Let us inscribe in a circle of radius 9 a rectangle ABCD.
Obviously the point of intersection of the diagonals AC and BD
is the center of the circle.
Triangle ABC is a right triangle at B whose hypotenuse AC is 9 units.
Let us call ∠ ACB = θ
then AB = 18 sinθ and BC = 18 cosθ
Hence the area of the rectangle ABCD is A(θ) = (18 sinθ)(18cosθ)= 162 sinθ2
A'( θ )= 324cos2θ
A'( θ ) = 0 implies cos2θ = 0 that is 2θ =90 and finally θ= 45º critical point
Then A''( θ ) = -81sin2θ and A''( 45)= -81 <0.
Then by the second derivative test the function A(θ) = (162) sinθ2 has a max at θ=45.
This implies that the rectangle inscribed in a circle with maximum area is a square.
In our case the side of the square has length 9√2.
The area of the inscribed square is A = ( 9√2)2 =162