Richard P. answered 12/28/14
Tutor
New to Wyzant
It appears that it is possible to solve for b directly. The side of the larger square is 3, the side of the smaller square is sqrt(8). Study of a diagram and application of the Pythagorean theorem leads to the equation
b2 + ( 3- b)2 = 8 this quadratic equation can be rearranged into the standard form and solved using the quadratic formula. The result is b = 3/2 ± sqrt(7) /2 . Since b > a, the plus sign must be taken. So b ~ 2.822.
So the answer is 4)