Hey Patrick,
1) For two forces to cancel, one must be equal and opposite to the other. This means that the magnitude is exactly the same and the direction is exactly opposite. So in this example, it would be 20N to the east.
2) Here it will help to call one direction positive and the other negative, so we can just write it mathematically. I'll call East positive
- Resultant = Fnet = +10N
- Fnet = 20N - 27N + F3
- 10N = 20N - 27N + F3
- Just solve this expression for F3. Then use your +/- choice to go back to direction. So a negative value would be West, positive will be east.