J.R. S. answered 10/16/20
Ph.D. University Professor with 10+ years Tutoring Experience
For a photon, frequency is directly proportional to energy as shown by E = hν
So, the transition that generates the most energy would be the one with the highest frequency.
n = 1 to n = 2 and n= 1 to n = 3 require an input of energy so you can rule them out.
That leaves
n = 3 to n = 1
n = 3 to n = 2
n = 5 to n = 3
You could use ∆E = 2.179x10-18(1/nf2 - 1/ni2) but since we have a constant, we can just look at 1/nf2 - 1/ni2
n = 3 to n = 1 -> 0.888
n = 3 to n = 2 -> 0.139
n = 5 to n = 3 -> 0.071
So the transition that would produce light of the highest frequency would be n = 3 to n = 1