To start, let's sub in the y=kx to get f(x,y) only in terms of x. This makes the equation k3x3+m / (x2 + k4x4). Now depending on what m is, we can simply use l'Hospital's Rule to find the limit. Bear in mind that we can only use l'Hospital's rule a maximum of 2 times before the denominator becomes a constant (2 + 12k4x2 for x=0). I'm assuming that based on your parsing that you're looking for which of the 5 options gives you no limit = 0 (let me know if this is wrong and I can edit my response. So let's look at values around the cutoff points.
m=1: For this we get 12k3x2 when that constant is reached, so this gives us a limit of zero.
m=-1: For this we get a numerator of 2k3 when that constant is reached. This gives us a limit of k3 which can be zero if k=0.
m<-1: In the special case that mโ{-2, -3}, we get a constant in the numerator before the denominator becomes a constant. If kโ 0, this limit will approach ยฑโ. If k=0, we can simply take the limit as kโ0 and note that the numerator becomes a constant before the denominator, making this c/0 going towards ยฑโ.
In the case where m<-3, we get a value approaching ยฑโ in the numerator and 0 in the denominator. This approaches ยฑโ as well.
Thus, the only solution that gives you a non-zero limit is m<-1.