Strictly an intuitive answer, but you know that if you are solving a problem in Rn, you will need n variables and n independent equations. You know this from Algebra 2.
The variables are represented by the column vectors and the equations by the row vectors. If you have three independent equations, you need 3 variables that make them work and your answer lies in R3; if you have 4 variables, and three equations either one variable is irrelevant because you are in R3, or you need a fourth equation because you are in R4.
Any additional data in the form of irrelevant data (x,y,z,w in a problem that uses x,y, and z, but not w), or superfluous (dependent) equations simply don't change the rank. A rank 2 matrix answers problems in R2, rank 3 in R3.