
Ben R. answered 07/13/19
MC CS, Rutgers
I pipeline is used to pre-fetch instructions from memory into the CPU so that when the CPU is ready ofr an instruction it's already there and the CPU can just go ahead and execute it, instead of waiting for it to come from memory. That's how you get one instruction per CPU clock cycle. Otherwise, the CPU has to just sit there for the memory to respond (which in CPU clock time is a looooong time).
So the depth of the pipeline is measured in how many instructions it can pre-fetch and store ahead of time.