JP C. answered 10/16/19
Expert piano and music theory instruction for all levels and ages!
I'm unsure why exactly it is called "whole" when the word suggests that the note is complete and full and at the top of the hierarchy. Until you learn about longer notes... You mention a point that many musicians take issue with. Our notation system is far from perfect. I constantly remind my students that everything is context dependent, like you rightly say. Another argument is the use of measure (bar) lines altogether!
Might I suggest the alternative terms? Breve, crotchet, quaver etc? :-)