It's because alkoxides are bad leaving groups, similar to hydroxide ion. Good leaving groups are weak bases. Worse leaving groups are stronger bases. Without strong acid, the leaving group cannot be deprotonated prior to departing.
Simple ethers have similar reactivity to acetals under basic/nucleophilic conditions. In acid, acetals are usually more reactive because they can form resonance stabilized oxocarbenium ions.

Matthew P.
03/17/19