Don't let yourself get overwhelmed with prefixes, they actually make life easier! Russian as a third as many words as English, those prefixes just provide the shades of meaning that English has separate words for.
First off, not every prefix goes with every verb. And, not every prefixed verb is in common use in the spoken language. Keep in mind that the essential meaning of any verb that has the root of "пить" is going to be "to drink." But, that the prefixes just change the meaning slightly. You see it as having to relearn the verbs from scratch, but really you are just recognizing that the prefix changes the meaning slightly.