Yes, milk works best here.
Capsaicin in almost insoluble in water but soluble in alcohol. Vodka might help, but a lot needs to be consumed at high concentration to be of any effect. Milk casein has a detergent like effect on capsaicin, solubilizes it and reduces the burning sensation.
Best
Sanjay