There is no problem with milk for those that can tolerate it, I for one have a semi-intolerance, as I call it, a bit of cheese (less than what others might eat in a day) brings me out in painful inflammations, so I avoid it generally...but I still enjoy the odd ice-cream, and Danish Blue, 'cos although it doesn't like me, I like it.
Milk also has the ability, or has been shown, to shrink fat cells...studies show that people who drink milk have lower levels of bodyfat than those who do not. I've never noticed that anyone who drinks milk, where there is no intolerance/allergy, has a bloated stomach, quite the reverse, since a friend always has milky coffee, or at least he used to, and he was stick thin, with a stomach flat as pancake.