Both are wrong the correct is : Tea is made with milk.
Why wrong :
tea is made from milk = Tea is not made of milk, milk is a just a small part of tea making ingredients.
tea is made of milk : Tea is not made of milk, tea is made of tea leaves And we can make tea without milk as well.
