Vegans: Can you turn back... ?

... to your old eating habits or would you experience problems (especially with milk products)? I'm talking from a health standpoint, not an ethical one