Where does the time go? It doesn't go anywhere, we are and it is always 'now here'. Maybe the question is 'where do you go' when you realize time has 'flown' or 'passed by'?
Moving onto yoga. The physical postures are a small portion of what yoga actually is. The physical postures are just a way to continue the practice of yoga which can be summed up in Patanjali's Yoga Sutra's as 'the science of mastering yourself over your mind.'
What is there to master? How can you master the mind? Is it counter intuitive to attempt to overcome the mind?
The mind, in my opinion is a machine. It's like 'Hal' from 2001 you know? It gives you information even when you don't ask for it and can hijack any situation. It also obviously is useful and can work with us.
To master the mind is to throw out the garble and keep the gold, be present in the chaos and have the capacity to know and sink into your own stillness.