It just seems to move faster since we fall asleep more often?

No, actually they say that our brains have a kind of frame rate, like a movie camera. When we are in crisis mode, the frame rate speeds up (which is why those in a crisis say "I saw my whole life pass before my eyes"). In old age, the frame rate may decrease, as life settles into a routine, there are less new experiences, and the brain doesn't need to record as much. If you don't like it start having new experiences or crises!