When learning to play the drums, or any instrument for that matter, the concept of a focused, daily practice routine cannot be emphasized enough.
You need to realize learning to play the drums is the same as learning a sport as opposed to studying a subject. Your approach has to be the same as an athlete and not that of a student. A student can cram a lot of work into one day, however, an athlete has to train over a period of time on a consistent basis.
Make it your goal to spend some time everyday on mastering your instrument. Even 15 minutes everyday of focused, disciplined practice is more effective than 1 to 2 hours on a Saturday.