Are you drinking any sodas or juices?
Just sticking to water and black tea/coffee is a simple way to tone down empty calories 

 I have a soda on occasion. Maybe twice a week. I drink a lot of ale though...