Coffee has insoluble fiber which will keep some of the existing fiber-loving bacteria in your colon until you’re producing enough bile to actually break down the fat you’re eating. Your colon might hate you until the bugs in your gut have adjusted.