Whether or not a man considers himself religious, he still worships something. He cannot avoid it. Mankind was made for worship. He ought to worship Christ his maker, but in rebellion he may worship a myriad other things. 
Even for the atheist or anti-theist, It is not whether he worships, but what the object of his worship is.