I've used the edge of a spoon to peel them kind of like ginger depending on how thick the skin is.  But you can also leave the skin on.