I put them into my compost pile like many other scraps. How much potassium the skins themselves have is another thing though. I think you are better putting in something more quantifiable.
Dice put a link in this thread on the NPK analysis of a lot of common things like peels. It does not say specifically "banana peels" though.
http://www.tomatoville.com/showthread.php?t=16622