Why can't you wear contact lenses in water?

Are they okay in salt water or is it just chlorine you can't wear them in?
>>> Why can't you wear contact lenses in water?