I think it's fine because rubbing is meant to dislodge debris or buildup, and I still use regular cleaners like Complete to disinfect/store the lenses. But it seems like almost no one else does it, or at least talks about it.
(The reason I do it is because saline is much cheaper than disinfecting solutions.)
>>> Is it ok to rub and rinse contact lenses with saline solution?