They do eventually lose their stickiness, but yes, you can mount things vertically, including smartphones and hard drives.
I guess they have to be washed every so often to maintain their stickiness. After I slapped one on the dirty exterior of my car, I found that it didn't hold as well.