Yes — once pressed firmly on a smooth flat surface, the sucker stays there on its own.
Pressing the cup down pushes almost all the air out from between the cup and the surface. Very little air is left inside, so the air pressure inside the sucker becomes much lower than the atmospheric pressure outside. The outside air now presses the sucker against the surface from every side, and it is held in place.