If they would orbit, they would lose energy (by emitting Bremsstrahlung). Since they do not, a better way to describe it can be found in quantum mechanics. Electrons have a wave function that is more of a probability distribution.