Scrolling left, right, up and down is easy in Vim using the hjkl keys. But, you can also move around by jumping between the results of a search or many other non-scrolling methods to change positions. It is easy to jump back and forward among these jump locations in Vim.
To jump back to an older jump position, press Ctrl-o
To jump forward to a newer jump position, press Ctrl-i
To view the jump list of cursor positions maintained by Vim, type :jumps
For more information see jump-motions in the Vim help documentation.
Tried with: Vim 7.3 and Ubuntu 12.04 LTS