In Ubuntu, the default application to open files of a certain type cannot be set from the Open With menu, like in Windows.
Instead, right-click on any file of the type and choose Properties > Open With. Choose the application you want to use as default and click Set as default. Done! 😊
Tried with: Ubuntu 12.04 LTS