Do you have root shell access? You can run mysql to check on the user settings and set them, just to make sure.
Digital Ocean has instructions for setting up on their VPS doing almost the entire installation from the command line for Ubuntu. Perhaps their instructions concerning mysql will help?
https://www.digitalocean.com/community/articles/how-to-install-wordpress-on-ubuntu-12-04