Wanted to share this as this seems to be good option:
If you are accessing you Linux machine from VNC then you can try x2go.
Pretty straight forward installation, with packages available for both Ubuntu and Fedora and most other common distros as well. Just install, change one line ( visit the link above) and you are done. Neat, I must say.
Do try it when you feel the need to do something new.