remote desktop viewer doesn't run smoothly

I have an acer aspire one running ubuntu 11.10 I am trying to connect to my desktop computer recently built from new parts running Ubuntu 10.10. I do understand that the problem could be due to the older OS. But after connecting to my desktop using remote desktop the control of my desktops' desktop is unusable. For example I am not able to close a window or open a file or even right click on the desktop visually from my acer. When im on my main computer (not my acer) i can see the mouse moving around and opening and closing windows ect. but once again i can not see this visually from my acer. please help

ProblemType: Bug
DistroRelease: Ubuntu 11.10
Package: vinagre 3.2.1-0ubuntu1
ProcVersionSignature: Ubuntu 3.0.0-16.29-generic 3.0.20
Uname: Linux 3.0.0-16-generic i686
ApportVersion: 1.23-0ubuntu4
Architecture: i386
Date: Tue Mar 27 23:05:17 2012
ExecutablePath: /usr/bin/vinagre
InstallationMedia: Ubuntu 11.10 "Oneiric Ocelot" - Release i386 (20111012)
ProcEnviron:
 PATH=(custom, no user)
 LANG=en_US.UTF-8
 SHELL=/bin/bash
SourcePackage: vinagre
UpgradeStatus: No upgrade log present (probably fresh install)