I have a feeling that my post is similar to the post "Picked object while rotating the model causes the movement to become jumpy".
What I have found is that I do not have this problem when I use a 3D Connexion Space Mouse. However, I don not wish to carry the heavy Space Mouse with me when travelling.
Any ideas?