Make sure you are fully updated (becuse there was a mouse driver issue in early FC6.
Make sure your mouse, nic, and video are on seperte IRQ' #'s.
Don't wiggle the mouse.
Lower the resolution and see if it is more stable.
Make sure your full monitor specs are defined in the X conf file.