Fedora 4... as a server??? Bad choice and now you get to pay the price as it is no longer supported. The command for installing the whole X system with gnome, etc., might be something like;
yum groupinstall "GNOME Desktop Environment", which will install gnome and all its dependencies (including X).
Preferably though, you'll upgrade each of these machines to some OS with a better life, like RHEL, or its free clone, CentOS. I really suggest that if you're running servers (and asking the kind of questions that you're asking), that you bite the bullet and buy RHEL as you're paying for support.