I generally prefer to run everything out of GUI mode. If I need to do anything useful other then browsing the Internet and looking at pertty (Intentionally misspelled) pictures, I just switch over to my command prompt. I'm also real keen on just alt tabbing between windows and being able to view multiple ones at the same time. Sure, alt+f1-6 is real neat and all, however, it's just a lot of a pain in the [censored] for me unless you really are masochistic or extremely direct to the point. X Displays are very handy. I'm rambling now and not making much of a point. I'm going to blame that on the fact that I'm very tired and it's too god damned early.
If'n you'd like to talk more about X Servers or the fun that ensues when using them, just lemme know.