It’s not quite as simple as dragging the Server app to the Trash. Here’s how to get rid of Server properly.
uninstall
Using Installer to see what was installed, and manually removing the different components.
The worst software seems to go out of its way to remain, like a stain on your clothes, and can even render OS X unstable.