If you're willing to deal with terminal, you don't need a gpu at all. You can merely connect over serial (which could be a DB8 connector, or an ethernet connector, or whatever), and a directly plugged in screen/keyboard (which is usually also supported, though maybe not over HDMI or anything) will also work.
And to be honest, if you want to play with servers, you should get used to terminal- it will do you a lot of good in general.