Both QEMU and gem5 are capable of outputting graphics to the screen, and taking mouse and keyboard input.
https://unix.stackexchange.com/questions/307390/what-is-the-difference-between-ttys0-ttyusb0-and-ttyama0-in-linux
QEMU text mode
QEMU graphic mode
gem5 graphic mode
X11 Buildroot