It really is bad compared to KVM. Though for my usecase of pandoc+vim, running Debian with VMware does the job. Browsing the web, watching videos, and listening to music are okay too. It's very bad for GPU accelerated stuff though which is what the Windows host is for.
I want to dual boot again but I'm still working on this project on one of my SSDs so I don't want to touch anything yet.