Why the hell does he have a modern gun?! [Heretical Last Boss Queen]

Context: the setting of the anime somewhat leans on the medieval period. I would understand it if he had musket but a modern gun just took me out of it.