This is a great example of why to check before killing/removing any bugs from your plants. Same thing when you see eggs planted on your leaves. It would suck to crush a bunch of assassin bug eggs on a plant.
I had yellow jackets build a nest inside one of my potted plants last year. On one hand, it's a little sketchy, on the other hand, wasps and Hornets are great multipurpose predators if they aren't located where they will bother you much.
Pro tip for killing the lanternflies: they are super quick and jumpy, but it takes a bit for them to build up a second jump, so once they land on their first, it's easy to squash them.