The correct way to deal with wasps or bees is to funnel them out through a window, if possible. If not, don’t get agitated. They absolutely do not care about your existence, as long as you don’t try to harm them.
Flicking a wasp/bee off your arm isn’t superclever. It won’t die, and it will know something harmed it - these animals have advanced eyesight, and see better that you’d expect. It takes several minutes before they calm down.
Wasps are starving in the autumn, but not aggressive. If one is crawling into a sleeve fx, either take a piece of clothing (like a t-shirt), and use it to grab and encapsulate it, or else get a hard object (the bottom of a glass will do) and rapidly crush down on the insect. I usually smash it with a flat palm if I become really annoyed. It will not have time to sting.
This last bit probably merits an explanation... The stinger for both wasps and bees is composed of two ‘daggers’ which move against each other, controlled by at least two muscles. It takes the insect a moment to prepare injecting poison.