That's not quite true - images are only shared if you attach the image to federated content, such as a post or comment. Then yes other instances will cache the image.
If you never do that, and just upload an image accidentally like OP then it will not be federated AFAIK.