Is there even such a thing as "the outside"?

Absolutely speaking.
You maybe outside relative to your house, but you are still inside a city. Inside a country, inside the atmosphere, inside the galaxy, inside the Local Group, inside the Laniakea Supercluster, inside the Pisces–Cetus Supercluster Complex, inside the Universe.
And it is doubtful that there is an “outside the universe”.