You've uttered the phrase, "I'm from New York. No, not the city..." more times than you can count
When traveling -- both domestically and abroad -- when you say you’re from New York, everyone will automatically assume you mean New York City. You will see their face light up with interest, and joy, and intrigue, and that will all come crashing down when you clarify where you're ACTUALLY from. Even when you make it a habit to say "Buffalo, New York", the follow up question will 100% of the time, always be. "Is that in/part of/close to New York City?".
When describing where you live, you still base it off your proximity to NYC
While people in NYC can occasionally be blissfully ignorant of the state at large, living Upstate, your entire geographic existence is centered around where exactly you live in proximity to NYC. You know how many miles away you are from NYC and how many hours it takes to drive there in five different weather scenarios.
You're not a "New Yorker"
Those were "air" "quotes" by the "way". Strictly speaking, you are a resident of New York State, but the only people who refer to themselves as New Yorkers are people who live in the NYC area. Like, if you're from Buffalo, you don't refer to yourself as a New Yorker, you refer to yourself as a Western New Yorker.