Absolutely. In today’s world where gender identity is fluid, and pronouns can be confusing, being asked this type of question can be considered rude. I assumed because the man was my age, his question came from ignorance or curiosity but not malice. I was amused and still am remembering the encounter.