It works on both sides! I’m persistently called a ‘young man’ even though I’m a fifth-tenth. What is "man"? No, I have not heard such a word.
So about what you are called "woman" instead of "girl" I see some pattern.

Judging by the movies, Americans think that we call each other ‘comrades’ and don’t experience similar problems.