Some believe that they irritate others as bearers of a certain social role, as a mother with a wheelchair or a small child, as a grandmother, as a teenager, etc.
Do not fool yourself, others do not notice the legions of young mothers, teenagers and grandmothers. And if you irritate someone, then irritation is caused by you - specific behavior, inability to behave normally in public places and count with other people. Passers have many of their concerns, they are unlikely to specifically hate certain groups of people, they have neither the strength nor the time to do so.
Just think about it.