Sometimes I find people least empathetic of all about other people's level of empathy.

Do you really believe that you chose all that?

Have you ever, say, aced a class that you worked hard at? If you hadn't studied, you would have done poorly or failed. Right? So you earned a good grade. But if you'd been someone else, you could have studied twice as much and still failed. Huh. And we also know that many people who realize they aren't good at something put in even less effort than average... given that they will (they believe) never be any good at this. (It can naturally start to feel like throwing good money after bad.) Meanwhile, someone else could have aced the test without any perceptible effort.

Are you seeing the connection?

Empathy is a skill like every other skill in existence. Some people are great at it, seemingly naturally. Other people suck at it, despite a lot of effort. And most people are somewhere in a very big and complicated space between those extremes. (I would recommend the following: try to get over it and be a little less judgy. But now that I've given you the message as clearly as I can, it's up to you.)