I care what you think, and that doesn't make me dishonest or pathetic. Actually, I just balance it another way. I care, but you're not going to push me around (without my agreement), because I have a solid reality check and I know manipulation and delusionality when I see it.
I think many people protect themselves by "not caring what anyone thinks" (kind of a lie, but they're free to lie to themselves or take a breather or keep things private). But you don't have to protect yourself on that level. You can manage any fallout another way - by using your reason.
I guess if your sense of reason is weaker, it can really help sometimes not to care. But if you have a strong enough sense of reason, you can care - you just apply a reality check and make your own decisions as you have every right to do.