In the English language, we often use cliches and idioms, but these phrases are NOT meant literally. In your first example, Friend B doesn't want to be late, but this does not mean that he does not value John's feelings/needs. I agree that Friend B might be angry with John for not being ready to leave on time. But the expression is not hostile: "Forget about him. We'll meet him there." The polite thing to do in this case would be to text John and tell him that Friends A and B are leaving now and will meet him there.
The other phrase is, "If he can't take a joke, the hell with him!" This expression doesn't mean ignore him. This expression actually has more to do with the person who delivered the joke; it was not funny at all. Perhaps it was obnoxious or mean! Uneasy laughter from listeners. The jokester attempts to save face by uttering that expression.