What is the Ruling on Leaving Off the Jamaah If Someone is Deserted?

It is permissible to leave off the Jamaah (congregation) if someone is deserted, cast-off (by the people), and he is unable to bear attending the congregation, as was the action of the two companions of Kaab bin Malik, may Allah be pleased with them. That's because, there is no doubt that it is from distress and embarrassment that a person comes to the masjid with the congregation, (and) he is not greeted with salam, his salam is not to be replied to, deserted, and cast-off. This person would be unable to bear it. This is an excuse (for not attending the congregation) as per the statement of the scholars.