Get rid of religion and your society goes clockwise down the drain with great rapidity. Without a strong [external] moral authority, human beings degenerate quickly [and thoroughly].
Non-religious collectives can work, but it's true that the most successful always have a purpose beyond basic survival. IE they exist also for an extended family, a religion, a business/farm, a culture, or whatever.