I agree with your assertion about "justice"... but I do so out of respect for life. What is the problem with the harm others do that cause us to remove them? That the harm they do effects the life, liberty, and pursuit of happiness for others.
If not life, liberty, and the pursuit of happiness... or at least either life or liberty... what is the point of sustaining society at all?
You must have some principle in mind, otherwise you support society for its own sake.

__________________
"Man lives in the sunlit world of that which he believes to be reality. But unseen by most is an underworld, a place that is just as real... but not as brightly lit... A DARK SIDE!"
-opening from Tales From the Darkside