That's not entirely correct. The Ultra-Orthodox spectrum is composed of different factions/sects that hold widely varying beliefs and interpretations of Judaism.
While a majority of Ultra-Orthodox are represented in the current government, there are also some Ultra-Orthodox factions that reject the Israeli state completely. Some won't fight due to their religious studies, some due to their pacifism, some due to their pro-Palestinian sentiment, and other will fight because of their convictions or their desire to settle in the west bank.
The infighting between these groups and their sometimes messianic beliefs and discussions are sometimes very intransparent from the outside. Sometimes internal feuds even erupt in street riots between groups or police.
I like my coworkers. I mean it; they're nice people.
But I want to spend time with the people I deeply care about, who share the same hobbies or have a similar vision of the world. I can't express myself freely around coworkers as I can with people I choose to be around in my free time.