Having Antipathy (or worst) with Unity will make all Unity Patrols and Super Mutant Remnants encounters attack you.
