HAHA OH NO!! They'll turn on you if you accidentally friendly fire them, which is...really easy to do since they're just a whirlwind of death as you leave. I just hang back and let them kill a thousand guards and then loot quietly in their wake. And then I get to hang out with Forsworn in their cool cave clubhouse afterwards! Win-win.