Yeah, he's definitely more "fuck the Silver-Bloods and the Stormcloaks" because hey, fair's fair, the Forsworn were there first. Just doesn't mean he has any less of a beef with the ones who've tried to kill him.

(Also, the part where Madanach either didn't actually tell his people not to kill Van on sight, or they elected not to listen.)