Though I have to wonder, would we be extending the same benefit of the doubt to right-wing appeasers?
Fascist ideological tenacity may not be as obvious but at this point the genocidal nature of their ideology has become eminently clear. Even if Nazism was stopped from raping and mass murdering its way through the Soviet Union it would still have a large number of victims to murder. Such as every Germany Jew, queer person, and socialist.
I don't think suppressing the pacifists is necessary, they clearly are not a significant political force, but in terms of consequences and priority their ideology is still genuinely vile. They would prefer to give the fascists more time to murder innocents just because they dislike war. I'm not going to pretend that pacifism never has any good points but WW2 is genuinely the worst possible time to be a fanatical pacifist. I doubt they're individually bad people but that doesn't make their political project any less unacceptable.