Visual counterfactual explanations reveal how an image could be minimally changed to alter a model's decision. Existing diffusion-based approaches commonly edit along a long reverse denoising trajectory, coupling semantic editability with spatial control while repeatedly estimating clean images for classifier guidance.
We introduce FiRe, a fixed-noise refinement framework that maps the input to one intermediate noise level and iteratively optimizes the noisy state there. Pixel Mean Flow provides direct clean-image prediction, while dynamic dual masks, adaptive guidance, and early stopping keep edits localized and decision-relevant. Across five tasks on CelebA, CelebA-HQ, and CheXpert, FiRe delivers competitive or state-of-the-art counterfactual quality with substantially lower computational cost.