You did identify yourself as hailing from hidden Rain in Sarobetsu during the day, but when you returned for the actual battle it happened in the gloom. So, plausibly the civilians may not know who the combatants were affiliated with either, and given that war actually did break out this may well be attributed to Hidden Leaf, at least at first. I think there's enough info for them to suspect your survival but not to confirm it entirely (once news finally arrives that conflict happened near the border and they notice Haru/Jun hasn't checked in in a while.) Though it's always possible the wandering patrol comes across you more directly, I suppose.