why bother changing a fuel filter just because it's rusty on the outside? if you do though, make sure you get new copper washers

that belt also drives the water pump, which is probably why it's overheated and spewed the rusty (not been properly treated with antifreeze) coolant all over the place. don't give that engine much longer.