Id keep it red. If you want a white one, then just buy a white one instead mate. It would definatly de-value the car in my opinion and would massively limit your market when you come to sell it.

Having said that, im sure they'll still be plenty of people that wont be put off by a colour change, especially if you take photo's at each stage of the restoration.