i wouldn't. it won't hurt anything, but i love air con. once you've had it, you can't go back to not having it.
if you do take it off, be careful ndoing any joints. let the gas out of one of the service ports (like tyre valves) slowly first (actually you should have the gas proffesionally recovered as it is a CFC and contributes to global warming, but it came out in crash right?). this gas is under pressure and can freeze you when you let it out. wear hand and eye protection.