My dad had a 80 xr3 so basically same, he changed the exhaust system, for a Janspeed, made a world of difference, so good gains to be had here, with a cam it should rev a lot freer at the top end as well.
tabetha