Which window rubbers do you mean exactly?

Is the paint work well cleaned and waxed? That should help with removing anything that shouldn't be there.