Mine kept catching so i had to get them out. It'll be worth it in the long run.
Quite a few people i have spoken to agreed with you about taking all four out at once. They were quite suprised it was allowed.