Unless you pay for it, you can only have 5 friends on your contact-list on ASE (All Seeing Eye).

I've never had a problem with XFire, but then again, I never use the "join game" option...