mate, on most cv joints ie the splined bit that goes into the gearbox (diff) there is usually a spring clip, you need to prize that out before the joint will come out the box.

if you just yank on it, you will do as you did and pull the tri bearing out the joint.

there is nothing to physically hold that in place, other than once everything is bolted up it cant come out.