The bracket that locates the caliper has nothing to do with pushing the wheel out, the plate bolts behind the hub, but not between it, so not pushing it out.
The only problems I can see is if the disk is thicker than the drum was, your using spacers, the wheels are too wide/wrong offset.
Steve