decent torx bits shouldn't twist/ burr if they fit snug, and you have enough leverage - shouldn't be a problem.

I often find those cheap ones you get in sets are pants I've got through many of those.

I tend to buy hardened bits for common sizes, so I know they aint going to burr.