I'd remove the plate and see how it sits

We had a belt not running true not long ago on a zvh but the tensioner they had is a 1.3 cvh tensioner but it was bent so the belt wasn't sitting right it was kicking over (poor casting very brittle)

Ordering a new tensioner wasn't easy as nobody seems to stock them anymore ours came all the way from France! we tried the 1.6 cvh tensioner but the pulley was to big,

New belt new tensioner and it was perfect,