Pull the flapper valve out and run the bike without it.
A thin washer between the bearings on the LHS should reduce the clearance in theory. Be careful it doesn't bind up and cause more issues though.
Seriously, many have reported the clack of the powervalve (at idle) being much more noticable after a top end and clean up.