Sounds plausible to me. However, now that you've got a brass bushing this problem will not appear again :)

Is this the metal part? I just rode last week and when I actually stop I have the hardest time finding Neutral. But, the damn bike sure can find Neutral when I'm riding the trails.

Do you think this would possibly help that?

Thanks

No. The hard to find neutral is a feature...

As long as your bike finds neutral only between first and second while riding all is good. :)