The mirrors were a bit of a struggle to get on until, like you, I figured it out. My issue was getting the clamp opening squeezed closed enough to get the bolts in. Did not need to remove the windshield, although that is easy to do.
Tip: if you ever do remove the windshield, pay particular...