I did it! Oh my god, I finally got those OnMouseDown scripts working. For some reason it was picking up a collider right behind the objects instead. I just had to disable the collider, since it wasn’t used for anything. Woo!!
I actually feel quite silly, considering I wrote up a huge script to try and fix it, yet the solution was so simple.