You see an orange or green dot and are curious. Who gave it and why? Currently you can't find out without giving some rep yourself. I propose a "Cancel" button after you view the rep. Sometimes you don't want to weigh in. You just want to view the comments.
I couldn't figure out how to simply view the rep. I though that I had to give rep since that was the only button to close the window. Didn't think of not clicking any button and clicking outside the pop-up (probably should have been obvious). But obvious or not, I didn't think of it, so I was suggesting a second button like "Cancel" or "Give no rep".