@kamimatsu: I do use windows, but it's not that, it's absolutely the mouse, if I plug my laptop mouse into my main rig, it works just fine.

Vise Versa, if I plug the problem mouse into my Linux laptop, the problem shows up there too.

@zenitix: Maybe it's whatever is registering the click. Like, if it's just less than what you need for a click and it goes just under during the click. You get a click, a release that didn't happen, then it goes back.