Speaking to a Mozilla guy he recommends you to file this as a bugreport over at Log in to Bugzilla
Before you do that, in system settings where you can tweak your windows installation for default, visual effects or performance. If you click performance (dunno if you need to reboot or not), does the same artifacts show up (that is when you dont use any visual effects for the window decorations, just plain old grey borders)?