I actually had the similar problem, and sent in a bug report yesterday.
Every time I tapped on something, the bug report window would open. It may have started after I accidently opened up the bug report window too. I couldn't remember what I did to cause it to start occurring. But it constantly kept popping up.

Ipad 3. Latest iOS 5.1.1.