IE9, Chrome, and Safari: background bleeds through border with border-radius

The corners look so ugly

How it looks in IE9 Platform Preview, Chrome 7, and Safari 4:

This has been filed as a bug on Microsoft Connect, and as Issue 33978 on the Chromium bug tracker.