Check that your feed encoding is set to UTF-8, and that your server (e.g. Apache) is sending headers to suggest UTF-8 as well.

In Firefox you can right click on the page and select 'View page info' to verify this, or change the encoding in the menu: View->Character Encoding