How I fixed the ? inserted at the beginning of email replies. Recently, Windows Live Mail began inserting question marks at the beginning of every email I would reply to. As it turns out the beta version of Internet Explorer 9, installed a few days earlier was the culprit. Once Internet Explorer 9 beta was uninstalled, my email replies started working normally again.