Annoyingly Word 2010 seems to like to convert certain symbols into these double line “Paragraph borders” that I do not know how to get rid of (or even how to put it in in the first place).
To get rid of these, highlight the lines around the border, and click the clear formatting button.