That looks like the remnant of the face the extrude leaves at the horizon line when you're using a mirror modifier. That is normal, since the extrude creates faces, it leaves that one behind because it is at the horizon line. If you had "clipping" enabled in the mirror modifier, that face would get deleted as soon as you made the extrusion.