Snapping to the vertex simply isn't working for me. I verified my snap settings, and when I hold control and mouse over the vertex I see the orange circle for the vertex I want to snap to, but nothing it's simply not snapping.
I solved it. Enable Snap To Face instead of Snap to Vertex and it should work without rotation enabled.