After creating the second pair and rotating them, I hid the first pair then I pushed the second pair all the way down such that when i did a difference it would cut through till the bottom. Then I unhid first pair and did a union. Then I went into edit mode and removed all double vertices.
I have found that moving the object slightly before cutting (so the faces don't overlap) also solves the problem.