After playing around some more both in Unity and Blender, I realised the lighting I had set up in Unity was pretty intense. I can now see that my AO map does make a very subtle change after reducing it!
Kent Trammell
replied
Glad to hear you solved it - Thanks for sharing your solution!