While there's probably some settings that could be changed in Unity to improve the conversion process, baking the Normal map in Blender was simple and produced better results. The Unity converted grayscale map was over-corrected with harsh color transitions and the resulting bumpiness was rather distorted.