So! Fun fact I just learned about the CC3 to Blender pipeline:
Normal maps get inverted on export from CC3. So this whole time I have been using inside out normal maps, which explains why I have always had such a difficult time getting things to look right inside Blender and UE4!