Exploring and Understanding the Limitations of Nb SRF Cavity Performance