Yes, there will still be a contribution. The Fermi-contribution is zero, since no electrons are in the nucleus. However, the small Bohr-Weisskopf distribution persists since the magnetic field of the electrons still penetrates inside the nucleus, and the contributions of the different regions in the nucleus will not be the same.