Yes, while thae audio will be in digital form going down the USB lead the USB adds another
ground return to the system thus creating the ground loop and causing the noise, when you
remove the usb cable the noise stops as you loose the extra earth return cutting the
ground loop. (an earth is still an earth at the end of the day wheather on a digital
system or an analog one)