Sounds very much like the problem I had here
It was indeed a ground loop problem. I had the KeyStep CV outputs plugged into the synth, the synth plugged into an audio interface, USB from the audio interface to a hub, and USB from the KeyStep to the hub. Inserting a ground loop noise isolator in the connection between the synth and the audio interface eliminated the noise.