Ok so going further I found that the issue is with C6 the 1nf capacitor, I took a vco out and blowing a fan on it brings the pitch down very quickly and i figured out the bringing a bag of ice near (not touching) that capacitor causes the pitch to go down VERY quickly (yes im being safe not to get things wet i just needed a quick temperature change.) So the C6 cap is the culprit
This is the one connected to pin 11 of the 3340 but im not sure where i would get a better one, the 1nf i got came from tayda along with the rest of my components