Why a mixer? Just an op-amp buffer will do the same thing as a mixer, right?
Furthermore, I would like to emphasize the output resistor. In the schematic, there is 1k written at the output, but it is not drawn. It will be necessary. An 4 or 8 ohm speaker will clip the output very hard again, and it might destroy the op-amp. The 1k resistor will drastically decrease the volume though. If it is too quiet, you might want to decrease the value of the transistor, but be careful to not draw more current than the datasheet for your particular op-amp specifies.
With this solution, you are effectively connecting your speakers to a pre-amplifier. To drive speakers correctly, you need an output stage. Although I like the mixer solution (it is quick and easy, and although less quick and easy than an op-amp buffer, you will end up with a useful mixer), if you chose to not make the mixer right now, you might want to use a “good” output stage.
It has been a while (12 years) since I last tried to build a simple quick and easy end stage. IIRC it was something like this.
The 8 ohm resistor at the output plays the role of your speaker. Don’t include it in your design.
The power rails must be at least ±3V, but you probably have standard ±12V available, so I put that in. The push-pull transistors should be relatively higher power. TIP31 and TIP32 are a bit overkill for this, but examples of some transistors I always have at hand.
The input resistors are just to scale down voltage to something a headphone speaker might want. You can play around with those values. Don’t put the headphone speakers in your ears before turning it on, just in case the volume is too high.
Push-pull configurations heavily distort the sound, but the op-amp feedback loop compensates for that. Any modern op-amp will be good enough in normal audio ranges.
You can connect this directly to your VCO, or other modules, or to the output of any pre-amplifier like a mixer.
There are better output stages than this one, but if I didn’t make any mistakes, this should do in most cases.