They use some granular synth techniques here from which you could start. It is basically an Arduino with 12 bit adc and dac and some additional memory. I am building a Kosmo version from it, but It is not yet ready and probably needs other controls for the granular synthesis stuff, but maybe worth checking out?