>>272513118
There are already some research projects on voice "style transfer" a la the visual style transfer stuff already out there. I don't think any of it is close to real-time though. 
https://github.com/andabi/deep-voice-conversion
https://github.com/mazzzystar/randomCNN-voice-transfer/