Open Access Open Access  Restricted Access Subscription Access

DeepVoiceMirror: An Emotion-Sensitive Self-Speaking AI Companion

Malini M, Priya Dharshini S, Rakshani D, Jones Geneva D, Dr.Kamalaveni V

Abstract


Such systems can be utilised to foster personal well-being and mental health, and are emerging with the development of technology in artificial intelligence (AI) and human computer interaction. Technology-based lifestyles are, more and more, requiring emotional self- sustenance. People are stressed and anxious, they are lonely and needing support. Traditional virtual assistants provide information, but none of them actual goes out of their way to take a personable approach and understand users. Thus we have an AI that can mirror emotions and act. DeepVoiceMirror is a system that uses real-time voice-based interaction to listen, understand, and react to human emotions. To give users a self-speaking mirror effect, the framework combines voice authentication, speech recognition, sentiment analysis, and voice cloning. High emotion recognition accuracy, human interaction via voice synthesis, and sympathetic reactions to promote introspection are all guaranteed by the suggested solution.


Full Text:

PDF

References


"AI in emotion recognition: Advances and challenges," IEEE Transactions on Affective Computing, 2022, K. Qian, Y. Zhang, and B. Schuller.

Resemblyzer (2024). Voice Embeddings to Confirm the Speaker. accessible via https://github.com/resemble- ai/Resemblyzer

TextBlob (2024). Text classification using basic NLP. accessible at: https://textblob.readthedocs.io

Coqui TTS. Open-source text-to-speech toolkit (2024). accessible via this link: https://github.com/coqui-ai/TTS

Speech Recognition (2024). Python speech recognition library. accessible via this link: https://pypi.org/project/SpeechRecognitio/

Streamlit. (2024). Data apps and machine learning framework. accessible at: https://streamlit.io

"Deep learning for personalized speech synthesis," by T. Taigman and Y. Bengio, NeurIPS Conference, 2021.

"AI Companions for Mental Wellness: A Review," Journal of AI in Healthcare, 2023,

A. Kumar, S. Mehta.


Refbacks

  • There are currently no refbacks.