Use TTS - STT with Mistral-7b or Other LLMs for an Offline Voice Assistant
This repository is dedicated to the research and development of an offline voice assistant using Text-to-Speech (TTS) systems integrated with Large Language Models (LLMs) like Mistral-7b.
The goal is to create a reliable offline voice assistant, especially considering the vital role of TTS in such systems. While there are solutions like Whisper AI and Bark AI available, there's a lack of information about their compatibility with LLMs.
-
If anyone has experience or knowledge about the integration of Whisper AI, Bark AI, or similar systems with LLMs, your insights would be invaluable.
-
For those who have worked with Google Colab notebooks demonstrating the use of TTS with LLMs, sharing such resources would be of great help.
-
Additionally, information on any TTS AI systems compatible with LLMs would be much appreciated.
As this project progresses, all findings and solutions will be shared with the community. Contributions, insights, and feedback from the community are highly encouraged.
These are the resources we've found so far that can help with integrating TTS with LLMs and setting up an offline voice assistant:
Click to show videos!
- ChatGPT AI Voice Chatbot Build Using React and FAST API
- Description: ChatGPT Al Voice Chatbot Build with React and FAST API Combo Develop a human-like voice assistant with ChatGPT and Eleven Labs to make one of the most advanced Chatbots today so that you can prove that not only will coders survive the Al transition happening right now, but that they will thrive. With just some basic knowledge on python and javascript, you are going to build Rachel Chat, a chatbot which uses the power of ChatGPT for conversation, whether it be for sales, teaching you Spanish (or any language) talking about sci-fi movies - whatever your interest and application is.
- Link to Video
- Link to Code
- Last Download if code is no longer there.
- Course On Demand Thank you!
- JARVIS : A ChatGPT (OpenAl) Powered Raspberry Pi Based Voice Assistant
- Description: Welcome to the future of Al assistants! In this video, we introduce you to JARVIS, a revolutionary Raspberry Pi-based Voice Assistant powered by ChatGPT from OpenAl.
- Link to Video
- Link to Github
- Arijit1080 Thank you!
Remember, the field is vast and ever-evolving, so always keep an eye out for new resources and updates. And if you come across any resource that can benefit others, please consider contributing by adding it to this list.
All information and resources provided in this project are 100% open source. While there's no formal license in place, we kindly request that if you use or adapt any content from this project, please credit this original repository. This will help us gain more traction and further the development of this initiative.
We value each and every contributor to this project. All contributors will be credited and acknowledged for their efforts. If you contribute, please ensure you add your name or handle to the list of contributors or send a notification so we can do it on your behalf.