chenjd/azure-openai-gpt4-voice-chatbot

azure-openai-gpt4-voice-chatbot

This project demonstrates the integration of Azure OpenAI service and Azure Speech service to create a chatbot that users can interact with via voice.

What is the difference between Azure OpenAI and OpenAI

Azure OpenAI Service provides customers with access to advanced language AI capabilities through OpenAI’s GPT-4, GPT-3, Codex, and DALL-E models, all with the added security and enterprise support of Azure. Co-developed with OpenAI, Azure OpenAI ensures compatibility and a seamless transition between the two platforms. By using Azure OpenAI, customers can leverage the same models as OpenAI while benefiting from the security features of Microsoft Azure, such as private networking and regional availability. Additionally, Azure OpenAI promotes responsible AI by offering content filtering capabilities.

Comparing Azure OpenAI and OpenAI

Installation

Create a virtual environment:

python3 -m venv venv

This will create a new virtual environment in a subdirectory called "venv".

Use pip to install dependencies:

pip install azure-cognitiveservices-speech
pip install openai

Blog post

Integrating Azure OpenAI and Azure Speech Services to Create a Voice-Enabled Chatbot with Python and GPT-4

azure-openai-gpt4-voice-chatbot's Issues

How is it possible to stop voice to text and/or gpt-4 text generation when keyword is detected?

To create a fully human like bot sometimes we need to be able to "interrupt" bot, to achieve that we use continuous listening for keyword and cancel gpt-4 and/or text to voice generation tasks.

But! I am not familiar with Azure and Bot framework, how it could be done here? Thanks!