game3dstudios/convai-unrealengine-sdk

This Unreal Engine plugin integrates Convai API for conversational AI and environment perception and action-taking by the AI in Unreal Engine.

Convai-UnrealEngine-SDK

Convai enables NPCs with intelligence such that they can converse naturally with players via text or voice and can carry out advanced actions as an enemy, companion, or filler bot. This Unreal plugin has integrations with all of Convai’s APIs to integrate with your characters and game assets. Check out this overview video to learn more about this plugin, and visit the documentation for tutorials and more details. Feel free to write to [email protected] if you have any issues or questions.

Links:

• Documentation
• Overview Video
• WIP Tutorial Series
• Metahuman Demo Project

Character Conversation

Allows you to define a character and interact with it in real-time from inside the game, the possible functionalities include:

• Creating a character using a backstory, name and voice type.
• Interacting with the character using either text or voice.
• Update an existing character's name, voice and backstory.

Character Action

Allows your character to respond with intelligent actions based on player's interaction.

Speech To Text

Allows transcription of spoken audio to text.

Text To Speech

Creates a Sound Wave object containing audio for the corresponding text

Voice Capture

Allows very easy voice recording through microphone.