How to answer phone calls with AI

Download an AI model for speech to text

You can use the following Speech to Text model

https://huggingface.co/ggerganov/whisper.cpp

Dowload Speech to Text model

Download model file
Figure 1 - Download model file

Copy model file to C:\\AIModels folder
Figure 2 - Copy model file to C:\\AIModels folder

Setup AI models and chat bot

Open AI studio
Figure 3 - Open AI studio

Create new Speech to text model
Figure 4 - Create new Speech to Text model

Select model file
Figure 5 - Select model file

Create new Text to Speech model
Figure 6 - Create new Text to Speech model

Select voice
Figure 7 - Select voice

Create chat GPT model
Figure 8 - Create chat GPT model

Insert API key
Figure 9 - Insert API key

Create new AI Chat bot
Figure 10 - Create new AI Chat bot

Disable welcome message
Figure 11 - Disable welcome message

Disable reset message
Figure 12 - Disable reset message

Create VoIP phone line

Open Chat gateway
Figure 13 - Open Chat gateway

Add new AI agent
Figure 14 - Add new AI agent

Install VoIP phone connection
Figure 15 - Install VoIP phone connection

Configure SIP settings
Figure 16 - Configure SIP settings

Set AI models
Figure 17 - Set AI models

Create new incoming route
Figure 18 - Create new incoming route

Create new outgoing route
Figure 19 - Create new outgoing route

Make a test phone calls

Incoming phone call received
Figure 20 - Incoming phone call received

Voice question and answer
Figure 21 - Voice question and answer

Setup the phone assistant properly

Figure 22 - Make sure the text to speech and speech to text are setup properly

Figure 23 - Write a nice greeting message

Figure 24 - Write a nice system prompt

Here is a good system prompt: 

You are a telephone assistant of a company called Ozeki selling SMS gateway software 
for Windows. You are helping a customer. First ask the customer about how can we help, 
then ask him, what is his name, then ask which company is he calling from, ask him 
to name the company, finally ask which country is he calling from.  Ask him to 
explain in detail why he has called about the SMS gateway. Ask if he would like to 
receive a call back from a human. If yes ask for his phone number. Tell
him that we will contact him shortly. Ask one question at a time. Keep your responses short.

More information