How to answer phone calls with local AI models

Download an AI model for speech to text

You can use the following Speech to Text model

https://huggingface.co/ggerganov/whisper.cpp

Dowload Speech to Text model

Download model file
Figure 1 - Download model file

Copy model file to C:\\AIModels folder
Figure 2 - Copy model file to C:\\AIModels folder

Download LLama 3 model from Hugging face to c:\AIModels

In the following video, you'll be guided through the process of downloading a GGUF-based language model from Hugging Face to use with Ozeki Chat. The video starts by navigating to huggingface.co, where you'll learn how to access the Models section, filter by Libraries, and search for your preferred GGUF model. Once you've found the right model, the video will show you how to download the GGUF file and properly place it in the C:\AIModels directory, preparing it for integration with your Ozeki Chat setup.

Navigate to the huggingface.co website, highlighted in Figure 3.

Open huggingface.co page
Figure 3 - Open huggingface.co page

Click the Models tab near the top edge of the screen, filter for Libraries, then GGUF in the left panel, as you can see in Figure 4.

Select GGUF models
Figure 4 - Select GGUF models

Search for the model you wish to install, and click it (Figure 5). In this example, we'll be using the following model:

Meta-Llama-3.1-8B-Instruct-hf-Q4_K_M-GGUF

Select model library
Figure 5 - Select model library

Open the model's Files and versions tab. Look for the .GGUF file and download it, as illustrated in Figure 6.

Download model file
Figure 6 - Download model file

Locate the file you have just downloaded, and place it in this folder, as depicted in Figure 7:

C:\AIModels

Figure 7 - Copy GGUF model file to C:\AIModels

Setup AI models and chat bot

Open AI studio
Figure 8 - Open AI studio

Create Speech to Text model
Figure 9 - Create Speech to Text model

Select model file
Figure 10 - Select model file

Create Text to Speech model
Figure 11 - Create Text to Speech model

Select voice
Figure 12 - Select voice

Create GGUF model
Figure 13 - Create GGUF model

Select model file
Figure 14 - Select model file

Create AI Chat bot
Figure 15 - Create AI Chat bot

Select model file and disable welcome message
Figure 16 - Select model file and disable welcome message

Disable reset message
Figure 17 - Disable reset message

Enable chat bot
Figure 18 - Enable chat bot

Create VoIP phone line

Open Chat Gateway
Figure 19 - Open Chat Gateway

Add new AI agent
Figure 20 - Add new AI agent

Install VoIP Phone connection
Figure 21 - Install VoIP Phone connection

Provide SIP Settings
Figure 22 - Provide SIP Settings

Set AI models
Figure 23 - Set AI models

Connect to PBX
Figure 24 - Connect to PBX

Create new incoming route
Figure 25 - Create new incoming route

Create new outgoing route
Figure 26 - Create new outgoing route

Make a test phone calls

Incomming call received
Figure 27 - Incomming call received

Voice questions and answers
Figure 28 - Voice questions and answers

More information