---

What is Ozeki AI

Ozeki AI Server is the software you need if you want to build a Local AI system. To run AI models locally, you need a computer with a GPU or NPU and you need a software that will run the AI Models. Ozeki AI Server is the software that runs the AI models on your computer. It provides a chat user interface to ask questions from the AI models, and it offers ready to use AI services and APIs to use these models.

Why is it better

Because other AI execution frameworks can only run one AI model at a time. If you use Ozeki, you can run multiple models at the same time. Runing multiple AI models gives you a huge advantage, due to the fact that specialized AI models do a better job than general AI models. For example the Qwen coder model is way much better in writing computer software, the Flux model is better in image generation, and the NVidia trained Nemotrom LLm is better then ChatGPT for standard AI chat. With Ozeki AI server you can run all of these on the same computer alongside each other.

---

Get started

---

How can I use Ozeki AI

The two most common ways are a chat inteface and an API. Human users interact with their AI models through the chat interface. The chat interface can be acccessed through a webbrowser (Chrome, Edge, Safari, Firefox, etx) or through a downloaded chat client. Any user can download an Ozeki chat client to enjoy faster access and more productivity. Software developers use the Ozeki API, which is compatible with other AI APIs, such as the ChatGPT API or CoPilot API. This makes switching easier, and development costs can be significantly reduced if developers build AI apps on a local AI systems powered by the Ozeki AI Server software.

---

Benefits

The greatest benefit of Ozeki AI is that it makes it possible to run multiple AI models on the same hardware simulatanously. This way you can utilize your AI hardware to the fullest extent and you can save on hardware costs. The Ozeki AI software will make sure that the AI models are loaded and unloaded when needed and the hardware resources are utilized to their best ability. This is achieved by combining a time sharing and parallel execution approach with a state of the art resource allocation algorithm.

Ozeki AI server offers other benefits as well:

---

What is in the package

When you download Ozeki AI Server, the package will include a set of apps that work together to bring you a complete AI experience. The most useful item is the AI gateway, because it allows you to create amazing AI services for your users.

---

AI services

AI services take the power of AI models and connect it to real-life systems that are used by organizations on a daily basis. For example the Ozeki AI Server allows you to connect your AI models to communication channels, such as E-mail, Phone or SMS. It also makes it possible to interact with databases in human language. With Ozeki AI, custom AI apps can be written to create amazing AI services for any business. Check out some of the AI services you can create:

---

Run Large Language Models (LLMs) with local knowledge

Ozeki AI allows you to setup AI chat bots to support your team with local knowledge. This means, that you can run GPT chats locally with your own data. If you introduce Ozeki AI technology in your business, you can make your team more efficient by helping them with smart AI chat bots trained on information specific to their jobs. You can setup AI chat bots with custom prompts that define their behaviour for different organization units, such as Customer Support, HR, Sales or to support the productive work of the Marketing Department.

Ozeki AI Quick Start Guide

---

Use local and on-line AI models

Ozeki AI is a local AI chat system, but it also allows you to use on-line AI models such as ChatGPT, CoPilot, Anthropic, Perplexity AI and others. If you find an On-line AI service, that performs better for a certain task, you can simply set it up using an API key and use it as if it was a local AI model. You can use On-line AI models to answer e-mails, make phone calls or provide AI voice assitance the same way you can use local AI models.

Mixing the power of local AI models and on-line AI models and using the one that offers the best results for a given task is the best way to work with AI.

On-line AI models are also a good choice if you don't have the required hardware capacity to run AI models locally.

---

What is an AI pipeline

The AI pipeline can also be called as AI automation. It is a technology that allows you to create a flow chart that can be used to create automated workflow or to build more intelligent chat bots.

The Ozeki AI pipeline can also be pictured as a chain of prompts and commands. It can be setup to achieve better results when automating tasks with AI. When a question is forwarded to the AI piplene, prompts are executed one after another to provide a better response at the end. You can design your custom AI pipelines by writing multiple prompts and passing the output of one prompt to the next. The AI pipeline can also include automation nodes, that lookup informatoin or trigger communication through various channels.

A simple AI piplene we use at Ozeki can be pictured as follows:

---

Use multiple channels

An AI chat bot created in Ozeki AI, can be accessed through multiple communication channels. The same chat bot can answer through chat, SMS, WhatsApp, E-mail, Voice calls, or through the API. This is useful because customers can get in touch through different channels, and often the same intelligence is required to serve them properly accross all channels.

---

Prepare task execution for your employees

The Ozeki AI chatbot configuration form, allows you to setup preparation prompts. This feature makes it possible for management to design custom chat bots for specific jobs. These chat bots can be prepared with chat history, knowledge bases, response prepration prompts and instruction prompts. The prepared chat bots can be used by employees during task exectuion and they will get better results to the prior knowledge added to the system by management.

---

Custom bots for custom jobs

A single chat bot cannot serve all the needs of an organization. Custom tasks require different prepration, different instructions and often different AI models (Figure 5). Ozeki Chat can run multiple chat bots simultaneously. Team members can use these chatbots from their mobile devices, laptops and desktop computers. As each chatbot is a friend in the contact list in Ozeki chat, a single person can communicate with multiple chat bots at the same time as their task demands it. For example one chatbot can generate appropriate images, and another can generate text.