Run Large Language Models Locally

Run GPT chats locally with your own data. Introduce Ozeki AI technology to make your team more efficient, by offering personal AI assistants tailored to specific jobs. Setup bots for Customer Support, HR or to support the productive work of the Marketing Department. Or simply setup a service that suggest AI responses to e-mails.

Quick start

Follow the instructions in our quick start guide and setup your system in 2 minutes.

Ozeki AI Quick Start Guide

What is Ozeki AI

Ozeki AI is a local AI execution engine, that allows you to run Large Language Models locally with information available on your computers. Use information in files, databases, CRM systems or websites to generate accurate responses.

Figure 1 - Local LLM and AI execution

Make your team more efficient

Create custom AI chat bots, with tailored prompts. Add customized short term memory (prepared context windows) and train the model with local information.

Examples

  • Create a chat bot with pre-defined chat history + custom prompts to provide accurate mission specific responses
  • Train a model with data in your support chat database
  • Setup automated AI actions: create an AI chat bot that prepares suggested e-mail responses
  • Create a web analizer AI chat bot: this bot can download webpages and can answer questions based on the information found

Benefits of using Ozeki AI

The greatest benefit is that you will become AI service independent and you can run Large Language Models (LLMs) locally. You can also use one or more online AI services if you want. You will not be tied to any single AI service. With this approach you can operate your system free of any recurring charges or you can optimize costs as new better AI offerings become available in the future.

Private

Chats and AI knowledge stay private

Ozeki Chat and Ozeki AI can be setup to run locally without Internet. You can use your private chat server and private LLM with your sensitive data stored locally.

Local

Use consumer hardware

Ozeki allows you to run LLMs on CPUs and GPUs. It runs on Windows. It can use Intel or AMD CPU, and provides great performance on NVidia GPU.

Personal

Use Files, CRMs and Databases

Chat with your local files, your local Intranet pages, use information in your CRM or SQL database. It works without internet and no data leaves your device.

Run Large Language Models Locally

Run GPT chats locally with your own data. Learn how you can use Ozeki AI technology to chat with your personal AI assistant, to answer emails using AI, to ask questions about websites and to make all of this more usable using local knowledge.

Open source AI models

Explore over 1000 open-source language models and take advantages of development and data training done by scientists, researchers and the open source comunity

Read the following guide:

Where can I find and how can I download LLM models

Steps to take to start using AI

  • Install Ozeki Chat Server
  • Download an AI model
  • Open Ozeki AI Studio
  • Install the AI model in Ozeki AI studio
  • Create an AI chatbot
  • Test your AI chat
  • Connect your AI chatbot to a chat account

AI performance improvement

  • Switch to NVIDIA GPU and set it up for Ozeki AI studio