Click here to Skip to main content
15,390,740 members
Articles / Artificial Intelligence / Tensorflow
Posted 16 Jan 2022


46 bookmarked

CodeProject.AI Server: AI the easy way.

Rate me:
Please Sign up or sign in to vote.
5.00/5 (22 votes)
21 Feb 20226 min read
Our fast, free, self-hosted Artificial Intelligence Server for any platform, any language
CodeProject.AI Server is a locally installed, self-hosted, fast, free and Open Source Artificial Intelligence server for any platform, any language. No off-device or out of network data transfer, no messing around with dependencies, and able to be used from any platform, any language. Runs as a Windows Service or a Docker container.
Due to a bug in the previous Windows installers (v1.5.0 and below), those who have 1.5.0 or below currently installed will need to uninstall before upgrading to version 1.5.5+ There are big scary notices and warnings in the new installer so you don't forget. We're so sorry.

Image 1

What's New - 1.5.5

  1. ( A minor face registration bug fixed
  2. Some minor cleanups to the Python SDK in preparation for serious refactoring
  3. Endless fights with Windows Installer XML that has resulted in a few nips and tucks. The installer is now more reliable
  4. Benchmark now allows any custom model you choose
  5. Overriding settings for some legacy modules now far easier: Blue Iris users will benefit
  6. Front end Server is now a self-contained .NET package

The What and the Why

The 'What' is simple:

A locally installed, self-hosted, fast, free and Open Source Artificial Intelligence server that provides AI functionality for any app, any language. Install CodePrect.AI and you have an AI server. Done.

The 'Why'

  • AI programming is something every single developer should be aware of

    We wanted a fun project we could use to help teach developers and get them involved in AI. We'll be using CodeProject.AI Server as a focus for articles and exploration to make it fun and painless to learn AI programming

    We want your contributions!
  • AI coding examples have too many moving parts

    You need to install packages and languages and extensions to tools, and then updates and libraries (but version X, not version Y) and then you have to configure paths and...Oh, you want to run on Windows not Linux? In that case you need to... It's all too hard. There was much yelling at CodeProject.

    CodeProject.AI Server includes everything you need in a single installer. CodeProject.AI Server also provides an installation script that will setup your dev environment and get you debugging within a couple of clicks.
  • AI solutions often require the use of cloud services

    If you trust the cloud provider, or understand the billing structure, or can be assured you aren't sending sensitive data or won't go over the free tier this is fine. If you have a webcam inside your house, or can't work out how much AWS will charge, it's not so OK

    CodeProject.AI Server can be installed locally. Your machine, your network, no data needs to leave your device.

Supported Platforms

Image 2 Image 3 Image 4 Image 5 Image 6 Image 7
Windows macOS Ubuntu Docker Visual Studio
Visual Studio

Cut to the chase: how do I play with it?

1: Running and playing with the features

  1. Install and Run
    1. For a Windows Service, Download the latest version, install, and launch the shortcut to the server's dashboard on your desktop or open a browser to http://localhost:5000.
    2. For a Docker Container for 64 Bit Linux run
      docker run -p 5000:5000 --name CodeProject.AI-Server -d -v <local directory>:/usr/share/CodeProject/AI codeproject/ai-server
      where <local directory> is some existing directory on the host machine such as
      1. C:\ProgramData\CodeProject/AI on Windows
      2. /usr/share/CodeProject/AI on Linux
  2. On the dashboard, at the bottom, is a link to the demo playground. Open that and play!

2: Running and debugging the code

  1. Clone the CodeProject CodeProject.AI Server repository.
  2. Make sure you have Visual Studio Code or Visual Studio 2019+ installed.
  3. Run the setup script in /Installers/Dev
  4. Debug the front-end server application (see notes below, but it's easy)

How do I use it in my application?

Here's an example of using the API for scene detection using a simple JavaScript call:

Detect the scene in this file: <input id="image" type="file" />
<input type="button" value="Detect Scene" onclick="detectScene(image)" />

function detectScene(fileChooser) {
    var formData = new FormData();
    formData.append('image', fileChooser.files[0]);

    fetch('http://localhost:5000/v1/vision/detect/scene', {
        method: "POST",
        body: formData
    .then(response => {
        if (response.ok) response.json().then(data => {
            console.log(`Scene is ${data.label}, ${data.confidence} confidence`)

You can include the CodeProject.AI Server installer (or just a link to the latest version of the installer) in your own apps and installers and voila, you have an AI enabled app.

What does it include?

CodeProject.AI Server includes

  • A HTTP REST API Server. The server listens for requests from other apps, passes them to the backend analysis services for processing, and then passes the results back to the caller. It runs as a simple self contained web service on your device.
  • Backend Analysis services. The brains of the operation is in the analysis services sitting behind the front end API. All processing of data is done on the current machine. No calls to the cloud and no data leaving the device.
  • The Source Code, naturally.

What can it do?

CodeProject.AI Server can currently

  • Detect objects in images
  • Detect faces in images
  • Detect the type of scene represented in an image
  • Recognise faces that have been registered with the service
  • Perform detection on custom models

The development environment also provides modules that can 

  • Remove a background from an image
  • Blur a background from an image
  • Pull out the most important sentences in text to generate a text summary
  • Prove sentiment analysis on text

We will be constantly expanding the feature list.

Our Goals

  • To promote AI development and inspire the AI developer community to dive in and have a go. Artificial Intelligence is a huge paradigm change in the industry and all developers owe it to themselves to experiment in and familiarize themselves with the technology. CodeProject.AI Server was built as a learning tool, a demonstration, and a library and service that can be used out of the box.
  • To make AI development easy. It's not that AI development is that hard. It's that there are so, so many options. Our architecture is designed to allow any AI implementation to find a home in our system, and for our service to be callable from any language.
  • To focus on core use-cases. We're deliberately not a solution for everyone. Instead we're a solution for common day-to-day needs. We will be adding dozens of modules and scores of AI capabilities to our system, but our goal is always clarity and simplicity over a 100% solution.
  • To tap the expertise of the Developer Community. We're not experts but we know a developer or two out there who are. The true power of CodeProject.AI Server comes from the contributions and improvements from our AI community.

How to Guides


CodeProject.AI Server is licensed under the Server-Side Public License

Release Notes and Roadmap

Coming up

  • Further simplifications when adding modules
  • Massive simplification to the installers
  • Networking. 
  • More modules.
  • Chaining modules.

Previous versions

Release 1.5 Beta

  • Support for custom models

Release 1.3.x Beta

  • Refactored and improved setup and module addition system
  • Introduction of modulesettings.json files
  • New analysis modules

Release 1.2.x Beta

  • Support for Apple Silicon for development mode
  • Native Windows installer
  • Runs as Windows Service
  • Run in a Docker Container
  • Installs and Builds using VSCode in Linux (Ubuntu), macOS and Windows, as well as Visual Studio on Windows
  • General optimisation of the download payload sizes


  • We started with a proof of concept on Windows 10+ only. Installs we via a simple BAT script, and the code has is full of exciting sharp edges. A simple dashboard and playground are included. Analysis is currently Python code only
  • Version checks are enabled to alert users to new versions
  • A new .NET implementation scene detection using the YOLO model to ensure the codebase is platform and tech stack agnostic
  • Blue Iris integration completed


About the Author

Software Developer CodeProject Solutions
Canada Canada
No Biography provided
Group type: Organisation

4 members

Comments and Discussions

Bug(Fixed in 1.5.6) Face registration failing Pin
Member 157312008-Aug-22 5:12
MemberMember 157312008-Aug-22 5:12 
GeneralRe: Face registration failing Pin
Matthew Dennis6hrs 44mins ago
sysadminMatthew Dennis6hrs 44mins ago 
GeneralRe: Face registration failing Pin
Member 157312005hrs 35mins ago
MemberMember 157312005hrs 35mins ago 
GeneralRe: Face registration failing Pin
Matthew Dennis6hrs 40mins ago
sysadminMatthew Dennis6hrs 40mins ago 
GeneralRe: Face registration failing Pin
Member 157312005hrs 22mins ago
MemberMember 157312005hrs 22mins ago 
QuestionDeepStack Not responding in Bi Pin
CJ Davis4-Aug-22 19:40
MemberCJ Davis4-Aug-22 19:40 
AnswerRe: DeepStack Not responding in Bi Pin
theoldfool5-Aug-22 1:32
professionaltheoldfool5-Aug-22 1:32 
GeneralRe: DeepStack Not responding in Bi Pin
CJ Davis5-Aug-22 11:12
MemberCJ Davis5-Aug-22 11:12 
GeneralRe: DeepStack Not responding in Bi Pin
theoldfool5-Aug-22 11:35
professionaltheoldfool5-Aug-22 11:35 
GeneralRe: DeepStack Not responding in Bi Pin
CJ Davis5-Aug-22 15:01
MemberCJ Davis5-Aug-22 15:01 
GeneralRe: DeepStack Not responding in Bi Pin
CJ Davis5-Aug-22 16:01
MemberCJ Davis5-Aug-22 16:01 
GeneralRe: DeepStack Not responding in Bi Pin
Village Guy5-Aug-22 23:43
MemberVillage Guy5-Aug-22 23:43 
GeneralRe: DeepStack Not responding in Bi Pin
CJ Davis6-Aug-22 9:38
MemberCJ Davis6-Aug-22 9:38 
GeneralRe: DeepStack Not responding in Bi Pin
Village Guy6-Aug-22 10:23
MemberVillage Guy6-Aug-22 10:23 
GeneralRe: DeepStack Not responding in Bi Pin
CJ Davis6-Aug-22 15:43
MemberCJ Davis6-Aug-22 15:43 
GeneralRe: DeepStack Not responding in Bi Pin
Village Guy6-Aug-22 23:14
MemberVillage Guy6-Aug-22 23:14 
GeneralRe: DeepStack Not responding in Bi Pin
Mike Lud7-Aug-22 4:37
MemberMike Lud7-Aug-22 4:37 
GeneralRe: DeepStack Not responding in Bi Pin
Village Guy7-Aug-22 6:18
MemberVillage Guy7-Aug-22 6:18 
GeneralRe: DeepStack Not responding in Bi Pin
CJ Davis7-Aug-22 11:08
MemberCJ Davis7-Aug-22 11:08 
GeneralRe: DeepStack Not responding in Bi Pin
Mike Lud7-Aug-22 18:18
MemberMike Lud7-Aug-22 18:18 
AnswerRe: DeepStack Not responding in Bi Pin
Chris Maunder22hrs 45mins ago
cofounderChris Maunder22hrs 45mins ago 
QuestionBlueIris and SenseAI Pin
Hubert S2-Aug-22 8:05
MemberHubert S2-Aug-22 8:05 
AnswerRe: BlueIris and SenseAI Pin
Vanterax2-Aug-22 8:14
MemberVanterax2-Aug-22 8:14 
GeneralRe: BlueIris and SenseAI Pin
Hubert S2-Aug-22 8:39
MemberHubert S2-Aug-22 8:39 
GeneralRe: BlueIris and SenseAI Pin
Tinman Tinner2-Aug-22 12:00
MemberTinman Tinner2-Aug-22 12:00 

General General    News News    Suggestion Suggestion    Question Question    Bug Bug    Answer Answer    Joke Joke    Praise Praise    Rant Rant    Admin Admin   

Use Ctrl+Left/Right to switch messages, Ctrl+Up/Down to switch threads, Ctrl+Shift+Left/Right to switch pages.