|
To start, as it usually asked for:
Server version: 2.6.5
System: Windows
Operating System: Windows (Microsoft Windows 10.0.19045)
CPUs: Intel(R) Core(TM) i5-7500 CPU @ 3.40GHz (Intel)
1 CPU x 4 cores. 4 logical processors (x64)
GPU (Primary): Intel(R) HD Graphics 630 (1,024 MiB) (Intel Corporation)
Driver: 31.0.101.2111
System RAM: 16 GiB
Platform: Windows
BuildConfig: Release
Execution Env: Native
Runtime Env: Production
Runtimes installed:
.NET runtime: 7.0.5
.NET SDK: Not found
Default Python: Not found
Go: Not found
NodeJS: Not found
Rust: Not found
Video adapter info:
Intel(R) HD Graphics 630:
Driver Version 31.0.101.2111
Video Processor Intel(R) HD Graphics Family
System GPU info:
GPU 3D Usage 9%
GPU RAM Usage 0
Global Environment variables:
CPAI_APPROOTPATH = <root>
CPAI_PORT = 32168
Module 'Object Detection (YOLOv5 6.2)' 1.9.1 (ID: ObjectDetectionYOLOv5-6.2)
Valid: True
Module Path: <root>\modules\ObjectDetectionYOLOv5-6.2
Module Location: Internal
AutoStart: True
Queue: objectdetection_queue
Runtime: python3.7
Runtime Location: Shared
FilePath: detect_adapter.py
Start pause: 1 sec
Parallelism: 0
LogVerbosity:
Platforms: all,!raspberrypi,!jetson
GPU Libraries: installed if available
GPU: use if supported
Accelerator:
Half Precision: enable
Environment Variables
APPDIR = <root>\modules\ObjectDetectionYOLOv5-6.2
CUSTOM_MODELS_DIR = <root>\modules\ObjectDetectionYOLOv5-6.2\custom-models
MODELS_DIR = <root>\modules\ObjectDetectionYOLOv5-6.2\assets
MODEL_SIZE = Medium
USE_CUDA = True
YOLOv5_AUTOINSTALL = false
YOLOv5_VERBOSE = false
Status Data: {
"inferenceDevice": "CPU",
"inferenceLibrary": "",
"canUseGPU": "false",
"successfulInferences": 65,
"failedInferences": 0,
"numInferences": 65,
"averageInferenceMs": 871.9076923076923
}
Started: 29 May 2024 7:52:34 AM Central Standard Time
LastSeen: 29 May 2024 8:04:21 AM Central Standard Time
Status: Started
Requests: 65 (includes status calls)
Installation Log
2024-05-29 07:08:20: Installing CodeProject.AI Analysis Module
2024-05-29 07:08:20: ======================================================================
2024-05-29 07:08:20: CodeProject.AI Installer
2024-05-29 07:08:20: ======================================================================
2024-05-29 07:08:20: 288.3Gb of 487Gb available on
2024-05-29 07:08:21: General CodeProject.AI setup
2024-05-29 07:08:21: Creating Directories...done
2024-05-29 07:08:21: GPU support
2024-05-29 07:08:21: CUDA Present...No
2024-05-29 07:08:21: ROCm Present...No
2024-05-29 07:08:22: Checking for .NET 7.0...Checking SDKs...Upgrading: .NET is 0
2024-05-29 07:08:22: Current version is 0. Installing newer version.
2024-05-29 07:08:22: 'winget' is not recognized as an internal or external command,
2024-05-29 07:08:22: operable program or batch file.
2024-05-29 07:08:24: Reading ObjectDetectionYOLOv5-6.2 settings.......done
2024-05-29 07:08:24: Installing module Object Detection (YOLOv5 6.2) 1.9.1
2024-05-29 07:08:24: Installing Python 3.7
2024-05-29 07:08:32: Downloading Python 3.7 interpreter...Expanding...done.
2024-05-29 07:08:42: Creating Virtual Environment (Shared)...done
2024-05-29 07:08:42: Confirming we have Python 3.7 in our virtual environment...present
2024-05-29 07:09:24: Downloading Standard YOLO models...Expanding...done.
2024-05-29 07:09:25: Copying contents of models-yolo5-pt.zip to assets...done
2024-05-29 07:10:23: Downloading Custom YOLO models...Expanding...done.
2024-05-29 07:10:24: Copying contents of custom-models-yolo5-pt.zip to custom-models...done
2024-05-29 07:10:24: Installing Python packages for Object Detection (YOLOv5 6.2)
2024-05-29 07:10:24: [0;Installing GPU-enabled libraries: If available
2024-05-29 07:10:25: Ensuring Python package manager (pip) is installed...done
2024-05-29 07:10:35: Ensuring Python package manager (pip) is up to date...done
2024-05-29 07:10:35: Python packages specified by requirements.txt
2024-05-29 07:10:37: - Installing urllib3, the HTTP client for Python...(✅ checked) done
2024-05-29 07:10:51: - Installing Pandas, a data analysis / data manipulation tool...(✅ checked) done
2024-05-29 07:11:42: - Installing CoreMLTools, for working with .mlmodel format models...(✅ checked) done
2024-05-29 07:11:49: - Installing OpenCV, the Open source Computer Vision library...(✅ checked) done
2024-05-29 07:11:53: - Installing Pillow, a Python Image Library...(✅ checked) done
2024-05-29 07:12:04: - Installing SciPy, a library for mathematics, science, and engineering...(✅ checked) done
2024-05-29 07:12:05: - Installing PyYAML, a library for reading configuration files...Already installed
2024-05-29 07:12:30: - Installing PyTorch, for Tensor computation and Deep neural networks...(✅ checked) done
2024-05-29 07:13:39: - Installing TorchVision, for Computer Vision based AI...(✅ checked) done
2024-05-29 07:15:24: - Installing Ultralytics YoloV5 package for object detection in images...(✅ checked) done
2024-05-29 07:15:26: - Installing Seaborn, a data visualization library based on matplotlib...Already installed
2024-05-29 07:15:26: Installing Python packages for the CodeProject.AI Server SDK
2024-05-29 07:15:28: Ensuring Python package manager (pip) is installed...done
2024-05-29 07:15:31: Ensuring Python package manager (pip) is up to date...done
2024-05-29 07:15:31: Python packages specified by requirements.txt
2024-05-29 07:15:33: - Installing Pillow, a Python Image Library...Already installed
2024-05-29 07:15:34: - Installing Charset normalizer...Already installed
2024-05-29 07:15:40: - Installing aiohttp, the Async IO HTTP library...(✅ checked) done
2024-05-29 07:15:43: - Installing aiofiles, the Async IO Files library...(✅ checked) done
2024-05-29 07:15:46: - Installing py-cpuinfo to allow us to query CPU info...(✅ checked) done
2024-05-29 07:15:48: - Installing Requests, the HTTP library...Already installed
2024-05-29 07:15:48: Scanning modulesettings for downloadable models...No models specified
2024-05-29 07:15:54: Fusing layers...
2024-05-29 07:15:55: YOLOv5.1m summary: 391 layers, 21805053 parameters, 0 gradients
2024-05-29 07:15:55: Adding AutoShape...
2024-05-29 07:15:56: Self test: Self-test passed
2024-05-29 07:15:56: Module setup time 00:07:33.99
2024-05-29 07:15:56: Setup complete
2024-05-29 07:15:56: Total setup time 00:07:35.51
Installer exited with code 0
I upgraded from CPAI ver 2.5.6 to CPAI version 2.6.5.
I installed version 2.6.5 on both the Windows machine that runs Blue Iris and the Linux machine.
Nothing has changed regarding Blue Iris on the Windows machine.
When I check the Use custom models checkbox on the AI tab, and restart the Blue Iris service, the custom models listbox does not populate.
This occurs when I have the Blue Iris AI pointed to the localhost and the linux machine.
Clicking the open AI dashboard link on the AI tab in Blue Iris opens the dashboard on either machine.
Selecting Default object detection on either machine works without issue. Only use custom models does not work.
Restarting the Blue Iris service has always been my go to to populate this listbox, as I believe it forces Blue Iris to call this from the API reference:
POST: http:
In earliar versions, when I would restart the Blue Iris server service, I would see the list call in the CPAI server log.
In this version of CPAI (2.6.5) I do not see that call anywhere in the log.
Again, I did not change anything in Blue Iris since I installed the last stable version on about 5/2/2024.
Before I installed version 2.6.5 this morning, the listbox was being populated.
My understanding is that this will keep Blue Iris from using custom models.
I have restarted the Blue Iris server service and rebooted the Blue Iris machine multiple times with no good results.
It seems that I will need to roll back CPAI to version 2.5.6 to regain the custom models functionality.
|
|
|
|
|
Can you try hitting Ctrl+F5 on the dashboard just to ensure there's no browser caching issues?
cheers
Chris Maunder
|
|
|
|
|
|
After doing Ctrl-F5 in the browser on each machine. Windows and Linux
Works on the Windows machine (localhost) but not on the Linux machine.
With Use AI server on IP port: Localhost
Restart BI Service
Listbox populates.
With Use AI service on IP port: 192.168.1.27 (the Linux machine)
Restart BI service
Listbox is blank
Can you run the POST: http://localhost:32168/v1/vision/custom/list command from a browser?
Or do you need to use a programming language?
Just to see if it works. I've never tried it.
|
|
|
|
|
Postman is your friend!
Do a POST to localhost:32168/v1/vision/custom/list:
{
"success": true,
"models": [
"ipcam-combined",
"license-plate",
"actionnetv2",
"ipcam-dark",
"ipcam-animal",
"ipcam-general"
],
"moduleId": "ObjectDetectionYOLOv5-6.2",
"moduleName": "Object Detection (YOLOv5 6.2)",
"code": 200,
"command": "list-custom",
"requestId": "35ead6ed-6eb8-4a5b-b7da-45833de826bc",
"inferenceDevice": "CPU",
"analysisRoundTripMs": 24668,
"processedBy": "localhost",
"timestampUTC": "Thu, 30 May 2024 16:39:59 GMT"
}
cheers
Chris Maunder
|
|
|
|
|
Then found that Blue Iris was doing nothing. All nothing found, no listbox contents.
Had to reboot the machine again.
|
|
|
|
|
I have a Dell PC with Blue Iris and CPAI for motion detection. It has been running very good with the Intel UHD 630 display adapter in DirectML mode until 2.6.2 version. I use .NET model.
The symptom is that after a random amount of time objects are no more detected. The only evidence I see in the logs is that the processing times pass from 150-200ms to 10-40ms ... No crash of the server.
License Plates reader stops as well. Same behavior with custom models.. Is there something I can investigate?
Thank you
|
|
|
|
|
Thanks very much for your report. Could you please share your System Info tab from your CodeProject.AI Server dashboard? Also, could you please share the logs from CodeProject.AI Server when the detections simply stop? And, when they do, are you able to still do a manual detection from the CodeProject.AI Server Explorer?
Thanks,
Sean Ewington
CodeProject
|
|
|
|
|
Hi Thanks for coming back. Here's the System Info:
Server version: 2.6.5
System: Windows
Operating System: Windows (Microsoft Windows 11 version 10.0.22631)
CPUs: Intel(R) Core(TM) i7-9700 CPU @ 3.00GHz (Intel)
1 CPU x 8 cores. 8 logical processors (x64)
GPU (Primary): Microsoft Remote Display Adapter (Microsoft)
Driver: 10.0.22621.3593
System RAM: 16 GiB
Platform: Windows
BuildConfig: Release
Execution Env: Native
Runtime Env: Production
Runtimes installed:
.NET runtime: 7.0.5
.NET SDK: Not found
Default Python: 3.10.6
Go: Not found
NodeJS: 18.16.1
Rust: Not found
Video adapter info:
Microsoft Remote Display Adapter:
Driver Version 10.0.22621.3593
Video Processor
Intel(R) UHD Graphics 630:
Driver Version 30.0.101.1692
Video Processor Intel(R) UHD Graphics Family
System GPU info:
GPU 3D Usage 2%
GPU RAM Usage 0
Global Environment variables:
CPAI_APPROOTPATH = <root>
CPAI_PORT = 32168
In the logs there is nothing , just a reduction of ms in precessing the request. No errors. Don't know if there are more verbose logs stored somewhere on the disk.
Will try to use the explorer as soon as it happens again.
Thank you.
|
|
|
|
|
If you open the CodeProject.AI Explorer and try object detection on an image there, does it work?
cheers
Chris Maunder
|
|
|
|
|
Just for info. I've updated Blue Iris to the latest version and I have 40000 detections without problems. Will keep you updated.
|
|
|
|
|
Evidence in the logs: from a normal working condition of 260ms average detection it goes to 3000ms an then drops to 3ms , which is a permanent "no object found" condition
2024-06-10 02:29:03: Response rec'd from Object Detection (YOLOv5 .NET) command 'detect' (#reqid b5b16882-7535-4508-a579-fc072e15762a) ['No objects found'] took 261ms
2024-06-10 02:29:04: Client request 'detect' in queue 'objectdetection_queue' (#reqid f8a5abcf-2b38-4f6a-83b4-e5541b3e0cfd)
2024-06-10 02:29:04: Request 'detect' dequeued from 'objectdetection_queue' (#reqid f8a5abcf-2b38-4f6a-83b4-e5541b3e0cfd)
2024-06-10 02:29:04: Response rec'd from Object Detection (YOLOv5 .NET) command 'detect' (#reqid f8a5abcf-2b38-4f6a-83b4-e5541b3e0cfd) ['No objects found'] took 269ms
2024-06-10 02:29:05: Client request 'detect' in queue 'objectdetection_queue' (#reqid 1145cfe8-2a15-4470-962a-d186d740e4c1)
2024-06-10 02:29:05: Request 'detect' dequeued from 'objectdetection_queue' (#reqid 1145cfe8-2a15-4470-962a-d186d740e4c1)
2024-06-10 02:29:06: Client request 'detect' in queue 'objectdetection_queue' (#reqid 183412fa-c95b-4f5a-8526-0f719b043b6b)
2024-06-10 02:29:06: Request 'detect' dequeued from 'objectdetection_queue' (#reqid 183412fa-c95b-4f5a-8526-0f719b043b6b)
2024-06-10 02:29:07: Client request 'detect' in queue 'objectdetection_queue' (#reqid 63e16a3b-462c-4a39-ad70-17a2a193dad2)
2024-06-10 02:29:07: Request 'detect' dequeued from 'objectdetection_queue' (#reqid 63e16a3b-462c-4a39-ad70-17a2a193dad2)
2024-06-10 02:29:08: Response rec'd from Object Detection (YOLOv5 .NET) command 'detect' (#reqid 1145cfe8-2a15-4470-962a-d186d740e4c1) ['No objects found'] took 3609ms
2024-06-10 02:29:08: Response rec'd from Object Detection (YOLOv5 .NET) command 'detect' (#reqid 183412fa-c95b-4f5a-8526-0f719b043b6b) ['No objects found'] took 2648ms
2024-06-10 02:29:08: Response rec'd from Object Detection (YOLOv5 .NET) command 'detect' (#reqid 63e16a3b-462c-4a39-ad70-17a2a193dad2) ['No objects found'] took 1642ms
2024-06-10 02:29:17: Client request 'detect' in queue 'objectdetection_queue' (#reqid c9f3704b-e924-401e-a2d8-a3670bdb39dd)
2024-06-10 02:29:17: Request 'detect' dequeued from 'objectdetection_queue' (#reqid c9f3704b-e924-401e-a2d8-a3670bdb39dd)
2024-06-10 02:29:17: Response rec'd from Object Detection (YOLOv5 .NET) command 'detect' (#reqid c9f3704b-e924-401e-a2d8-a3670bdb39dd) ['No objects found'] took 3ms
2024-06-10 02:29:17: Client request 'custom' in queue 'objectdetection_queue' (#reqid a98297c0-1743-49c0-9972-78e0aa529b13)
2024-06-10 02:29:17: Request 'custom' dequeued from 'objectdetection_queue' (#reqid a98297c0-1743-49c0-9972-78e0aa529b13)
2024-06-10 02:29:17: Response rec'd from Object Detection (YOLOv5 .NET) command 'custom' (#reqid a98297c0-1743-49c0-9972-78e0aa529b13) ['No objects found'] took 3ms
2024-06-10 02:29:18: Client request 'detect' in queue 'objectdetection_queue' (#reqid 1ad01245-814b-4eb6-8bcb-f6311cbcd62c)
2024-06-10 02:29:18: Request 'detect' dequeued from 'objectdetection_queue' (#reqid 1ad01245-814b-4eb6-8bcb-f6311cbcd62c)
2024-06-10 02:29:18: Response rec'd from Object Detection (YOLOv5 .NET) command 'detect' (#reqid 1ad01245-814b-4eb6-8bcb-f6311cbcd62c) ['No objects found'] took 3ms
2024-06-10 02:29:18: Client request 'custom' in queue 'objectdetection_queue' (#reqid 7e45acca-570c-48e1-862e-9062dde69b5a)
2024-06-10 02:29:18: Request 'custom' dequeued from 'objectdetection_queue' (#reqid 7e45acca-570c-48e1-862e-9062dde69b5a)
2024-06-10 02:29:18: Response rec'd from Object Detection (YOLOv5 .NET) command 'custom' (#reqid 7e45acca-570c-48e1-862e-9062dde69b5a) ['No objects found'] took 3ms
|
|
|
|
|
Noticed Object Detection (Coral) wouldn't start on upgrade to 2.6.5 (docker install)
Uninstalled module and reinstalled only to receive below.
Not seeing anything in logs. Only error seen in GUI as follows.
Error in Install ObjectDetectionCoral: 404
Moving back to 2.6.2 allowed reinstall of module.
Logs at startup ..
Creating runtimes path '/app/runtimes'
Creating downloaded models path '/app/downloads/models'
Debug Settings file: /app/server/installmodules.json exists: False
Infor ** System: Docker (486afa18b838)
Infor ** Operating System: Linux (Ubuntu 22.04)
Infor ** CPUs: Intel(R) Core(TM) i5-2520M CPU @ 2.50GHz (Intel)
Infor ** 1 CPU x 2 cores. 4 logical processors (x64)
Infor ** System RAM: 8 GiB
Infor ** Platform: Linux
Infor ** BuildConfig: Release
Infor ** Execution Env: Docker
Infor ** Runtime Env: Production
Infor ** Runtimes installed:
Infor ** .NET runtime: 7.0.19
Infor ** .NET SDK: Not found
Infor ** Default Python: 3.10.12
Infor ** Go: Not found
Infor ** NodeJS: Not found
Infor ** Rust: Not found
Infor ** App DataDir: /etc/codeproject/ai
Infor Video adapter info:
Infor *** STARTING CODEPROJECT.AI SERVER
Infor RUNTIMES_PATH = /app/runtimes
Infor PREINSTALLED_MODULES_PATH = /app/preinstalled-modules
Infor DEMO_MODULES_PATH = /app/src/demos/modules
Infor EXTERNAL_MODULES_PATH =
Infor MODULES_PATH = /app/modules
Infor PYTHON_PATH = /bin/linux/%PYTHON_NAME%/venv/bin/python3
Infor Data Dir = /etc/codeproject/ai
Infor ** Server version: 2.6.5
Server is listening on port 32168
Server is also listening on legacy port 5000
Trace ModuleRunner Start
Trace Starting Background AI Modules
Warni Overriding address(es) 'http://+:32168, http://+:5000'. Binding to endpoints defined via IConfiguration and/or UseKestrel() instead.
Debug Current Version is 2.6.5
Infor Server: This is the latest version
Trace Client request 'alpr' in queue 'alpr_queue' (#reqid 2d9fd17f-a60c-4136-9b82-a9708c64e4c9)
Trace Client request 'alpr' in queue 'alpr_queue' (#reqid ef21cad0-f907-4f66-847e-308200dae696)
Trace Client request 'alpr' in queue 'alpr_queue' (#reqid 28aa08ed-eae4-44b7-bbf7-c4766b533db4)
|
|
|
|
|
having the same issue. Except I don't know how to revert back to 2.6.2 (running as a docker in unRaid), so hopefully there is a fix soon!
|
|
|
|
|
Not sure where you set configuration for image, but look for
image: codeproject/ai-server:latest
and change it to
image: codeproject/ai-server:2.6.2
|
|
|
|
|
Thanks very much for your report. Could you please share your System Info tab from your CodeProject.AI Server dashboard?
Thanks,
Sean Ewington
CodeProject
|
|
|
|
|
Server version: 2.6.5
System: Docker (d1e1925ba47f)
Operating System: Linux (Ubuntu 22.04)
CPUs: Intel(R) Core(TM) i5-2520M CPU @ 2.50GHz (Intel)
1 CPU x 2 cores. 4 logical processors (x64)
System RAM: 8 GiB
Platform: Linux
BuildConfig: Release
Execution Env: Docker
Runtime Env: Production
Runtimes installed:
.NET runtime: 7.0.19
.NET SDK: Not found
Default Python: 3.10.12
Go: Not found
NodeJS: Not found
Rust: Not found
Video adapter info:
System GPU info:
GPU 3D Usage 0%
GPU RAM Usage 0
Global Environment variables:
CPAI_APPROOTPATH = <root>
CPAI_PORT = 32168
|
|
|
|
|
22:15:19:Started Object Detection (Coral) module
22:15:21:objectdetection_coral_adapter.py: Exception ignored in:
22:15:21:objectdetection_coral_adapter.py: Traceback (most recent call last):
22:15:21:objectdetection_coral_adapter.py: File "/app/modules/ObjectDetectionCoral/bin/linux/python39/venv/lib/python3.9/site-packages/tflite_runtime/interpreter.py", line 124, in __del__
22:15:21:objectdetection_coral_adapter.py: if self._library is not None:
22:15:21:objectdetection_coral_adapter.py: AttributeError: 'Delegate' object has no attribute '_library'
22:15:21:objectdetection_coral_adapter.py: An exception occurred initialising the module: libedgetpu.so.1: cannot open shared object file: No such file or directory
22:15:22:Object Detection (Coral): [ImportError] : Error during main_loop: Traceback (most recent call last):
File "/app/modules/ObjectDetectionCoral/../../SDK/Python/module_runner.py", line 576, in main_loop
output = await callbacktask
File "/usr/lib/python3.9/concurrent/futures/thread.py", line 58, in run
result = self.fn(*self.args, **self.kwargs)
File "/app/modules/ObjectDetectionCoral/objectdetection_coral_adapter.py", line 107, in process
response = self._do_detection(img, threshold)
File "/app/modules/ObjectDetectionCoral/objectdetection_coral_adapter.py", line 179, in _do_detection
from objectdetection_coral_singletpu import do_detect
File "/app/modules/ObjectDetectionCoral/objectdetection_coral_singletpu.py", line 65, in
from pycoral.utils.edgetpu import make_interpreter
File "/app/modules/ObjectDetectionCoral/bin/linux/python39/venv/lib/python3.9/site-packages/pycoral/utils/edgetpu.py", line 24, in
from pycoral.pybind._pywrap_coral import GetRuntimeVersion as get_runtime_version
ImportError: libedgetpu.so.1: cannot open shared object file: No such file or directory
|
|
|
|
|
Thanks very much for that. What command line did you run to setup CodeProject.AI Server / what parameters did you use?
Thanks,
Sean Ewington
CodeProject
|
|
|
|
|
Installation is via a docker compose file (posted below). I have created NFS volumes for data/config so that I can move the docker container to any server.
volumes:
codeprojectai-config:
external: true
codeprojectai-app:
external: true
services:
codeprojectai:
container_name: codeprojectai
restart: unless-stopped
privileged: true
image: codeproject/ai-server:latest
ports:
- '32168:32168'
- '5000:5000'
# environment:
volumes:
- codeprojectai-config:/etc/codeproject/ai
- codeprojectai-app:/app/modules
devices:
- /dev/bus/usb:/dev/bus/usb
|
|
|
|
|
Have you shut down and recreated the docker container? There is a known issue that this will result in a missing libedgetpu library and you'll need to reinstall the coral object detection module.
What host operating system are you running Docker in? Windows or Linux?
cheers
Chris Maunder
|
|
|
|
|
I run this on a Linux system (Ubuntu)
I have stopped, deleted container, deleted image and recreated with latest image and it fails
Note the Config/App directories are persistent.
|
|
|
|
|
Fresh install of 2.6.5. Getting this error when starting a Large YoloV8 Model with Coral. It seemingly works fine but switches over from TPU to CPU silently off and on (even though the error states it's using CPU)
00:43:45:Module 'Object Detection (Coral)' 2.2.2 (ID: ObjectDetectionCoral)
00:43:45:Valid: True
00:43:45:Module Path: <root>\modules\ObjectDetectionCoral
00:43:45:Module Location: Internal
00:43:45:AutoStart: True
00:43:45:Queue: objectdetection_queue
00:43:45:Runtime: python3.9
00:43:45:Runtime Location: Local
00:43:45:FilePath: objectdetection_coral_adapter.py
00:43:45:Start pause: 1 sec
00:43:45:Parallelism: 16
00:43:45:LogVerbosity:
00:43:45:Platforms: all
00:43:45:GPU Libraries: installed if available
00:43:45:GPU: use if supported
00:43:45:Accelerator:
00:43:45:Half Precision: enable
00:43:45:Environment Variables
00:43:45:CPAI_CORAL_MODEL_NAME = YOLOv8
00:43:45:CPAI_CORAL_MULTI_TPU = True
00:43:45:MODELS_DIR = <root>\modules\ObjectDetectionCoral\assets
00:43:45:MODEL_SIZE = large
00:43:45:
00:43:45:Started Object Detection (Coral) module
00:43:47:objectdetection_coral_adapter.py: TPU detected
00:43:47:objectdetection_coral_adapter.py: Attempting multi-TPU initialisation
00:43:47:objectdetection_coral_adapter.py: Supporting multiple Edge TPUs
00:46:30:objectdetection_coral_adapter.py: ERROR:root:TFLite file C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral\assets\tf2_ssd_mobilenet_v1_fpn_640x640_coco17_ptq_segment_0_of_2_edgetpu.tflite doesn't exist
00:46:30:objectdetection_coral_adapter.py: WARNING:root:Model file not found: [Errno 2] No such file or directory: 'C:\\Program Files\\CodeProject\\AI\\modules\\ObjectDetectionCoral\\assets\\tf2_ssd_mobilenet_v1_fpn_640x640_coco17_ptq_segment_0_of_2_edgetpu.tflite'
00:46:30:objectdetection_coral_adapter.py: WARNING:root:No Coral TPUs found or able to be initialized. Using CPU.
00:46:30:objectdetection_coral_adapter.py: WARNING:root:Unable to load delegate for TPU cpu: Failed to load delegate from edgetpu.dll
00:46:30:objectdetection_coral_adapter.py: WARNING:root:Unable to create interpreter for CPU using edgeTPU library: cpu
00:46:30:objectdetection_coral_adapter.py: ERROR:root:TFLite file C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral\assets\tf2_ssd_mobilenet_v1_fpn_640x640_coco17_ptq_segment_0_of_2_edgetpu.tflite doesn't exist
00:46:30:objectdetection_coral_adapter.py: WARNING:root:Model file not found: [Errno 2] No such file or directory: 'C:\\Program Files\\CodeProject\\AI\\modules\\ObjectDetectionCoral\\assets\\tf2_ssd_mobilenet_v1_fpn_640x640_coco17_ptq_segment_0_of_2_edgetpu.tflite'
00:46:30:objectdetection_coral_adapter.py: WARNING:root:No Coral TPUs found or able to be initialized. Using CPU.
00:46:30:objectdetection_coral_adapter.py: WARNING:root:Unable to load delegate for TPU cpu: Failed to load delegate from edgetpu.dll
00:4
Server version: 2.6.5
System: Windows
Operating System: Windows (Microsoft Windows 11 version 10.0.22631)
CPUs: AMD Ryzen 9 3950X 16-Core Processor (AMD)
1 CPU x 16 cores. 32 logical processors (x64)
GPU (Primary): NVIDIA GeForce RTX 3060 (12 GiB) (NVIDIA)
Driver: 555.85, CUDA: 12.2.140 (up to: 12.5), Compute: 8.6, cuDNN: 8.5
System RAM: 64 GiB
Platform: Windows
BuildConfig: Release
Execution Env: Native
Runtime Env: Production
Runtimes installed:
.NET runtime: 8.0.3
.NET SDK: 8.0.203
Default Python: Not found
Go: Not found
NodeJS: 21.7.2
Rust: Not found
Video adapter info:
NVIDIA GeForce RTX 3060:
Driver Version 32.0.15.5585
Video Processor NVIDIA GeForce RTX 3060
System GPU info:
GPU 3D Usage 31%
GPU RAM Usage 6.3 GiB
Global Environment variables:
CPAI_APPROOTPATH = <root>
CPAI_PORT = 32168
|
|
|
|
|
Looks like the model file isn’t getting parsed correctly for your 2-TPU system. It looks like you’ve requested the YOLOv8 model but it’s looking for the MobileNet files for some reason. I don’t have much insight into how that process works I’m afraid.
As a temporary workaround, try the medium model size?
|
|
|
|
|
I've had a computer running Windows 10 w/version 2.5.4 great. I decided to upgrade to Windows 11. That may have been a complete mistake but please try to help me anyway. Of course I also updated to version 2.6.2, so I have changed two variables at once, so yes, I may be an idiot, but please try to help me anyway.
The good news is that CodeProject still works, BUT the status window only shows "CPU (DirectML)" rather than "GPU (DirectML)" using the YOLOv5Net version. Further below, I am pasting the "System Info" information from both before and after at the bottom of this post. I do note that the format has changed in 2.6.2 and show, "Runtimes installed" which shows that the .Net SDK is not installed, but I don't believe I had that installed before so that doesn't seem to be the problem, but let me know if I'm wrong about that.
I have looked at the logs, and don't see any indication of a problem. In fact, I see "GPU enabled: enabled" in the logs. I will include a screenshot of that here, with the logging turned up to "trace" prior to restarting.
I am fully aware that the status window did not always update to show GPU usage until after some actual use, even with 2.5.4, so I thought that perhaps might be the problem, but even after running some test images, the status window still shows "CPU":
Perhaps the only issue is a problem with the status window in 2.6.2? Any ideas? Does "GPU enabled: enabled" indicate the GPU is being used, or is the status window correct that CPU is still being used? For what it's worth, this is a screenshot of it working with Windows 10 and 2.5.4. I really did have it all working great, which makes this even more frustrating if this was self-inflicted damage, and I cannot tell whether it's a difference in 2.6.2 or with Windows 11.
Before (Windows 10, 2.5.4)
Server version: 2.5.4
System: Windows
Operating System: Windows (Microsoft Windows 10.0.19045)
CPUs: AMD Ryzen 9 5900HX with Radeon Graphics (AMD)
1 CPU x 8 cores. 16 logical processors (x64)
GPU (Primary): Microsoft Remote Display Adapter (Microsoft)
Driver: 10.0.19041.4355
System RAM: 31 GiB
Platform: Windows
BuildConfig: Release
Execution Env: Native
Runtime Env: Production
.NET framework: .NET 7.0.5
Default Python:
Video adapter info:
Microsoft Remote Display Adapter:
Driver Version 10.0.19041.4355
Video Processor
AMD Radeon(TM) Graphics:
Driver Version 31.0.12027.9001
Video Processor AMD Radeon Graphics Processor (0x1638)
System GPU info:
GPU 3D Usage 7%
GPU RAM Usage 514.3 MiB
Global Environment variables:
CPAI_APPROOTPATH = <root>
CPAI_PORT = 32168
After (Windows 11, 2.6.2)
Server version: 2.6.2
System: Windows
Operating System: Windows (Microsoft Windows 11 version 10.0.22631)
CPUs: AMD Ryzen 9 5900HX with Radeon Graphics (AMD)
1 CPU x 8 cores. 16 logical processors (x64)
GPU (Primary): AMD Radeon(TM) Graphics (512 MiB) (Advanced Micro Devices, Inc.)
Driver: 31.0.21912.14
System RAM: 15 GiB
Platform: Windows
BuildConfig: Release
Execution Env: Native
Runtime Env: Production
Runtimes installed:
.NET runtime: 7.0.19
.NET SDK: Not found
Default Python: Not found
Go: Not found
NodeJS: Not found
Rust: Not found
Video adapter info:
AMD Radeon(TM) Graphics:
Driver Version 31.0.21912.14
Video Processor AMD Radeon Graphics Processor (0x1638)
System GPU info:
GPU 3D Usage 2%
GPU RAM Usage 514.8 MiB
Global Environment variables:
CPAI_APPROOTPATH = <root>
CPAI_PORT = 32168
|
|
|
|
|
General 
News 
Suggestion 
Question 
Bug 
Answer 
Joke 
Praise 
Rant 
Admin 
Submit an article or tip
