|
Our installer script does (or attempts to do) all those painful complex steps all the guides suggest. We're trying hard to take those 10 different ways to do something and automate it all so you don't have to go through the pain of what we've gone through to get things working.
It looks like it all installed correctly. On the dashboard can you click the "..." to the right of the ObjectDetection YOLO package and select Stop. Click the ... next to the Coral module and select Start. Do the modules appear in the correct state?
If so, open the Explorer (link is top of dashboard in blue) and test the object detection through the explorer UI
cheers
Chris Maunder
|
|
|
|
|
Hi Chris,
Thanks for the reply.
I tried starting it from the "...." and this time it started. However, some errors were seen.
The logs are below. It also seemed to decide no settings had been set and set it's own even though there were already settings in the dashboard. I've had no triggers so hard to say if it's working atm. It has de-conflicted the previous triggers, but there's no sign of them being processed or processing times.
So anyone's guess if it's actually working or part working.
The error messages can be seen in the logs below:
20:01:28:Operating System: Windows (Microsoft Windows 10.0.19045)
20:01:28:CPUs: 11th Gen Intel(R) Core(TM) i5-11400 @ 2.60GHz (Intel)
20:01:28: 1 CPU x 6 cores. 12 logical processors (x64)
20:01:28:GPU: Intel(R) UHD Graphics 730 (1,024 MiB) (Intel Corporation)
20:01:28: Driver: 30.0.101.1273
20:01:28:System RAM: 16 GiB
20:01:28:Target: Windows
20:01:28:BuildConfig: Release
20:01:28:Execution Env: Native
20:01:28:Runtime Env: Production
20:01:28:.NET framework: .NET 7.0.5
20:01:28:App DataDir: C:\ProgramData\CodeProject\AI
20:01:28:Video adapter info:
20:01:28: Intel(R) UHD Graphics 730:
20:01:28: Driver Version 30.0.101.1273
20:01:28: Video Processor Intel(R) UHD Graphics Family
20:01:28:ROOT_PATH = C:\Program Files\CodeProject\AI
20:01:28:RUNTIMES_PATH = C:\Program Files\CodeProject\AI\runtimes
20:01:28:PREINSTALLED_MODULES_PATH = C:\Program Files\CodeProject\AI\preinstalled-modules
20:01:28:MODULES_PATH = C:\Program Files\CodeProject\AI\modules
20:01:28:PYTHON_PATH = \bin\windows\%PYTHON_RUNTIME%\venv\scripts\Python
20:01:28:Data Dir = C:\ProgramData\CodeProject\AI
20:01:28:Server version: 2.1.10-Beta
20:01:28:ModuleRunner Start
20:01:28:Starting Background AI Modules
20:01:33:A new version 2.1.11-Beta is available
20:01:33:Current Version is 2.1.10-Beta
20:01:39:Client request 'detect' in queue 'objectdetection_queue' (...31f90a)
20:01:39:Client request 'detect' in queue 'objectdetection_queue' (...761508)
20:01:40:Client request 'detect' in queue 'objectdetection_queue' (...7a1c02)
20:01:57:Client request 'detect' in queue 'objectdetection_queue' (...bb3459)
20:01:57:Client request 'detect' in queue 'objectdetection_queue' (...681ef6)
20:01:58:Client request 'detect' in queue 'objectdetection_queue' (...245226)
23:03:55:GetCommandByRuntime: Runtime=python37, Location=Local
23:03:55:Command: C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral\bin\windows\python37\venv\scripts\Python
23:03:55:
23:03:55:
23:03:55:Module 'ObjectDetection (Coral)' (ID: ObjectDetectionCoral)
23:03:55:Module Path: C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral
23:03:55:Starting C:\Program Files...ws\python37\venv\scripts\Python "C:\Program Files...ectdetection_coral_adapter.py"
23:03:55:Attempting to start ObjectDetectionCoral with C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral\bin\windows\python37\venv\scripts\Python "C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral\objectdetection_coral_adapter.py"
23:03:55:AutoStart: True
23:03:55:Queue: objectdetection_queue
23:03:55:Platforms: windows,linux,linux-arm64,macos,macos-arm64
23:03:55:GPU: Support enabled
23:03:55:Parallelism: 1
23:03:55:Accelerator:
23:03:55:Half Precis.: enable
23:03:55:Runtime: python37
23:03:55:Runtime Loc: Local
23:03:55:FilePath: objectdetection_coral_adapter.py
23:03:55:Pre installed: False
23:03:55:Start pause: 1 sec
23:03:55:LogVerbosity:
23:03:55:Valid: True
23:03:55:Environment Variables
23:03:55:MODELS_DIR = %CURRENT_MODULE_PATH%/assets
23:03:55:MODEL_SIZE = Medium
23:03:55:
23:03:55:Started ObjectDetection (Coral) module
23:04:11:objectdetection_coral_adapter.py: E driver/mmio_driver.cc:254] HIB Error. hib_error_status = ffffffffffffffff, hib_first_error_status = ffffffffffffffff
23:04:24:objectdetection_coral_adapter.py: E driver/mmio_driver.cc:254] HIB Error. hib_error_status = ffffffffffffffff, hib_first_error_status = ffffffffffffffff
23:04:24:objectdetection_coral_adapter.py: CPAI_MODULE_REQUIRED_MB not found. Setting to default 0
23:04:24:objectdetection_coral_adapter.py: NUM_THREADS not found. Setting to default 1
23:04:24:objectdetection_coral_adapter.py: MIN_CONFIDENCE not found. Setting to default 0.5
23:04:24:objectdetection_coral_adapter.py: MODULE_PATH: C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral
23:04:24:objectdetection_coral_adapter.py: MODELS_DIR: C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral\assets
23:04:24:objectdetection_coral_adapter.py: MODEL_SIZE: medium
23:04:24:objectdetection_coral_adapter.py: Timeout connecting to the server
23:04:24:objectdetection_coral_adapter.py: ObjectDetection (Coral) started.ObjectDetection (Coral): ObjectDetection (Coral) started.
23:04:24:objectdetection_coral_adapter.py: CPU_MODEL_NAME: efficientdet_lite3_512_ptq.tflite
23:04:24:objectdetection_coral_adapter.py: TPU_MODEL_NAME: efficientdet_lite3_512_ptq_edgetpu.tflite
23:04:24:objectdetection_coral_adapter.py: Input details: {'name': 'serving_default_images ', 'index': 0, 'shape': array([ 1, 512, 512, 3]), 'shape_signature': array([ 1, 512, 512, 3]), 'dtype': , 'quantization': (0.0078125, 127), 'quantization_parameters': {'scales': array([0.0078125], dtype=float32), 'zero_points': array([127]), 'quantized_dimension': 0}, 'sparsity_parameters': {}}
23:04:24:objectdetection_coral_adapter.py: Output details: {'name': 'StatefulPartitionedCall:31', 'index': 931, 'shape': array([ 1, 25, 4]), 'shape_signature': array([ 1, 25, 4]), 'dtype': , 'quantization': (0.0, 0), 'quantization_parameters': {'scales': array([], dtype=float32), 'zero_points': array([], dtype=int32), 'quantized_dimension': 0}, 'sparsity_parameters': {}}
23:04:24:ObjectDetection (Coral): ObjectDetection (Coral) started.
23:04:24:Request 'detect' dequeued from 'objectdetection_queue' (...31f90a)
23:04:24:Request 'detect' dequeued from 'objectdetection_queue' (...761508)
23:04:24:Request 'detect' dequeued from 'objectdetection_queue' (...7a1c02)
23:04:24:Request 'detect' dequeued from 'objectdetection_queue' (...681ef6)
23:04:24:Request 'detect' dequeued from 'objectdetection_queue' (...bb3459)
23:04:24:Request 'detect' dequeued from 'objectdetection_queue' (...245226)
One further point. I was unsure if I needed to load custom models for the EdgeTPU so stopped the service as it wouldn't allow custom models without. I was unable to select anything. BI then hung for quite some time before coming back and starting the AI service again. Seems to still be some code conflict there between AI and BI.
|
|
|
|
|
Ghost Man Nov2022 wrote: It also seemed to decide no settings had been set and set it's own even though there were already settings in the dashboard.
Do you mean CodeProject settings or Blue Iris settings?
Ghost Man Nov2022 wrote: I've had no triggers so hard to say if it's working atm. It has de-conflicted the previous triggers, but there's no sign of them being processed or processing times.
I assume this is in Blue Iris
Ghost Man Nov2022 wrote: I was unsure if I needed to load custom models for the EdgeTPU
We don't have custom models for the Coral yet, but will certainly be adding that soon.
In the logs I'm not seeing that the TPU was actually detected. Can you check your hardware?
cheers
Chris Maunder
|
|
|
|
|
Quote: Do you mean CodeProject settings or Blue Iris settings?
The C{AI logs suggested the values for minimum confidence etc were blank but in the AI Tab for BI they were filled out:
Quote: I assume this is in Blue Iris
Yes.
Quote: We don't have custom models for the Coral yet, but will certainly be adding that soon.
Ok. I was just wondering if I had to select a Coral model for it to work.
|
|
|
|
|
Quote: In the logs I'm not seeing that the TPU was actually detected. Can you check your hardware?
2 instances reported (Dual TPU) and windows reports it's working properly, so it's at least seeing it and has drivers.
I know someone with one working and they manually installed both Python using a script and Tensor flow lite, so I'm guessing that the issue is the CPAI module isn't correctly installing one of those (as required).
I'll post the latest logs below to show the latest error messages:
Quote:
18:06:56:Operating System: Windows (Microsoft Windows 10.0.19045)
18:06:56:CPUs: 11th Gen Intel(R) Core(TM) i5-11400 @ 2.60GHz (Intel)
18:06:56: 1 CPU x 6 cores. 12 logical processors (x64)
18:06:56:GPU: Intel(R) UHD Graphics 730 (1,024 MiB) (Intel Corporation)
18:06:56: Driver: 30.0.101.1273
18:06:56:System RAM: 16 GiB
18:06:56:Target: Windows
18:06:56:BuildConfig: Release
18:06:56:Execution Env: Native
18:06:56:Runtime Env: Production
18:06:56:.NET framework: .NET 7.0.5
18:06:56:App DataDir: C:\ProgramData\CodeProject\AI
18:06:56:Video adapter info:
18:06:57: Intel(R) UHD Graphics 730:
18:06:57: Driver Version 30.0.101.1273
18:06:57: Video Processor Intel(R) UHD Graphics Family
18:06:57:ROOT_PATH = C:\Program Files\CodeProject\AI
18:06:57:RUNTIMES_PATH = C:\Program Files\CodeProject\AI\runtimes
18:06:57:PREINSTALLED_MODULES_PATH = C:\Program Files\CodeProject\AI\preinstalled-modules
18:06:57:MODULES_PATH = C:\Program Files\CodeProject\AI\modules
18:06:57:PYTHON_PATH = \bin\windows\%PYTHON_RUNTIME%\venv\scripts\Python
18:06:57:Data Dir = C:\ProgramData\CodeProject\AI
18:06:57:Server version: 2.1.10-Beta
18:06:57:ModuleRunner Start
18:06:57:Starting Background AI Modules
18:07:00:GetCommandByRuntime: Runtime=python37, Location=Local
18:07:00:Command: C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral\bin\windows\python37\venv\scripts\Python
18:07:00:
18:07:00:Attempting to start ObjectDetectionCoral with C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral\bin\windows\python37\venv\scripts\Python "C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral\objectdetection_coral_adapter.py"
18:07:00:Starting C:\Program Files...ws\python37\venv\scripts\Python "C:\Program Files...ectdetection_coral_adapter.py"
18:07:00:
18:07:00:Module 'ObjectDetection (Coral)' (ID: ObjectDetectionCoral)
18:07:00:Module Path: C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral
18:07:00:AutoStart: True
18:07:00:Queue: objectdetection_queue
18:07:00:Platforms: windows,linux,linux-arm64,macos,macos-arm64
18:07:00:GPU: Support enabled
18:07:00:Parallelism: 1
18:07:00:Accelerator:
18:07:00:Half Precis.: enable
18:07:00:Runtime: python37
18:07:00:Runtime Loc: Local
18:07:00:FilePath: objectdetection_coral_adapter.py
18:07:00:Pre installed: False
18:07:00:Start pause: 1 sec
18:07:00:LogVerbosity:
18:07:00:Valid: True
18:07:00:Environment Variables
18:07:00:MODELS_DIR = %CURRENT_MODULE_PATH%/assets
18:07:00:MODEL_SIZE = Medium
18:07:00:
18:07:00:Started ObjectDetection (Coral) module
18:07:02:A new version 2.1.11-Beta is available
18:07:02:Current Version is 2.1.10-Beta
18:07:14:objectdetection_coral_adapter.py: E driver/mmio_driver.cc:254] HIB Error. hib_error_status = ffffffffffffffff, hib_first_error_status = ffffffffffffffff
18:07:28:objectdetection_coral_adapter.py: E driver/mmio_driver.cc:254] HIB Error. hib_error_status = ffffffffffffffff, hib_first_error_status = ffffffffffffffff
18:07:28:objectdetection_coral_adapter.py: CPAI_MODULE_REQUIRED_MB not found. Setting to default 0
18:07:28:objectdetection_coral_adapter.py: NUM_THREADS not found. Setting to default 1
18:07:28:objectdetection_coral_adapter.py: MIN_CONFIDENCE not found. Setting to default 0.5
18:07:28:objectdetection_coral_adapter.py: MODULE_PATH: C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral
18:07:28:objectdetection_coral_adapter.py: MODELS_DIR: C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral\assets
18:07:28:objectdetection_coral_adapter.py: MODEL_SIZE: medium
18:07:28:objectdetection_coral_adapter.py: CPU_MODEL_NAME: efficientdet_lite3_512_ptq.tflite
18:07:28:objectdetection_coral_adapter.py: TPU_MODEL_NAME: efficientdet_lite3_512_ptq_edgetpu.tflite
18:07:28:objectdetection_coral_adapter.py: Input details: {'name': 'serving_default_images ', 'index': 0, 'shape': array([ 1, 512, 512, 3]), 'shape_signature': array([ 1, 512, 512, 3]), 'dtype': , 'quantization': (0.0078125, 127), 'quantization_parameters': {'scales': array([0.0078125], dtype=float32), 'zero_points': array([127]), 'quantized_dimension': 0}, 'sparsity_parameters': {}}
18:07:28:objectdetection_coral_adapter.py: Output details: {'name': 'StatefulPartitionedCall:31', 'index': 931, 'shape': array([ 1, 25, 4]), 'shape_signature': array([ 1, 25, 4]), 'dtype': , 'quantization': (0.0, 0), 'quantization_parameters': {'scales': array([], dtype=float32), 'zero_points': array([], dtype=int32), 'quantized_dimension': 0}, 'sparsity_parameters': {}}
18:07:28:objectdetection_coral_adapter.py: Timeout connecting to the server
18:07:28:objectdetection_coral_adapter.py: ObjectDetection (Coral) started.ObjectDetection (Coral): ObjectDetection (Coral) started.
18:07:28:ObjectDetection (Coral): ObjectDetection (Coral) started.
18:16:51:Client request 'detect' in queue 'objectdetection_queue' (...fe704d)
18:16:51:Request 'detect' dequeued from 'objectdetection_queue' (...fe704d)
18:16:51:ObjectDetection (Coral): Retrieved objectdetection_queue command
18:16:52:Client request 'detect' in queue 'objectdetection_queue' (...850279)
18:16:52:Request 'detect' dequeued from 'objectdetection_queue' (...850279)
18:16:52:ObjectDetection (Coral): Retrieved objectdetection_queue command
18:16:52:Client request 'detect' in queue 'objectdetection_queue' (...61a35f)
18:16:52:Request 'detect' dequeued from 'objectdetection_queue' (...61a35f)
18:16:52:ObjectDetection (Coral): Retrieved objectdetection_queue command
18:16:53:ObjectDetection (Coral): Queue request for ObjectDetection (Coral) command 'detect' (...850279) took 1019ms
18:16:53:Response received (...850279): The interpreter is in use. Please try again later
18:16:53:ObjectDetection (Coral): Queue request for ObjectDetection (Coral) command 'detect' (...61a35f) took 1025ms
18:16:53:Response received (...61a35f): The interpreter is in use. Please try again later
Logging level
trace
One other question, the Coral database runs locally doesn't it? I currently don't have a dedicated network cable for the BI pc so have to swap it between Main PC and BI PC as required.
Reading the logs (which mean little to me) the main issue seems to be a HIB error status and the interpreter being busy.
One last thought, the log also says Quote: objectdetection_coral_adapter.py: CPAI_MODULE_REQUIRED_MB not found. Setting to default 0
Could it be looking in the wrong place ie PCIE slot by default using CPAI? Mine is in the CPU M.2 slot via an adapter (adapter because the key of the TPU m.2 is different to the motherboard M.2 slot).
modified 22-Aug-23 13:49pm.
|
|
|
|
|
Quote: E driver/mmio_driver.cc:254] HIB Error. hib_error_status = ffffffffffffffff, hib_first_error_status = ffffffffffffffff
This seems to be the issue.
In the Coral module (/modules/ObjectDetectionCoral) should be a edgetpu_runtime folder. In that is the install.bat for the drivers. It would be interesting to re-run that (under admin mode in a Windows Terminal) just to ensure things are good
cheers
Chris Maunder
|
|
|
|
|
Hi Chris,
Didn't know how to do what you said, so I used the Uninstaller in the EdgeRuntime and then reinstalled the Module.
This seems to have it working with some issues:
1. Interpretation tooks 229ms vs 250 for the PC's CPU under Yolo5. This looks plainly wrong as the TPU is both dual and on a direct connection to the CPU's bus via M.2 (non chipset version) so direct path to CPU.
2. A subsequent Interpretation took 1021 ms with no result.
3. After 2. the logs show "The interpreter is in use. Please try again later". This may have been a request from the 2nd camera as I walked through 1 cameras tips to the others and then back again.
Very strange it would timeout though and very long times - remember this is dual TPU so processing should be at least 1/2 what a single TPU would return, no forgoing the direct CPU Bus connection as well circumventing the chipset.
Quote:
18:54:18:Operating System: Windows (Microsoft Windows 10.0.19045)
18:54:18:CPUs: 11th Gen Intel(R) Core(TM) i5-11400 @ 2.60GHz (Intel)
18:54:18: 1 CPU x 6 cores. 12 logical processors (x64)
18:54:18:GPU: Intel(R) UHD Graphics 730 (1,024 MiB) (Intel Corporation)
18:54:18: Driver: 30.0.101.1273
18:54:18:System RAM: 16 GiB
18:54:18:Target: Windows
18:54:18:BuildConfig: Release
18:54:18:Execution Env: Native
18:54:18:Runtime Env: Production
18:54:18:.NET framework: .NET 7.0.5
18:54:18:App DataDir: C:\ProgramData\CodeProject\AI
18:54:18:Video adapter info:
18:54:18: Intel(R) UHD Graphics 730:
18:54:18: Driver Version 30.0.101.1273
18:54:18: Video Processor Intel(R) UHD Graphics Family
18:54:18:ROOT_PATH = C:\Program Files\CodeProject\AI
18:54:18:RUNTIMES_PATH = C:\Program Files\CodeProject\AI\runtimes
18:54:18:PREINSTALLED_MODULES_PATH = C:\Program Files\CodeProject\AI\preinstalled-modules
18:54:18:MODULES_PATH = C:\Program Files\CodeProject\AI\modules
18:54:18:PYTHON_PATH = \bin\windows\%PYTHON_RUNTIME%\venv\scripts\Python
18:54:18:Data Dir = C:\ProgramData\CodeProject\AI
18:54:18:Server version: 2.1.10-Beta
18:54:18:ModuleRunner Start
18:54:18:Starting Background AI Modules
18:54:21:GetCommandByRuntime: Runtime=python37, Location=Local
18:54:21:Command: C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral\bin\windows\python37\venv\scripts\Python
18:54:21:Starting C:\Program Files...ws\python37\venv\scripts\Python "C:\Program Files...ectdetection_coral_adapter.py"
18:54:21:
18:54:21:Attempting to start ObjectDetectionCoral with C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral\bin\windows\python37\venv\scripts\Python "C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral\objectdetection_coral_adapter.py"
18:54:21:
18:54:21:Module 'ObjectDetection (Coral)' (ID: ObjectDetectionCoral)
18:54:21:Module Path: C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral
18:54:21:AutoStart: True
18:54:21:Queue: objectdetection_queue
18:54:21:Platforms: windows,linux,linux-arm64,macos,macos-arm64
18:54:21:GPU: Support enabled
18:54:21:Parallelism: 1
18:54:21:Accelerator:
18:54:21:Half Precis.: enable
18:54:21:Runtime: python37
18:54:21:Runtime Loc: Local
18:54:21:FilePath: objectdetection_coral_adapter.py
18:54:21:Pre installed: False
18:54:21:Start pause: 1 sec
18:54:21:LogVerbosity:
18:54:21:Valid: True
18:54:21:Environment Variables
18:54:21:MODELS_DIR = %CURRENT_MODULE_PATH%/assets
18:54:21:MODEL_SIZE = Medium
18:54:21:
18:54:21:Started ObjectDetection (Coral) module
18:54:24:objectdetection_coral_adapter.py: CPAI_MODULE_REQUIRED_MB not found. Setting to default 0
18:54:24:objectdetection_coral_adapter.py: NUM_THREADS not found. Setting to default 1
18:54:24:objectdetection_coral_adapter.py: Edge TPU detected
18:54:24:objectdetection_coral_adapter.py: MIN_CONFIDENCE not found. Setting to default 0.5
18:54:24:objectdetection_coral_adapter.py: MODULE_PATH: C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral
18:54:24:objectdetection_coral_adapter.py: MODELS_DIR: C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral\assets
18:54:24:objectdetection_coral_adapter.py: MODEL_SIZE: medium
18:54:24:objectdetection_coral_adapter.py: CPU_MODEL_NAME: efficientdet_lite3_512_ptq.tflite
18:54:24:objectdetection_coral_adapter.py: TPU_MODEL_NAME: efficientdet_lite3_512_ptq_edgetpu.tflite
18:54:24:objectdetection_coral_adapter.py: Input details: {'name': 'serving_default_images ', 'index': 0, 'shape': array([ 1, 512, 512, 3]), 'shape_signature': array([ 1, 512, 512, 3]), 'dtype': , 'quantization': (0.0078125, 127), 'quantization_parameters': {'scales': array([0.0078125], dtype=float32), 'zero_points': array([127]), 'quantized_dimension': 0}, 'sparsity_parameters': {}}
18:54:24:objectdetection_coral_adapter.py: Output details: {'name': 'StatefulPartitionedCall:31', 'index': 23, 'shape': array([ 1, 25, 4]), 'shape_signature': array([ 1, 25, 4]), 'dtype': , 'quantization': (0.0, 0), 'quantization_parameters': {'scales': array([], dtype=float32), 'zero_points': array([], dtype=int32), 'quantized_dimension': 0}, 'sparsity_parameters': {}}
18:54:24:Running init for ObjectDetection (Coral)
18:54:24:ObjectDetection (Coral): ObjectDetection (Coral) started.
18:54:24:A new version 2.1.11-Beta is available
18:54:24:Current Version is 2.1.10-Beta
18:57:57:Client request 'detect' in queue 'objectdetection_queue' (...1a68f9)
18:57:57:Request 'detect' dequeued from 'objectdetection_queue' (...1a68f9)
18:57:57:ObjectDetection (Coral): Retrieved objectdetection_queue command
18:57:57:ObjectDetection (Coral): Queue request for ObjectDetection (Coral) command 'detect' (...1a68f9) took 229ms
18:57:57:Response received (...1a68f9): Found person, truck
18:58:03:Client request 'detect' in queue 'objectdetection_queue' (...394efa)
18:58:03:Request 'detect' dequeued from 'objectdetection_queue' (...394efa)
18:58:03:ObjectDetection (Coral): Retrieved objectdetection_queue command
18:58:04:Client request 'detect' in queue 'objectdetection_queue' (...ab17c7)
18:58:04:Request 'detect' dequeued from 'objectdetection_queue' (...ab17c7)
18:58:04:ObjectDetection (Coral): Retrieved objectdetection_queue command
18:58:05:Client request 'detect' in queue 'objectdetection_queue' (...5ad358)
18:58:05:Request 'detect' dequeued from 'objectdetection_queue' (...5ad358)
18:58:05:ObjectDetection (Coral): Retrieved objectdetection_queue command
18:58:05:ObjectDetection (Coral): Queue request for ObjectDetection (Coral) command 'detect' (...ab17c7) took 1021ms
18:58:05:Response received (...ab17c7): The interpreter is in use. Please try again later
|
|
|
|
|
With the dual TPUs you either run inferences in parallel (target one TPU, then target the other, and back again) resulting in higher throughput, but each inference is on a single TPU, or you use pipelining to split a single inference between both TPUs. Unfortunately don't have specific support for multiple TPUs so you won't see a doubling of throughput.
The other thing we've seen is that Coral on Windows is simply slower than any other platform. I don't have an answer as to why, unfortunately.
cheers
Chris Maunder
|
|
|
|
|
Original issues are back this morning, in fact it looks as if the AI is turning itself off with the console:
HIb issues also:
Quote: 09:25:04:Server version: 2.1.10-Beta
09:25:04:ModuleRunner Start
09:25:04:Starting Background AI Modules
09:25:07:GetCommandByRuntime: Runtime=python37, Location=Local
09:25:07:Command: C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral\bin\windows\python37\venv\scripts\Python
09:25:07:
09:25:07:Attempting to start ObjectDetectionCoral with C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral\bin\windows\python37\venv\scripts\Python "C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral\objectdetection_coral_adapter.py"
09:25:07:Starting C:\Program Files...ws\python37\venv\scripts\Python "C:\Program Files...ectdetection_coral_adapter.py"
09:25:07:
09:25:07:Module 'ObjectDetection (Coral)' (ID: ObjectDetectionCoral)
09:25:07:Module Path: C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral
09:25:07:AutoStart: True
09:25:07:Queue: objectdetection_queue
09:25:07:Platforms: windows,linux,linux-arm64,macos,macos-arm64
09:25:07:GPU: Support enabled
09:25:07:Parallelism: 1
09:25:07:Accelerator:
09:25:07:Half Precis.: enable
09:25:07:Runtime: python37
09:25:07:Runtime Loc: Local
09:25:07:FilePath: objectdetection_coral_adapter.py
09:25:07:Pre installed: False
09:25:07:Start pause: 1 sec
09:25:07:LogVerbosity:
09:25:07:Valid: True
09:25:07:Environment Variables
09:25:07:MODELS_DIR = %CURRENT_MODULE_PATH%/assets
09:25:07:MODEL_SIZE = Medium
09:25:07:
09:25:07:Started ObjectDetection (Coral) module
09:25:10:A new version 2.1.11-Beta is available
09:25:10:Current Version is 2.1.10-Beta
09:25:22:objectdetection_coral_adapter.py: E driver/mmio_driver.cc:254] HIB Error. hib_error_status = ffffffffffffffff, hib_first_error_status = ffffffffffffffff
09:25:35:objectdetection_coral_adapter.py: E driver/mmio_driver.cc:254] HIB Error. hib_error_status = ffffffffffffffff, hib_first_error_status = ffffffffffffffff
09:25:35:objectdetection_coral_adapter.py: CPAI_MODULE_REQUIRED_MB not found. Setting to default 0
09:25:35:objectdetection_coral_adapter.py: NUM_THREADS not found. Setting to default 1
09:25:35:objectdetection_coral_adapter.py: MIN_CONFIDENCE not found. Setting to default 0.5
09:25:35:objectdetection_coral_adapter.py: MODULE_PATH: C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral
09:25:35:objectdetection_coral_adapter.py: MODELS_DIR: C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral\assets
09:25:35:objectdetection_coral_adapter.py: MODEL_SIZE: medium
09:25:35:objectdetection_coral_adapter.py: CPU_MODEL_NAME: efficientdet_lite3_512_ptq.tflite
09:25:35:objectdetection_coral_adapter.py: TPU_MODEL_NAME: efficientdet_lite3_512_ptq_edgetpu.tflite
09:25:35:objectdetection_coral_adapter.py: Timeout connecting to the server
09:25:35:objectdetection_coral_adapter.py: ObjectDetection (Coral) started.ObjectDetection (Coral): ObjectDetection (Coral) started.
09:25:35:objectdetection_coral_adapter.py: Input details: {'name': 'serving_default_images ', 'index': 0, 'shape': array([ 1, 512, 512, 3]), 'shape_signature': array([ 1, 512, 512, 3]), 'dtype': , 'quantization': (0.0078125, 127), 'quantization_parameters': {'scales': array([0.0078125], dtype=float32), 'zero_points': array([127]), 'quantized_dimension': 0}, 'sparsity_parameters': {}}
09:25:35:objectdetection_coral_adapter.py: Output details: {'name': 'StatefulPartitionedCall:31', 'index': 931, 'shape': array([ 1, 25, 4]), 'shape_signature': array([ 1, 25, 4]), 'dtype': , 'quantization': (0.0, 0), 'quantization_parameters': {'scales': array([], dtype=float32), 'zero_points': array([], dtype=int32), 'quantized_dimension': 0}, 'sparsity_parameters': {}}
09:25:35:ObjectDetection (Coral): ObjectDetection (Coral) started.
I might try installing python separately and see if that alters anything.
|
|
|
|
|
Ghost Man Nov2022 wrote: it looks as if the AI is turning itself off with the console
I'm not sure where you are seeing that. It also doesn't seem like the libraries are finding the TPU itself. Does the dashboard say it's running under CPU or TPU?
cheers
Chris Maunder
|
|
|
|
|
Chris, Major turn for the worse.
I removed and re-installed the runtime launcher and removed and re-installed the Coral AI Model. Didn't bother with python separately as it looked too complex.
I decided to install version .11 beta of the AI as others who had it running seemed to have no issues.
After this, I went to the "...." next to the Coral AI model and right clicked. Selected Medium size of model, then Start.
Shortly afterwards my PC blue screened and shut down identifying the issue as Coral.
On a re-start, I now caanot get AI to start at all. Any attempt to start it brings up this message in BI. The AI server webpage is non responsive:
|
|
|
|
|
If the Blue screen is Coral related then I'd recommend checking the hardware is seated securely and would ensure you have the latest drivers.
cheers
Chris Maunder
|
|
|
|
|
Despite reverting back to CPAI V.10, it still will not start the AI service - path not found.
Procudure was Windows Apps > CPAI > Repair (Success but Unsuccessful in practice)
Windows App > Uninstall CPAI > Reboot
CPAI Standalone .exe .10 executed and installed > (Service created successfully, installed successfully) > Reboot
BI > Settings > AI > Start (failed - path not found)
So now left with NO AI.
As an aside, it might be an idea to create a clean installation utility to completely remove all traces of CPAI as I'm guessing the issue here is something left over.
|
|
|
|
|
Our installer is a fairly standard Windows installer and should clean out most of its debris. The only exception being (at this time) that it won't uninstall modules or ProgramData. This is to allow the update of the server to happen without requiring a full (and painfully slow, sometimes) install of the modules.
We're rewriting the entire installer to allow a full clean and hose-down.
For now, you can uninstall, then delete the C:\Program Files\CodeProject\AI folder, and also the C:\ProgramData\CodeProject\AI folders and you're clean.
After your reinstall, did the CodeProject.AI dashboard come up? In Blue Iris I would suggest disabling the stop/start AI service.
cheers
Chris Maunder
|
|
|
|
|
Chris I'm currently reinstalling CPAI and Coral Runtime, I'll let you know how it goes.
I noticed in the manual there's a section on a HIB error that blams the registry calls albeit it seems to be for Linux. I wonder if something similar is happening in windows.
This is what it says (from the Coral Website):
Get started with the M.2 or Mini PCIe Accelerator | Coral[^]
Quote: Troubleshooting on Linux
Here are some solutions to possible problems on Linux.
HIB error
If you are running on ARM64 platform and receive error messages such as the following when you run an inference...
HIB Error. hib_error_status = 0000000000002200, hib_first_error_status = 0000000000000200
... You should be able to solve it if you modify your kernel command line arguments to include gasket.dma_bit_mask=32.
For information about how to modify your kernel command line arguments, refer to your respective platform documentation. For bootloaders based on U-Boot, you can usually modify the arguments either by modifying the bootargs U-Boot environment variable or by setting othbootargs environment variable as follows:
=> setenv othbootargs gasket.dma_bit_mask=32
=> printenv othbootargs
othbootargs=gasket.dma_bit_mask=32
=> saveenv
If you make the above change and then receive errors such as, DMA: Out of SW-IOMMU space, then you need to increase the swiotlb buffer size by adding another kernel command line argument: swiotlb=65536.
As mentioned that is for Linux, but wonder if could also affect windows..
|
|
|
|
|
Back up and no blue screen now. Same issues though with Hib error.
Latest Logs:
Quote: cam setup guide and common issues pages.
20:43:12:Operating System: Windows (Microsoft Windows 10.0.19045)
20:43:12:CPUs: 11th Gen Intel(R) Core(TM) i5-11400 @ 2.60GHz (Intel)
20:43:12: 1 CPU x 6 cores. 12 logical processors (x64)
20:43:12:GPU: Intel(R) UHD Graphics 730 (1,024 MiB) (Intel Corporation)
20:43:12: Driver: 30.0.101.1273
20:43:12:System RAM: 16 GiB
20:43:12:Target: Windows
20:43:12:BuildConfig: Release
20:43:12:Execution Env: Native
20:43:12:Runtime Env: Production
20:43:12:.NET framework: .NET 7.0.5
20:43:12:App DataDir: C:\ProgramData\CodeProject\AI
20:43:12:Video adapter info:
20:43:12: Intel(R) UHD Graphics 730:
20:43:12: Driver Version 30.0.101.1273
20:43:12: Video Processor Intel(R) UHD Graphics Family
20:43:12:ROOT_PATH = C:\Program Files\CodeProject\AI
20:43:12:RUNTIMES_PATH = C:\Program Files\CodeProject\AI\runtimes
20:43:12:PREINSTALLED_MODULES_PATH = C:\Program Files\CodeProject\AI\preinstalled-modules
20:43:12:MODULES_PATH = C:\Program Files\CodeProject\AI\modules
20:43:12:PYTHON_PATH = \bin\windows\%PYTHON_RUNTIME%\venv\scripts\Python
20:43:12:Data Dir = C:\ProgramData\CodeProject\AI
20:43:12:Server version: 2.1.10-Beta
20:43:12:ModuleRunner Start
20:43:12:Starting Background AI Modules
20:43:14:Client request 'list-custom' in queue 'objectdetection_queue' (...e78435)
20:43:15:GetCommandByRuntime: Runtime=python37, Location=Local
20:43:15:Command: C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral\bin\windows\python37\venv\scripts\Python
20:43:15:
20:43:15:Starting C:\Program Files...ws\python37\venv\scripts\Python "C:\Program Files...ectdetection_coral_adapter.py"
20:43:15:Attempting to start ObjectDetectionCoral with C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral\bin\windows\python37\venv\scripts\Python "C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral\objectdetection_coral_adapter.py"
20:43:15:
20:43:15:Module 'ObjectDetection (Coral)' (ID: ObjectDetectionCoral)
20:43:15:Module Path: C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral
20:43:15:AutoStart: True
20:43:15:Queue: objectdetection_queue
20:43:15:Platforms: windows,linux,linux-arm64,macos,macos-arm64
20:43:15:GPU: Support enabled
20:43:15:Parallelism: 1
20:43:15:Accelerator:
20:43:15:Half Precis.: enable
20:43:15:Runtime: python37
20:43:15:Runtime Loc: Local
20:43:15:FilePath: objectdetection_coral_adapter.py
20:43:15:Pre installed: False
20:43:15:Start pause: 1 sec
20:43:15:LogVerbosity:
20:43:15:Valid: True
20:43:15:Environment Variables
20:43:15:MODELS_DIR = %CURRENT_MODULE_PATH%/assets
20:43:15:MODEL_SIZE = Medium
20:43:15:
20:43:15:Started ObjectDetection (Coral) module
20:43:23:Client request 'detect' in queue 'objectdetection_queue' (...abbef9)
20:43:24:Client request 'detect' in queue 'objectdetection_queue' (...ddda08)
20:43:24:Client request 'detect' in queue 'objectdetection_queue' (...9e7279)
20:43:30:objectdetection_coral_adapter.py: E driver/mmio_driver.cc:254] HIB Error. hib_error_status = ffffffffffffffff, hib_first_error_status = ffffffffffffffff
20:43:43:objectdetection_coral_adapter.py: E driver/mmio_driver.cc:254] HIB Error. hib_error_status = ffffffffffffffff, hib_first_error_status = ffffffffffffffff
20:43:43:objectdetection_coral_adapter.py: CPAI_MODULE_REQUIRED_MB not found. Setting to default 0
20:43:43:objectdetection_coral_adapter.py: NUM_THREADS not found. Setting to default 1
20:43:43:objectdetection_coral_adapter.py: MIN_CONFIDENCE not found. Setting to default 0.5
20:43:43:objectdetection_coral_adapter.py: MODULE_PATH: C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral
20:43:43:objectdetection_coral_adapter.py: MODELS_DIR: C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral\assets
20:43:43:objectdetection_coral_adapter.py: MODEL_SIZE: medium
20:43:43:objectdetection_coral_adapter.py: Timeout connecting to the server
20:43:43:objectdetection_coral_adapter.py: ObjectDetection (Coral) started.ObjectDetection (Coral): ObjectDetection (Coral) started.
20:43:43:objectdetection_coral_adapter.py: CPU_MODEL_NAME: efficientdet_lite3_512_ptq.tflite
20:43:43:objectdetection_coral_adapter.py: TPU_MODEL_NAME: efficientdet_lite3_512_ptq_edgetpu.tflite
20:43:43:objectdetection_coral_adapter.py: Input details: {'name': 'serving_default_images ', 'index': 0, 'shape': array([ 1, 512, 512, 3]), 'shape_signature': array([ 1, 512, 512, 3]), 'dtype': , 'quantization': (0.0078125, 127), 'quantization_parameters': {'scales': array([0.0078125], dtype=float32), 'zero_points': array([127]), 'quantized_dimension': 0}, 'sparsity_parameters': {}}
20:43:43:objectdetection_coral_adapter.py: Output details: {'name': 'StatefulPartitionedCall:31', 'index': 931, 'shape': array([ 1, 25, 4]), 'shape_signature': array([ 1, 25, 4]), 'dtype': , 'quantization': (0.0, 0), 'quantization_parameters': {'scales': array([], dtype=float32), 'zero_points': array([], dtype=int32), 'quantized_dimension': 0}, 'sparsity_parameters': {}}
20:43:43:ObjectDetection (Coral): ObjectDetection (Coral) started.
20:43:43:Request 'list-custom' dequeued from 'objectdetection_queue' (...e78435)
20:43:43:Request 'detect' dequeued from 'objectdetection_queue' (...abbef9)
20:43:43:Request 'detect' dequeued from 'objectdetection_queue' (...ddda08)
20:43:43:Request 'detect' dequeued from 'objectdetection_queue' (...9e7279)
20:43:43:ObjectDetection (Coral): Retrieved objectdetection_queue command
20:43:43:ObjectDetection (Coral): Queue request for ObjectDetection (Coral) command 'list-custom' (...e78435) took 1ms
20:43:43:Response received (...e78435)
20:43:43:ObjectDetection (Coral): Retrieved objectdetection_queue command
20:43:43:ObjectDetection (Coral): Retrieved objectdetection_queue command
20:43:43:ObjectDetection (Coral): Retrieved objectdetection_queue command
20:43:44:ObjectDetection (Coral): Queue request for ObjectDetection (Coral) command 'detect' (...abbef9) took 1027ms
20:43:44:Response received (...abbef9): The interpreter is in use. Please try again later
20:43:44:ObjectDetection (Coral): Queue request for ObjectDetection (Coral) command 'detect' (...ddda08) took 1041ms
20:43:44:Response received (...ddda08): The interpreter is in use. Please try again later
20:44:17:ObjectDetection (Coral): Queue request for ObjectDetection (Coral) command 'detect' (...9e7279) took 33493ms
|
|
|
|
|
No solutions yet?
Sorry not been around for a few days, been in hospital.
|
|
|
|
|
Hello,
i have an M.2 Coral installed in my Server running Proxmox.
I created a VM with the Coral PCI Device attached.
Installed all Coral Drivers and Modules inside the VM.
Installed Docker and attached the device to the Docker Container.
Installed ObjectDetection (Coral)
The M.2 Coral is attached to the VM according lspci inside the Container:
00:10.0 System peripheral: Global Unichip Corp. Coral Edge TPU
Starting the Coral ObjectDetection tells me "Edge TPU detected" :
08:20:18:Running init for ObjectDetection (Coral)
08:20:19:objectdetection_coral_adapter.py: CPAI_MODULE_REQUIRED_MB not found. Setting to default 0
08:20:19:objectdetection_coral_adapter.py: NUM_THREADS not found. Setting to default 1
08:20:19:objectdetection_coral_adapter.py: MIN_CONFIDENCE not found. Setting to default 0.5
08:20:19:objectdetection_coral_adapter.py: MODULE_PATH: /app/modules/ObjectDetectionCoral
08:20:19:objectdetection_coral_adapter.py: MODELS_DIR: /app/modules/ObjectDetectionCoral/assets
08:20:19:objectdetection_coral_adapter.py: MODEL_SIZE: medium
08:20:19:objectdetection_coral_adapter.py: CPU_MODEL_NAME: efficientdet_lite3_512_ptq.tflite
08:20:19:objectdetection_coral_adapter.py: TPU_MODEL_NAME: efficientdet_lite3_512_ptq_edgetpu.tflite
08:20:19:objectdetection_coral_adapter.py: Edge TPU detected
08:20:19:objectdetection_coral_adapter.py: Input details: {'name': 'serving_default_images:0', 'index': 0, 'shape': array([ 1, 512, 512, 3], dtype=int32), 'shape_signature': array([ 1, 512, 512, 3], dtype=int32), 'dtype': , 'quantization': (0.0078125, 127), 'quantization_parameters': {'scales': array([0.0078125], dtype=float32), 'zero_points': array([127], dtype=int32), 'quantized_dimension': 0}, 'sparsity_parameters': {}}
08:20:19:objectdetection_coral_adapter.py: Output details: {'name': 'StatefulPartitionedCall:31', 'index': 23, 'shape': array([ 1, 25, 4], dtype=int32), 'shape_signature': array([ 1, 25, 4], dtype=int32), 'dtype': , 'quantization': (0.0, 0), 'quantization_parameters': {'scales': array([], dtype=float32), 'zero_points': array([], dtype=int32), 'quantized_dimension': 0}, 'sparsity_parameters': {}}
08:20:19:ObjectDetection (Coral): ObjectDetection (Coral) started.
ObjectDetection (Coral) is Starting but using CPU
Everything seems to work properly but detecting does nothing.
Are im missing something here?
Systeminfo:
Server version: 2.1.11-Beta
Operating System: Linux (Linux 5.10.0-25-amd64 #1 SMP Debian 5.10.191-1 (2023-08-16))
CPUs: QEMU Virtual CPU version 2.5+
1 CPU x 1 core. 1 logical processors (x64)
System RAM: 4 GiB
Target: Linux
BuildConfig: Release
Execution Env: Docker
Runtime Env: Production
.NET framework: .NET 7.0.10
System GPU info:
GPU 3D Usage 0%
GPU RAM Usage 0
Video adapter info:
Global Environment variables:
CPAI_APPROOTPATH = /app
CPAI_PORT = 32168
Serverlogs:
24:27:36:Operating System: Linux (Linux 5.10.0-25-amd64 #1 SMP Debian 5.10.191-1 (2023-08-16))
24:27:36:CPUs: QEMU Virtual CPU version 2.5+
24:27:36: 1 CPU x 1 core. 1 logical processors (x64)
24:27:36:System RAM: 4 GiB
24:27:36:Target: Linux
24:27:36:BuildConfig: Release
24:27:36:Execution Env: Docker
24:27:36:Runtime Env: Production
24:27:36:.NET framework: .NET 7.0.10
24:27:36:App DataDir: /etc/codeproject/ai
24:27:36:Video adapter info:
24:27:36:ROOT_PATH = /app
24:27:36:RUNTIMES_PATH = /app/runtimes
24:27:36:PREINSTALLED_MODULES_PATH = /app/preinstalled-modules
24:27:36:MODULES_PATH = /app/modules
24:27:36:PYTHON_PATH = /bin/linux/%PYTHON_RUNTIME%/venv/bin/python3
24:27:36:Data Dir = /etc/codeproject/ai
24:27:36:Server version: 2.1.11-Beta
24:27:36:ModuleRunner Start
24:27:36:Overriding address(es) 'http://+:32168, http://+:5000'. Binding to endpoints defined via IConfiguration and/or UseKestrel() instead.
24:27:36:Starting Background AI Modules
24:27:39:GetCommandByRuntime: Runtime=python39, Location=Local
24:27:39:Command: /app/modules/ObjectDetectionCoral/bin/linux/python39/venv/bin/python3
24:27:39:
24:27:39:Attempting to start ObjectDetectionCoral with /app/modules/ObjectDetectionCoral/bin/linux/python39/venv/bin/python3 "/app/modules/ObjectDetectionCoral/objectdetection_coral_adapter.py"
24:27:39:Starting /app...onCoral/bin/linux/python39/venv/bin/python3 "/app...ionCoral/objectdetection_coral_adapter.py"
24:27:39:
24:27:39:Module 'ObjectDetection (Coral)' (ID: ObjectDetectionCoral)
24:27:39:Module Path: /app/modules/ObjectDetectionCoral
24:27:39:AutoStart: True
24:27:39:Queue: objectdetection_queue
24:27:39:Platforms: windows,linux,linux-arm64,macos,macos-arm64
24:27:39:GPU: Support enabled
24:27:39:Parallelism: 1
24:27:39:Accelerator:
24:27:39:Half Precis.: enable
24:27:39:Runtime: python39
24:27:39:Runtime Loc: Local
24:27:39:FilePath: objectdetection_coral_adapter.py
24:27:39:Pre installed: False
24:27:39:Start pause: 1 sec
24:27:39:LogVerbosity:
24:27:39:Valid: True
24:27:39:Environment Variables
24:27:39:MODELS_DIR = %CURRENT_MODULE_PATH%/assets
24:27:39:MODEL_SIZE = Medium
24:27:39:
24:27:39:Started ObjectDetection (Coral) module
24:27:41:Current Version is 2.1.11-Beta
24:27:41:Server: This is the latest version
24:27:42:Running init for ObjectDetection (Coral)
24:27:42:objectdetection_coral_adapter.py: CPAI_MODULE_REQUIRED_MB not found. Setting to default 0
24:27:42:objectdetection_coral_adapter.py: NUM_THREADS not found. Setting to default 1
24:27:42:objectdetection_coral_adapter.py: MIN_CONFIDENCE not found. Setting to default 0.5
24:27:42:objectdetection_coral_adapter.py: MODULE_PATH: /app/modules/ObjectDetectionCoral
24:27:42:objectdetection_coral_adapter.py: MODELS_DIR: /app/modules/ObjectDetectionCoral/assets
24:27:42:objectdetection_coral_adapter.py: MODEL_SIZE: medium
24:27:42:objectdetection_coral_adapter.py: CPU_MODEL_NAME: efficientdet_lite3_512_ptq.tflite
24:27:42:objectdetection_coral_adapter.py: TPU_MODEL_NAME: efficientdet_lite3_512_ptq_edgetpu.tflite
24:27:42:objectdetection_coral_adapter.py: Edge TPU detected
24:27:42:objectdetection_coral_adapter.py: Input details: {'name': 'serving_default_images:0', 'index': 0, 'shape': array([ 1, 512, 512, 3], dtype=int32), 'shape_signature': array([ 1, 512, 512, 3], dtype=int32), 'dtype': , 'quantization': (0.0078125, 127), 'quantization_parameters': {'scales': array([0.0078125], dtype=float32), 'zero_points': array([127], dtype=int32), 'quantized_dimension': 0}, 'sparsity_parameters': {}}
24:27:42:objectdetection_coral_adapter.py: Output details: {'name': 'StatefulPartitionedCall:31', 'index': 23, 'shape': array([ 1, 25, 4], dtype=int32), 'shape_signature': array([ 1, 25, 4], dtype=int32), 'dtype': , 'quantization': (0.0, 0), 'quantization_parameters': {'scales': array([], dtype=float32), 'zero_points': array([], dtype=int32), 'quantized_dimension': 0}, 'sparsity_parameters': {}}
24:27:42:ObjectDetection (Coral): ObjectDetection (Coral) started.
24:28:03:Client request 'list-custom' in queue 'objectdetection_queue' (...bd74c6)
24:28:03:Client request 'list-custom' in queue 'objectdetection_queue' (...6c8e5b)
24:28:09:Client request 'detect' in queue 'objectdetection_queue' (...83649e)
24:28:54:Client request 'detect' in queue 'objectdetection_queue' (...bd1107)
24:28:54:Client request 'detect' in queue 'objectdetection_queue' (...e3cb2f)
24:28:54:Client request 'detect' in queue 'objectdetection_queue' (...4683a6)
24:28:54:Client request 'detect' in queue 'objectdetection_queue' (...ac0487)
24:28:54:Client request 'detect' in queue 'objectdetection_queue' (...b764db)
24:28:54:Client request 'detect' in queue 'objectdetection_queue' (...8a0ade)
08:02:39:Sending shutdown request to python3/ObjectDetectionCoral
08:02:39:Client request 'Quit' in queue 'objectdetection_queue' (...005acd)
08:03:12:Forcing shutdown of python3/ObjectDetectionCoral
08:03:12:Waiting for ObjectDetectionCoral to end.
08:03:12:Module ObjectDetectionCoral has shutdown
|
|
|
|
|
Unfortunately I can't help with proxmox isues, but have you tried increasing the amount of RAM from 4 to 8Gb? Just a thought.
cheers
Chris Maunder
|
|
|
|
|
It's not a proxmox problem. I can use the coral tpu inside the same vm. I attached the tpu test wise with a Frigate NVR Docker Container.
I can try adding more ram.
|
|
|
|
|
I had a rough time trying to get the Coral to work. Sometimes everything would report as being OK, but things like loading the delegates from the edgetpu libraries would just hang or crash the module. And then some days it would just...work.
Things that seemed to help for me was plugging devices in before starting the module, and if there were issues, shutting down, unplugging, then plugging into a different USB port (I'm using the USB Coral) or using a different cable. Not solutions for you, unfortunately, but I definitely did find it fiddly.
Except on the Raspberry Pi. It's always been rock solid on the Pi. So weird.
cheers
Chris Maunder
|
|
|
|
|
Sorry for this late response. My Family got the flue one by one...
So Adding more RAM did finally do the Trick.
I did build my own Image with libedgetpu1-max and some drivers for M.2.
It runs with about 100 - 120 ms Roundtrip.
|
|
|
|
|
If you can share your working code I'll integrate this into the module for all to enjoy
Well done! (and sorry to hear about your family. Ah, flu season...)
cheers
Chris Maunder
|
|
|
|
|
Are you sharing the TPU with Frigate? I'm unable to get the Coral to work with both Frigate and CPAI at the same time. As soon as I shut down Frigate, it came right up in CPAI.
|
|
|
|
|
No! That's in my Knowledge technically impossible beacause you can map /dev/apex only once.
I did just test the Docker Setup with a Frigate Container to verify that the M.2 Coral Hardware could be used in Docker)
|
|
|
|
|