Engine & Accelerator

class Engine(value)

Software inference engines supported by edgeIQ

DNN = 'DNN'

OpenCV’s DNN backend.

Supports:

DNN_CUDA = 'DNN_CUDA'

OpenCV’s CUDA Inference Engine backend.

Supports:

TENSOR_RT = 'TENSOR_RT'

Tensor RT Engine

Supports:

HAILO_RT = 'HAILO_RT'

Hailo RT Engine

Supports:

QAIC_RT = 'QAIC_RT'

QAIC RT Engine

Supports:

ONNX_RT = 'ONNX_RT'

ONNX RT Engine

Supports:

PYTORCH = 'PYTORCH'

PYTORCH Engine

Supports:

class Accelerator(value)

HW accelerators supported by edgeIQ

DEFAULT = 'DEFAULT'

Selects the default accelerator for the given Engine

CPU = 'CPU'

Run the Engine on the CPU

GPU = 'GPU'

Run the Engine on the GPU.

NVIDIA = 'NVIDIA'

Run the Engine on a NVIDIA gpu accelerator

NVIDIA_FP16 = 'NVIDIA_FP16'

Run the Engine on a NVIDIA gpu accelerator compressed to floating point 16

NVIDIA_DLA_0 = 'NVIDIA_DLA_0'

Run the Engine on NVIDIA DLA core 0

NVIDIA_DLA_1 = 'NVIDIA_DLA_1'

Run the Engine on NVIDIA DLA core 1

HAILO = 'HAILO'

Run the Engine on a HAILO accelerator

QAIC = 'QAIC'

Run the Engine on a Qualcomm’s QAIC accelerator