VideoStream¶

exception CameraFailedToStart(cmd, backend, append='')¶

Error when camera initialization fails.

args¶

with_traceback()¶: Exception.with_traceback(tb) – set self.__traceback__ to tb and return self.

exception CameraConnectionLost¶

Error for when the camera connection is not found after the connection has been established.

args¶

with_traceback()¶: Exception.with_traceback(tb) – set self.__traceback__ to tb and return self.

class BaseVideoStream(cmd, backend)¶

start()¶

Start reading frames from the video stream.

Returns: self
Raises: CameraFailedToStart if video stream fails to open.

property fps¶

The FPS of the video stream.

Raises: RuntimeError if FPS cannot be queried
Return type: float

read()¶

Read the most recent frame from the camera.

This function blocks on waiting for a new frame.

Return type: ndarray
Returns: numpy array – The frame that was read from the camera
Raises: RuntimeError if camera connection has not been initiated.
Raises: CameraConnectionLost if camera has disconnected.

read_non_blocking()¶

Read the most recent frame from the camera.

This function will return None if no new frames are available

Return type: Optional[ndarray]
Returns: The frame that was read from the camera, or None
Raises: RuntimeError if camera connection has not been initiated.
Raises: CameraConnectionLost if camera has disconnected.

stop()¶: Stop and clean up the camera connection.

class WebcamVideoStream(cam=0)¶

Capture video frames from a webcam or CSI camera attached to your device.

WebcamVideoStream can be instantiated as a context manager:

with edgeiq.WebcamVideoStream() as video_stream:
    ...

To use WebcamVideoStream directly, use the start() and stop() functions:

video_stream = edgeiq.WebcamVideoStream().start()
...
video_stream.stop()

Typical usage:

with edgeiq.WebcamVideoStream() as video_stream:
    while True:
        frame = video_stream.read()

Parameters: cam (int) – The integer identifier of the camera.

property fps¶

The FPS of the video stream.

Raises: RuntimeError if FPS cannot be queried
Return type: float

read()¶

Read the most recent frame from the camera.

This function blocks on waiting for a new frame.

Return type: ndarray
Returns: numpy array – The frame that was read from the camera
Raises: RuntimeError if camera connection has not been initiated.
Raises: CameraConnectionLost if camera has disconnected.

read_non_blocking()¶

Read the most recent frame from the camera.

This function will return None if no new frames are available

Return type: Optional[ndarray]
Returns: The frame that was read from the camera, or None
Raises: RuntimeError if camera connection has not been initiated.
Raises: CameraConnectionLost if camera has disconnected.

start()¶

Start reading frames from the video stream.

Returns: self
Raises: CameraFailedToStart if video stream fails to open.

stop()¶: Stop and clean up the camera connection.

class GStreamerVideoStream(cam=0, display_width=640, display_height=480, framerate=30)¶

Capture video frames using the GStreamer plugin.

This can be useful for capturing videos from CSI cameras when V4L is not supported.

GStreamerVideoStream can be instantiated as a context manager:

with edgeiq.GStreamerVideoStream() as video_stream:
    ...

To use GStreamerVideoStream directly, use the start() and stop() functions:

video_stream = edgeiq.GStreamerVideoStream().start()
...
video_stream.stop()

Typical usage:

with edgeiq.GStreamerVideoStream() as video_stream:
    while True:
        frame = video_stream.read()

Parameters

cam (int) – The integer identifier of the camera.
display_width (int) – The output image width in pixels.
display_height (int) – The output image height in pixels.
framerate (int) – The recording frame rate.

property fps¶

The FPS of the video stream.

Raises: RuntimeError if FPS cannot be queried
Return type: float

read()¶

Read the most recent frame from the camera.

This function blocks on waiting for a new frame.

Return type: ndarray
Returns: numpy array – The frame that was read from the camera
Raises: RuntimeError if camera connection has not been initiated.
Raises: CameraConnectionLost if camera has disconnected.

read_non_blocking()¶

Read the most recent frame from the camera.

This function will return None if no new frames are available

Return type: Optional[ndarray]
Returns: The frame that was read from the camera, or None
Raises: RuntimeError if camera connection has not been initiated.
Raises: CameraConnectionLost if camera has disconnected.

start()¶

Start reading frames from the video stream.

Returns: self
Raises: CameraFailedToStart if video stream fails to open.

stop()¶: Stop and clean up the camera connection.

class GStreamerCustomVideoStream(cmd)¶

Capture video frames using a custom GStreamer pipeline.

GStreamerCustomVideoStream can be instantiated as a context manager:

with edgeiq.GStreamerCustomVideoStream(cmd) as video_stream:
    ...

To use GStreamerCustomVideoStream directly, use the start() and stop() functions:

video_stream = edgeiq.GStreamerCustomVideoStream(cmd).start()
...
video_stream.stop()

Typical usage:

# Receive an H264-encoded RTP stream
cmd = ' ! '.join([
        'udpsrc port=5001',
        'application/x-rtp,encoding-name=H264,payload=96',
        'rtph264depay',
        'h264parse',
        'queue',
        'avdec_h264',
        'videoconvert',
        'appsink'
        ])
with edgeiq.GStreamerCustomVideoStream(cmd) as video_stream:
    while True:
        frame = video_stream.read()

Parameters: cmd (str) – The custom GStreamer pipeline

property fps¶

The FPS of the video stream.

Raises: RuntimeError if FPS cannot be queried
Return type: float

read()¶

Read the most recent frame from the camera.

This function blocks on waiting for a new frame.

Return type: ndarray
Returns: numpy array – The frame that was read from the camera
Raises: RuntimeError if camera connection has not been initiated.
Raises: CameraConnectionLost if camera has disconnected.

read_non_blocking()¶

Read the most recent frame from the camera.

This function will return None if no new frames are available

Return type: Optional[ndarray]
Returns: The frame that was read from the camera, or None
Raises: RuntimeError if camera connection has not been initiated.
Raises: CameraConnectionLost if camera has disconnected.

start()¶

Start reading frames from the video stream.

Returns: self
Raises: CameraFailedToStart if video stream fails to open.

stop()¶: Stop and clean up the camera connection.

class TestVideoStream(fps=30, display_width=640, display_height=480)¶

Creates a test video source with a static colorblock feed. A use case for this class is to validate the operation of the end-to-end app when the live feed is not available. Uses a specific instance of GStreamerCustomVideoStream.

TestVideoStream can be instantiated as a context manager:

with edgeiq.TestVideoStream() as video_stream:
    ...

To use TestVideoStream directly, use the start() and stop() functions:

video_stream = edgeiq.TestVideoStream().start()
...
video_stream.stop()

Typical usage:

with edgeiq.TestVideoStream() as video_stream:
    while True:
        frame = video_stream.read()

Parameters

fps (int) – The video frames per second of the generated video stream.
display_width (int) – The width of the app’s video frame in pixels.
display_height (int) – The height of the app’s video frame in pixels.

property fps¶

The FPS of the video stream.

Raises: RuntimeError if FPS cannot be queried
Return type: float

read()¶

Read the most recent frame from the camera.

This function blocks on waiting for a new frame.

Return type: ndarray
Returns: numpy array – The frame that was read from the camera
Raises: RuntimeError if camera connection has not been initiated.
Raises: CameraConnectionLost if camera has disconnected.

read_non_blocking()¶

Read the most recent frame from the camera.

This function will return None if no new frames are available

Return type: Optional[ndarray]
Returns: The frame that was read from the camera, or None
Raises: RuntimeError if camera connection has not been initiated.
Raises: CameraConnectionLost if camera has disconnected.

start()¶

Start reading frames from the video stream.

Returns: self
Raises: CameraFailedToStart if video stream fails to open.

stop()¶: Stop and clean up the camera connection.

class FrameRotation(value)¶

Amount of rotation applied to each frame in degrees

ROTATE_NONE = 0¶

ROTATE_90 = 90¶

ROTATE_180 = 180¶

class JetsonCameraMode(value)¶

Sensor Mode applied to CSI camera which determines input width and height and framerate. The first Number identifies the Sony Sensor Number (IMX219 or IMX477). The second numbers are the input width and height. The third number is the framerate and fourth number is the camera sensor mode.

IMX219_3264x2468_21_0 = 0¶

IMX219_3264x1848_28_1 = 1¶

IMX219_1920x1080_30_2 = 2¶

IMX219_1640x1232_30_3 = 3¶

IMX477_4032x3040_30_0 = 4¶

IMX477_1920x1080_60_1 = 5¶

IMX477_2560x1440_40_3 = 7¶

class JetsonVideoStream(cam=0, rotation=<FrameRotation.ROTATE_NONE: 0>, camera_mode=<JetsonCameraMode.IMX219_1920x1080_30_2: 2>, display_width=640, display_height=480)¶

Capture video frames from a CSI ribbon camera on NVIDIA Jetson.

JetsonVideoStream can be instantiated as a context manager:

with edgeiq.JetsonVideoStream() as video_stream:
    ...

To use JetsonVideoStream directly, use the start() and stop() functions:

video_stream = edgeiq.JetsonVideoStream().start()
...
video_stream.stop()

Typical usage:

with edgeiq.JetsonVideoStream() as video_stream:
    while True:
        frame = video_stream.read()

Parameters

cam (int) – The integer identifier of the camera.
rotation (FrameRotation) – The rotation applied to each frame
camera_mode (JetsonCameraMode) – The sensor mode for csi camera
display_width (int) – The output image width in pixels.
display_height (int) – The output image height in pixels.

Raises

ValueError if invalid values for rotation or camera mode are provided.

property fps¶

The FPS of the video stream.

Raises: RuntimeError if FPS cannot be queried
Return type: float

read()¶

Read the most recent frame from the camera.

This function blocks on waiting for a new frame.

Return type: ndarray
Returns: numpy array – The frame that was read from the camera
Raises: RuntimeError if camera connection has not been initiated.
Raises: CameraConnectionLost if camera has disconnected.

read_non_blocking()¶

Read the most recent frame from the camera.

This function will return None if no new frames are available

Return type: Optional[ndarray]
Returns: The frame that was read from the camera, or None
Raises: RuntimeError if camera connection has not been initiated.
Raises: CameraConnectionLost if camera has disconnected.

start()¶

Start reading frames from the video stream.

Returns: self
Raises: CameraFailedToStart if video stream fails to open.

stop()¶: Stop and clean up the camera connection.

class IPVideoStream(url)¶

Capture video frames from an IP stream.

IPVideoStream can be instantiated as a context manager:

with edgeiq.IPVideoStream('tcp://0.0.0.0:3333') as video_stream:
    ...

To use IPVideoStream directly, use the start() and stop() functions:

video_stream = edgeiq.IPVideoStream('tcp://0.0.0.0:3333').start()
...
video_stream.stop()

Typical usage:

with edgeiq.IPVideoStream('tcp://0.0.0.0:3333') as video_stream:
    while True:
        frame = video_stream.read()

Parameters: url (str) – The URL of the IP stream

property fps¶

The FPS of the video stream.

Raises: RuntimeError if FPS cannot be queried
Return type: float

read()¶

Read the most recent frame from the camera.

This function blocks on waiting for a new frame.

Return type: ndarray
Returns: numpy array – The frame that was read from the camera
Raises: RuntimeError if camera connection has not been initiated.
Raises: CameraConnectionLost if camera has disconnected.

read_non_blocking()¶

Read the most recent frame from the camera.

This function will return None if no new frames are available

Return type: Optional[ndarray]
Returns: The frame that was read from the camera, or None
Raises: RuntimeError if camera connection has not been initiated.
Raises: CameraConnectionLost if camera has disconnected.

start()¶

Start reading frames from the video stream.

Returns: self
Raises: CameraFailedToStart if video stream fails to open.

stop()¶: Stop and clean up the camera connection.

exception NoMoreFrames¶

Error when trying to read more frames but no frames remaining to read.

args¶

with_traceback()¶: Exception.with_traceback(tb) – set self.__traceback__ to tb and return self.

class FileVideoStream(path, queue_size=128, play_realtime=False, fps=None)¶

Stream a video file for analysis.

FileVideoStream can be instantiated as a context manager:

with edgeiq.FileVideoStream('/path/to/video.mp4') as video_stream:
    ...

To use FileVideoStream directly, use the start() and stop() functions:

video_stream = edgeiq.FileVideoStream('/path/to/video.mp4').start()
...
video_stream.stop()

Typical usage:

with edgeiq.FileVideoStream('/path/to/video.mp4') as video_stream:
    while video_stream.more():
        frame = video_stream.read()

Parameters

path (str) – The path of the video file location.
queue_size (int) – The size of the buffer queue.
play_realtime (bool) – If True play video in simulated realtime, where frames are dropped as they become outdated.
fps (Optional[int]) – The framerate to override the video file’s frame rate

property fps¶

The FPS of the loaded video file or override FPS

Return type: Optional[int]

start()¶

Start reading frames from the video file.

When called a second time, will stop and restart.

Returns: self
Raises: RuntimeError when file doesn’t exist or video stream can’t be opened.

read()¶

Read the next frame from the file.

This function blocks on waiting for frames to become available.

Return type: ndarray
Returns: numpy array – The next frame
Raises: NoMoreFrames if no frames left to read.
Raises: RuntimeError if called before start().

more()¶

Check if there are more frames in the video file.

When play_realtime is True, this value won’t be accurate. It is recommended to catch NoMoreFrames on read() instead.

Return type: bool
Returns: True if there are more frames to read in the video file.
Raises: RuntimeError if called before start().

stop()¶: Stop the FileVideoStream.