ess.reduce.streaming#

This module provides tools for running workflows in a streaming fashion.

Functions

maybe_hist(value)

Convert value to a histogram if it is not already a histogram.

Classes

Accumulator([preprocess])

Abstract base class for accumulators.

EternalAccumulator(**kwargs)

Simple accumulator that adds pushed values immediately.

RollingAccumulator([window])

Accumulator that adds pushed values to a rolling window.

StreamProcessor(base_workflow, *, ...)

Wrap a base workflow for streaming processing of chunks.