ess.reduce.streaming#

This module provides tools for running workflows in a streaming fashion.

Functions

maybe_hist(value)

Convert value to a histogram if it is not already a histogram.

Classes

Accumulator([preprocess])

Abstract base class for accumulators.

EternalAccumulator(**kwargs)

Simple accumulator that adds pushed values immediately.

MaxAccumulator(**kwargs)

Keeps the maximum value seen so far.

MinAccumulator(**kwargs)

Keeps the minimum value seen so far.

RollingAccumulator([window])

Accumulator that adds pushed values to a rolling window.

StreamProcessor(base_workflow, *, dynamic_keys)

Wrap a base workflow for streaming processing of chunks.