Direct temporal-reduction series

Overview

temporal-reduce-series exposes one temporal resolution directly as a queryable series instead of creating a directory.

Example configuration

in_pattern: series:///sensors/*  # Required: example source pattern.
time_column: timestamp          # Required: source event-time column.
group_by: []                    # Default: no additional grouping columns.
resolution: 1h                  # Required: example aggregation window.
aggregations:                   # Required: one or more aggregation operations.
  - type: avg                   # Required: example operation.
    columns: null               # Default: all eligible numeric columns.
transforms: null                # Default: no input transforms.
output_aliases: null            # Default: names such as temperature.avg.
allowed_lateness: 1d            # Effective default: one-day hot window.
seal_target_bytes: 1048576       # Effective default: 1 MiB before sealing.
max_live_segments: 50           # Effective default: compaction backstop.

Set columns: [temperature] for a selected-column rollup. Null or omitted cache settings resolve to the explicit defaults above.

Use and behavior

Install with pond mknod temporal-reduce-series /derived/hourly --config-path reduce.yaml, then inspect and query /derived/hourly.

resolution must be a positive duration. The same cache, lateness, sealing, schema, and backfill semantics as temporal reduction apply.

group_by also works here. For example, group_by: [site_id, page_uri], resolution: 1d, aggregations: [{type: count, columns: ["*"]}], and output_aliases: {timestamp.count: views} expose daily per-site/page counts through the same shared reduction cache.

Full configuration

Settings

FieldAccepted typeRequiredDefaultDescription
aggregationsarray of Aggregationyesnot specified
allowed_latenessstring | nullnonot specified
group_byarray of stringnonot specifiedExact source columns retained as grouping keys alongside the time bucket.
in_patternWatertown Urlyesnot specified
max_live_segmentsinteger | nullnonot specifiedConstraints: format="uint"; minimum=0.
output_aliasesobject | nullnonot specified
resolutionstringyesnot specified
seal_target_bytesinteger | nullnonot specifiedConstraints: format="uint64"; minimum=0.
time_columnstringyesnot specified
transformsarray | nullnonot specified

Aggregation

Configuration for a single aggregation operation

FieldAccepted typeRequiredDefaultDescription
columnsarray | nullnonullColumns to apply the aggregation to If not specified, applies to all numeric columns Use ["*"] for count operations
typeAggregation Typeyesnot specifiedType of aggregation (avg, min, max, count, sum)

Aggregation Type

Aggregation types supported by the temporal reduce factory

Accepted value: "avg" | "min" | "max" | "count" | "sum".

Watertown Url

Accepted value: string.