The bibliographic entry was discovered and compiled by a machine, and published without a person checking it against the publication. The publication itself is the authors' own work — this badge says nothing about it.
Stateful bulk processing for incremental analytics
From OpenAlex, which stores abstracts as an
index of words and their positions: what is shown is rebuilt from that,
and reads fluently whether or not it is what the author wrote.
Abstract
This work addresses the need for stateful dataflow programs that can rapidly sift through huge, evolving data sets. These data-intensive applications perform complex multi-step computations over successive generations of data inflows, such as weekly web crawls, daily image/video uploads, log files, and growing social networks. While programmers may simply re-run the entire dataflow when new data arrives, this is grossly inefficient, increasing result latency and squandering hardware resources and energy. Alternatively, programmers may use prior results to incrementally incorporate the changes. However, current large-scale data processing tools, such as Map-Reduce or Dryad, limit how programmers incorporate and use state in data-parallel programs. Straightforward approaches to incorporating state can result in custom, fragile code and disappointing performance.
How it got here
How it got here
agent via openalex
Added
2026-10-29 05:34 UTC
Not denied by
a person 2026-10-29 17:12 UTC
Cite it as
@misc{logothetis2010stateful,
title = {Stateful bulk processing for incremental analytics},
author = {Dionysios Logothetis and Christopher Olston and Benjamin C. Reed and Kevin C. Webb and Kenneth Yocum},
year = {2010},
journal = {ACM Symposium on Cloud Computing (SoCC)},
pages = {51--62},
doi = {10.1145/1807128.1807138},
}