Loading…
Friday, June 24 • 9:00am - 9:25am
SplitJoin: A Scalable, Low-latency Stream Join Architecture with Adjustable Ordering Precision

Sign up or log in to save this to your schedule and see who's attending!

There is a rising interest in accelerating stream processing through modern parallel hardware, yet it remains a challenge as how to exploit the available resources to achieve higher throughput without sacrificing latency due to the increased length of processing pipeline and communication path and the need for central coordination. To achieve these objectives, we introduce a novel top-down data flow model for stream join processing (arguably, one of the most resource-intensive operators in streamprocessing), called SplitJoin, that operates by splitting the join operation into independent storing and processing steps that gracefully scale with respect to the number of cores. Furthermore, SplitJoin eliminates the need for global coordination while preserving the order of input streams by re-thinking how streams are channeled into distributed join computation cores and maintaining the order of output streams by proposing a novel distributed punctuation technique. Throughout our experimental analysis, SplitJoin offered up to 60%improvement in throughputwhile reducing latency by up to 3.3X compared to state-of-the-art solutions.

Friday June 24, 2016 9:00am - 9:25am
Denver Marriott City Center 1701 California Street, Denver, CO 80202

Attendees (1)