The confluence of ubiquitous, high-performance networking and increased availability of online information has led to the emergence of a new class of large-scale stream processing and dissemination applications. These applications often exhibit diverse logic and performance requirements, yet they all require common facilities, which include construction of an overlay network, routing and processing logic, and membership management. In contrast to existing approaches that provide custom, point solutions to point applications, we introduce a general-purpose infrastructure that provides these core functionalities and can be easily extended for a broad spectrum of target applications.

Extensibility is the central design consideration for our infrastructure, which can be customized to support diverse processing logic, stream types, and performance targets through a set of methods that encapsulate application-specific behavior and a cost model for defining the desired QoS and resource-utilization metrics and constraints. Given these specifications, the system automatically creates and optimizes a data stream acquisition, processing and dissemination overlay network. Its optimization is driven by metric-independent operations, which can refine the structure of the overlay network as well as efficiently distribute processing across the network.

A high-level overview of XPORT can be found in our SenS'06 paper. XPORT's extensible optimization framework and initial performance results from the XPORT prototype running on PlanetLab are given in our SIGMOD'06 paper. The two applications we implemented using XPORT, a multiplayer networked game and an RSS feed distribution application, are described in our SIGMOD'06 demo paper. This project subsumes the SemCast project.

XFlow: Internet-Scale Distributed Stream Processing.
O. Papaemmanouil, U. Cetintemel, J. Jannotti.
Brown University, CS Department, Technical Report CS-07-06.

Extensible Optimization in Overlay Dissemination Trees. [pdf]
O. Papaemmanouil, Y. Ahmad, U. Cetintemel, J. Jannotti, Y. Yildirim.
In Proceeding of the 25th ACM International Conference of Special Interest Group on Management of Data (SIGMOD '06), June 2006.

XPORT: Extensible Profile-driven Overlay Routing Trees. [pdf]
O. Papaemmanouil, Y. Ahmad, U. Cetintemel, J. Jannotti, Y. Yildirim.
In Proceeding of the 25th ACM International Conference of Special Interest Group on Management of Data (SIGMOD '06), June 2006

Application-aware Overlay Networks for Data Dissemination. [pdf]
O. Papaemmanouil, Y. Ahmad, U. Cetintemel, J. Jannotti.
In the Proceeding of the International Workshop on Semantics enabled Networks and Services (SeNS '06) (In conjuction with ICDE'06), Atlanta, April 2006.

Extensible Profile-driven Data Dissemination. [pdf]
O. Papaemmanouil, Y. Ahmad, U. Cetintemel, J. Jannotti, Y. Yildirim.
Brown University, CS Department, Technical Report CS-06-05. (A shorter version appeared in SIGMOD'06).

SemCast: Semantic Multicast for Content-based Data Dissemination. [pdf]
O. Papaemmanouil, U. Cetintemel.
In Proceeding of the 21st International Conference on Data Engineering (ICDE '05), April 2005. (67/521=12.8% accepted)

Semantic Multicast for Content-Based Stream Dissemination. [pdf]
O. Papaemmanouil, U. Cetintemel.
In Proceeding of the 7th International Workshop on the Web and Databases (WebDB '04) (In conjuction with SIGMOD'04) , June 2004 (16/61=26.2% accepted)

Current Members:  Olga Papaemmanouil, Ugur Cetintemel, John Jannotti,Yanif Ahmad

Past Members: Yenel Yildirim