Data streaming platforms provide the tools needed to bring together real-time streams of data. It enables data intelligent, real-time applications and systems, and empowers teams to act on data instantly.

We will host a series of meetup events to showcase some of the cutting edge developments that are happening in data stream processing in the open sourced tools and industry. We will invite the PMCs of Apache Beam, Airflow, Spark, Flink, Kafka, etc.. and teams who use these tools to share practical experiences, best practices in building data stream processing pipelines. The community of real-time technology leaders and developers will come together to share best practices and use cases as well as explore the vision and future of data streaming.

Agenda (EST):

• 6:00pm - 6:30pm: Check-in and Food & Drinks
• 6:30pm - 8:00pm: Tech Talks
• 8:00pm: Networking, Raffle with Prizes and Closing

Tech Talk 1: Lessons from reimplementing a streaming source 3 times.

Abstract: I am the author of Pub/Sub Lite I/O, and have had to implement a streaming source at various points in the maturity of the beam model. I will discuss issues I ran into, how they can be solved, and what my takeaways are for beam development.

Speaker: Daniel Collins, Software Engineer,  Lead Developer on the Pub/Sub Lite project at Google

Tech Talk 2: Scaling with Data Streams with Apache Kafka

A high level overview of how open source technologies such as Apache Kafka were used to build Wix highly scalable platform for millions of developers. Learn more about Wix Engineering open source contributions in the stream processing ecosystem.

Speaker: Thomas Jimenez, Developer Advocate at Wix