We're delighted to welcome three exceptional speakers to discuss all things Kafka. Huge thanks to Microsoft Reactor for the use of their event space, and to Confluent and Star Tree for supporting this event!
Please note that Reactor is now in Paddington, having moved from their Shoreditch location last year. The details given here are correct.
Agenda:
1745 - 1800 Arrivals
1800 LJC welcome
1805 Microsoft Reactor welcome
1810 Danica Fine presentation
1900 Pizza break/networking
1930 Tim Berglund presentation
2005 Bill Bejeck presentation
2040 Close and departures
Speaker:
Danica Fine, Staff Developer Advocate, Confluent
Title:
Brick-by-Brick: Exploring the Elements of Apache Kafka®
Synopsis:
Do you wish that learning Apache Kafka were as easy, intuitive, and fun as building your favorite LEGO® set? Why shouldn’t it be!?
Let’s rebuild the world of Kafka brick-by-brick starting from the basic building blocks of the technology. We’ll leave no plate unturned as we introduce events, brokers, topics, and partitions––fundamental elements that affect how data is stored inside of this powerful distributed event streaming platform. From there, explore the wider inventory of pieces in the ecosystem––APIs and tools like Kafka Streams and Kafka Connect––that you can use to migrate, stream, and transform your data.
By the end of the session, you’ll know the ins and outs of the components that form the basis of Kafka, how they ‘click’ together, and what you can build with them. At that point, only one question should remain––what will YOU make with Kafka?
Speaker bio:
Danica Fine is a Staff Developer Advocate at Confluent where she helps others get the most out of their event-driven pipelines. Prior to this role, she served as a software engineer on a streaming infrastructure team at Bloomberg where she predominantly worked on Kafka Streams- and Kafka Connect-based projects. Her expertise in streaming systems has taken her to a number of conferences and speaking engagements over the years, giving her the chance to express her love of Kafka to anyone who will listen. Danica is committed to increasing diversity in the technical community and actively serves as a mentor to a number of women in tech. She can be found on Twitter, tweeting about tech, plants, and baking @TheDanicaFine.
Speaker:
Tim Berglund, Vice President of Developer Relations, StarTree
Topic:
Making Kafka Queryable with Apache Pinot
Synopsis:
Apache Kafka has become the standard infrastructure for event-driven and streaming data systems. The stunningly simple abstraction of the distributed log provides exactly what modern microservices and real-time systems need, but no choice is without its tradeoffs. Logs are an excellent way to keep track of events, but they are notoriously difficult to query. Given a constellation of services exchanging events with each other and reacting to inputs in real time, how can you find out—and gain insight into—what has just happened? How, in other words, do you query a log? This is where Apache Pinot comes in.
Developed at LinkedIn alongside Kafka, Pinot is a distributed, real-time analytics database designed to ingest data from Kafka (and other sources) and make it instantly queryable at low latency in the face of a huge number of concurrent requests. All that data tucked neatly away into topics, maintaining an immutable record of how the state of the system has evolved, can now be ingested into Pinot and made accessible through simple SQL queries.
This talk explores Pinot’s internal architecture, how its integration with Kafka is specially optimized, and how Pinot fits architecturally in the modern streaming stack. You’ll leave understanding how Pinot works, how it fits together with Kafka, where it has been used successfully in the real world, and what steps to take next in your own Pinot learning journey.
Speaker bio:
Tim is a teacher, author, and technology leader with StarTree, where he serves as the Vice President of Developer Relations. He is a regular speaker at conferences and a presence on YouTube explaining complex technology topics in an accessible way. He tweets as @tlberglund, blogs every few years at http://timberglund.com, and lives in Littleton, CO, USA. He has three grown children and two grandchildren, a fact about which he is rather excited.
Speaker:
Bill Bejeck, Staff Developer Experience Engineer, Confluent
Title:
Windowing in Kafka Streams and Flink SQL
Synopsis:
Shakespeare once said that the "Eyes are the window to your soul". Had Shakespeare been a developer today, he may have changed that to "Windows are the eyes into your data."
Stream processing has become the de facto standard of working with data, with Kafka Streams and Flink being the top choices to implement an event streaming application. Responding quickly to any event is only possible when you can access those events as they happen. But in many cases, you're not concerned with one single event. Instead, it's a series of events within a given period that commands attention. In other words, it's essential to analyze events within discrete windows of time. Yet, with the different options available and the time semantics around them, windowing can be tricky to get right.
In this talk, I will cover the following topics for windowing in Kafka Streams and Flink SQL:
Different window types (hopping, tumbling, sliding, etc.) and use-case application
The semantics of time advancement, window closing, and the emitting of results
Analyzing windowed results
Testing strategies
Developers attending this presentation will gain an understanding of what windowing is in stream processing, the different types available to them, and some guidelines on when to apply which window type.
Speaker bio:
Bill has been a software engineer for over 18 years. Currently, he is working at Confluent as a Staff DevX Engineer. Previously, Bill was an engineer on the Kafka Streams team for three-plus years. Before Confluent, he worked on various ingest applications as a U.S. Government contractor using distributed software such as Apache Kafka, Spark, and Hadoop. Bill has also written a book about Kafka Streams titled "Kafka Streams in Action" and is working on a 2nd edition (https://www.manning.com/books/kafka-streams-in-action-second-edition), available Spring 2024.
This event is organised by RecWorks on behalf of the London Java Community.
The London Java Community is sponsored by Hazelcast, JFrog, Redis, Vonage and Discover