Agenda:

Opening Words

By Tamir Dresher, System Architect, Payoneer & President of IASA Israeli Chapter

Session - The 3 "S" of Kafka streams architecture for large scale streaming (1M EPS)

Abstract: Coralogix ingests tens of billions of messages per day. Every one of these records needs to go through our entire pipeline at near real-time rates. Validation, parsing, classification, and ingestion. How do we process all of this data, so quickly?

We had to rethink our entire approach to message processing from the ground up. Leveraging Kafka streaming framework to keep our streams CPU bound and decoupled from external side effects to build a highly scalable and robust data pipeline

Speaker: Yoni Farin, CTO & Co-founder, Coralogix

Architecture Gym

At this event, we're going to try something new - Architectural Gym!

We are all experts and have mastered our daily work, the technology, and the knowledge area we work in. We want to give you the opportunity to exercise your architectural brain muscle while having fun and the opportunity to learn.

After the first session, we will break into groups that will try to come up with an architecture for a requirement presented by the Coralogix team. Each group will have a few minutes to present their solution and receive feedback from the team on how they solved it in practice.