Apache Kafka® and Stream Processing at Pinterest
Speakers: Liquan Pei, Software Engineer, Ads Infrastructure Team, Pinterest; Boyang Chen, Software Engineer, Ads Infrastructure Team, Pinterest & Shawn Nguyen, Platform Engineer, Pinterest
Apache Kafka® is widely used at Pinterest to power the recommendation systems for both organic and promoted content to its 200+ million monthly active users.
With the recent adoption of the Confluent Go client and Kafka Streams, Pinterest has experienced significantly improved system stability and performance of its Kafka clients and real-time processing framework, as well as improved scalability and lower maintenance costs.
In this talk, members of the Pinterest team:
-Share details of their results
-Offer lessons learned from their Confluent Go client migration
-Discuss their use cases for adopting Kafka Streams
Apache Kafka® is widely used at Pinterest to power the recommendation systems for both organic and promoted content to its 200+ million monthly active users.
With the recent adoption of the Confluent Go client and Kafka Streams, Pinterest has experienced significantly improved system stability and performance of its Kafka clients and real-time processing framework, as well as improved scalability and lower maintenance costs.
In this talk, members of the Pinterest team:
-Share details of their results
-Offer lessons learned from their Confluent Go client migration
-Discuss their use cases for adopting Kafka Streams