Apache Kafka® and Stream Processing at Pinterest

82ff0ce0 4701 4a3c 95d6 dc87a7d8c08d

Speakers: Liquan Pei, Software Engineer, Ads Infrastructure Team, Pinterest; Boyang Chen, Software Engineer, Ads Infrastructure Team, Pinterest & Shawn Nguyen, Platform Engineer, Pinterest

Apache Kafka® is widely used at Pinterest to power the recommendation systems for both organic and promoted content to its 200+ million monthly active users.

With the recent adoption of the Confluent Go client and Kafka Streams, Pinterest has experienced significantly improved system stability and performance of its Kafka clients and real-time processing framework, as well as improved scalability and lower maintenance costs.

In this talk, members of the Pinterest team:
-Share details of their results
-Offer lessons learned from their Confluent Go client migration
-Discuss their use cases for adopting Kafka Streams