In-House LLM Serving at Netflix
In-House LLM Serving at Netflix By AI Platform’s Model Runtime team and Inference team Introduction Most organizations consume LLMs through hosted APIs. Netflix went further — we run the full …
Netflix TechBlog
@netflix-techblog
Publisher
12
Posts
Posts by Netflix TechBlog
Building Service Topology at Scale: Architecture, Challenges, and Lessons Learned
Netflix built the three-stage distributed pipeline behind its real-time service map, tackling backpressure, hot nodes, and Kafka scaling challenges
GenPage: Towards End-to-End Generative Homepage Construction at Netflix
GenPage: Towards End-to-End Generative Homepage Construction at Netflix Authors: Lequn Wang, Jiangwei Pan, and Linas Baltrunas Introduction The Netflix homepage is the first thing users see when they …
Toward More Controllable AI Video Editing: An Early Research Exploration at Netflix
Toward More Controllable AI Video Editing: An Early Research Exploration at Netflix By Zhuoning Yuan, Ta-Ying Cheng, Benjamin Klein, Bahareh Azarnoush Introduction At Netflix, we build technology to …
How Netflix Simplified Batch Compute with Kueue
How Netflix Simplified Batch Compute with Kueue By Alvin Bao, Alex Petrov, Jennifer Lai, Aidan Sherr, and Samartha Chandrashekar As a part of the journey to transition Netflix’s compute …
The Data Canary: How Netflix Validates Catalog Metadata
The Data Canary: How Netflix Validates Catalog Metadata By Celina Amados At Netflix, our catalog metadata is crucial to our member experience, and a single corrupted data state can impact millions of …
Data Projects: Managing Data Assets at Netflix Scale
Data Projects: Managing Data Assets at Netflix Scale By Amer Hesson, Marcelo Mayworm, James Mulcahy, and Brittany Truong The Problem: Managing Assets at Netflix Scale Netflix’s Data Platform is …
Predicting Risk in Content Launches: How Data-Driven Insights can Transform Launch Planning
Predicting Risk in Content Launches: How Data-Driven Insights can Transform Launch Planning by Emily Gill Each year, we bring the Analytics Engineering community together for an Analytics Summit — …
The Evolution of Cassandra Data Movement at Netflix
The Evolution of Cassandra Data Movement at Netflix By Guil Pires, Jennifer Prince, Jose Camacho, Ken Kurzweil, Phanindra Chunduru Background In a previous post, we introduced Data Bridge, a unified …
Thinking Fast & Slow for a Personalized Notification System
Thinking Fast & Slow for a Personalized Notification System by Matthew Wood, Ishan Gupta, Kevin Mercurio, Devon Bryant, and Claire Dorman In his seminal book “Thinking, Fast and Slow,” Daniel …
A Human-Augmenting Agentic Workflow for Causal Inference
A Human-Augmenting Agentic Workflow for Causal Inference By Winston Chou, Adrien Alexandre, Lars Olds, Yi Zhang, Garrett Hagemann, and Nathan Kallus Introduction Imagine asking a data agent to …
From Silos to Service Topology: Why Netflix Built a Real-Time Service Map
Netflix built a real-time service dependency map using eBPF, IPC metrics, and distributed tracing to understand blast radius and resolve incidents faster.