Artificial Intelligence
Netflix's LLM Serving Platform
Netflix details its in-house LLM serving platform with Triton and vLLM for improved AI performance and efficiency in content recommendation.
Netflix Technology
1 story
1 story
Netflix details its in-house LLM serving platform with Triton and vLLM for improved AI performance and efficiency in content recommendation.