-
Tracing Large Models in Recommendation Systems 
Liao Jiayi #AI#Recommendation systems#LLM New wine bottles for familiar ideas: how can LLM techniques systematically reshape recommendation systems?
-
Key Implementation Details of vLLM’s KV Cache Liao Jiayi #vLLM#KVCache#LLM KV caching is essential to vLLM inference. Growing contexts drive frequent architectural changes, including prefill/decode separation and new cache storage options.