Predictive Speculative KV Replication for Bursty LLM Inference (jwlabs.vercel.app)
21 points by shreybirmiwal 5 hours ago
msp26 an hour ago
the hand drawn diagrams and highlights are charming
shreybirmiwal a minute ago
thank you so much
21 points by shreybirmiwal 5 hours ago
the hand drawn diagrams and highlights are charming
thank you so much