ads
Home AI News Together AI Open-Sources OSCAR: An Attention-Aware 2-Bit KV Cache Quantization System for...

Together AI Open-Sources OSCAR: An Attention-Aware 2-Bit KV Cache Quantization System for Long-Context LLM Serving

0
131
Together AI Open-Sources OSCAR: An Attention-Aware 2-Bit KV Cache Quantization System for Long-Context LLM Serving