LCLMs compress LLM context before decode — 8.8x faster at 16x compression, beating every KV cache method tested. Open-sourced by NYU and Columbia.
OpenAI says ChatGPT's memory is getting better. But my tests show outdated assumptions, personal profiling, and wrong details ...
Some results have been hidden because they may be inaccessible to you
Show inaccessible results