LatentPress: Context Compression Beyond Text and Vision
This paper introduces LatentPress, a method to compress conversational histories and documents into a continuous memory token format that allows language models to directly read and process the context without text reconstruction. Practitioners might care about this because it could lead to faster and more efficient language model inference.