Three-Layer Caching Architecture for Low-Latency LLM Web Search

OreoLook implements a three-layer caching stack designed for commodity CPU hardware to optimize web search agents. It uses Redis for session context with Huffman-compressed disk overflow and a semantic query layer to prevent redundant embedding and inference costs.