General Asynchronous LLM Framework for Concurrent Tasks

A new asynchronous framework allows LLM agents to handle non-sequential inputs, such as voice or video streams, by defining inference coroutines with overlapping memory states. This enables agents to process new information while actively performing tasks or thinking.