AnythingLLM is transitioning its underlying infrastructure from Ollama to include support for the Lemonade embedded SDK and llama.cpp. This shift provides developers with different options for local model execution and embedding integration.
HOW THIS AFFECTS YOU
●
builderYou have more flexible options for local model serving and embedding integration within the AnythingLLM ecosystem.