Mozilla-Ocho/llamafile: Distribute and run LLMs with a single file.

Our goal is to make open source large language models much more accessible to both developers and end users. We’re doing that by combining llama.cpp with Cosmopolitan Libc into one framework that collapses all the complexity of LLMs down to a single-file executable (called a “llamafile”) that runs locally on most computers, with no installation.

Source: GitHub - Mozilla-Ocho/llamafile: Distribute and run LLMs with a single file.