1# Kronk
2
3> [!IMPORTANT]
4> The Kronk provider for Fantasy is considered experimental!
5> The API and behavior can change until we consider it stable.
6
7[Kronk][kronk] is a Go package by [ArdanLabs][ardanlabs] that uses [yzma][yzma]
8under the hood to provide hardware accelerated local inference with
9[llama.cpp][llama.cpp] directly integrated into your applications.
10Kronk provides a high-level API that feels similar to using an OpenAI compatible
11API.
12
13When using the Kronk provider in Fantasy, you only need to specify the model you
14want to use and it'll be automatically downloaded in your machine and used for
15inference.
16
17To see which models are available for you, see the [Kronk Catalog][catalog].
18
19Examples on how to use it are available in [`examples/kronk`][examples].
20
21[kronk]: https://github.com/ardanlabs/kronk
22[ardanlabs]: https://github.com/ardanlabs
23[yzma]: https://github.com/hybridgroup/yzma
24[llama.cpp]: https://github.com/ggml-org/llama.cpp
25[catalog]: https://github.com/ardanlabs/kronk_catalogs
26[examples]: https://github.com/charmbracelet/fantasy/tree/main/examples/kronk