[!WARNING] 🚧 This is a pre-release under heavy, active development. Things are still in flux but we’re excited to share early progress.

Crush

Crush is a tool for building software with AI.

Installation

Nightly builds are available while Crush is in development.

Packages are available in Debian and RPM formats
Binaries are available for Linux and macOS

You can also just install it with go:

git clone git@github.com:charmbracelet/crush.git
cd crush
go install

Note that Crush doesn't support Windows yet, however Windows support is planned and in progress.

Getting Started

For now, the quickest way to get started is to set an environment variable for your preferred provider. Note that you can switch between providers mid- sessions, so you're welcome to set environment variables for multiple providers.

Environment Variable	Provider
`ANTHROPIC_API_KEY`	Anthropic
`OPENAI_API_KEY`	OpenAI
`GEMINI_API_KEY`	Google Gemini
`VERTEXAI_PROJECT`	Google Cloud VertexAI (Gemini)
`VERTEXAI_LOCATION`	Google Cloud VertexAI (Gemini)
`GROQ_API_KEY`	Groq
`AWS_ACCESS_KEY_ID`	AWS Bedrock (Claude)
`AWS_SECRET_ACCESS_KEY`	AWS Bedrock (Claude)
`AWS_REGION`	AWS Bedrock (Claude)
`AZURE_OPENAI_ENDPOINT`	Azure OpenAI models
`AZURE_OPENAI_API_KEY`	Azure OpenAI models (optional when using Entra ID)
`AZURE_OPENAI_API_VERSION`	Azure OpenAI models

Configuration

For many use cases, Crush can be run with no config. That said, if you do need config, it can be added either local to the project itself, or globally. Configuration has the following priority:

.crush.json
crush.json
$HOME/.config/crush/crush.json

LSPs

Crush can use LSPs for additional context to help inform its decisions, just like you would. LSPs can be added manually like so:

{
  "lsp": {
    "go": {
      "command": "gopls"
    },
    "typescript": {
      "command": "typescript-language-server",
      "args": ["--stdio"]
    },
    "nix": {
      "command": "alejandra"
    }
  }
}

OpenAI-Compatible APIs

Crush supports all OpenAI-compatible APIs. Here's an example configuration for Deepseek, which uses an OpenAI-compatible API. Don't forget to set DEEPSEEK_API_KEY in your environment.

{
  "providers": {
    "deepseek": {
      "provider_type": "openai",
      "base_url": "https://api.deepseek.com/v1",
      "models": [
        {
          "id": "deepseek-chat",
          "model": "Deepseek V3",
          "cost_per_1m_in": 0.27,
          "cost_per_1m_out": 1.1,
          "cost_per_1m_in_cached": 0.07,
          "cost_per_1m_out_cached": 1.1,
          "context_window": 64000,
          "default_max_tokens": 5000
        }
      ]
    }
  }
}

Local AI Model Providers

Crush is compatible with local AI model applications that implement OpenAI's API standard. This includes popular tools like Ollama, LM Studio, LocalAI, Jan.ai, and many others. Running models locally gives you complete privacy and control over your AI infrastructure.

Ollama

Ollama is a popular tool for running AI models locally. It packages models with all dependencies, making deployment simple and reliable.

Installation:

# Install Ollama
curl -fsSL https://ollama.com/install.sh | sh

# Download and run a model
ollama run llama3.2:3b

Auto-Discovery: Crush automatically detects Ollama installations and discovers available models without any configuration needed. Simply install Ollama and pull models - they'll appear in the model switcher automatically.

Manual Configuration (Optional): For advanced use cases or custom configurations, you can manually define Ollama providers:

{
  "providers": {
    "ollama": {
      "type": "openai",
      "base_url": "http://localhost:11434/v1",
      "api_key": "ollama",
      "models": [
        {
          "id": "llama3.2:3b",
          "model": "Llama 3.2 3B",
          "context_window": 131072,
          "default_max_tokens": 4096,
          "cost_per_1m_in": 0,
          "cost_per_1m_out": 0
        }
      ]
    }
  }
}

Other Local AI Tools

For other local AI applications (LM Studio, LocalAI, Jan.ai, etc.), you can configure them manually using the OpenAI-compatible API format shown above.

Whatcha think?

We’d love to hear your thoughts on this project. Feel free to drop us a note!

License

MIT

Part of Charm.

Charm热爱开源 • Charm loves open source

README.md