Huihui Qwen3.8-27B abliterated UD-DW-Q4_K_M GGUF for Docker Model Runner (chat)

Olmo 3.1 32B Think Q4_K_M GGUF for Docker Model Runner (chat)

Qwen-AgentWorld-35B-A3B UD-Q4_K_M GGUF for Docker Model Runner (chat)

Qwen3-Omni-30B-A3B-Instruct Q4_K_M GGUF for Docker Model Runner (vision)

DeepSeek-R1-Distill-Qwen-32B Q4_K_M GGUF for Docker Model Runner (chat)

EuroLLM-22B-Instruct Q4_K_M GGUF for Docker Model Runner (chat)

ai local

KAT-Coder-V2.5-Dev Q4_K_M GGUF for Docker Model Runner (chat)

Hermes 4.3 36B Q4_K_M GGUF for Docker Model Runner (chat)

DeepSeek-OCR Q8_0 GGUF for Docker Model Runner (OCR)

Mistral-Small-3.2-24B-Instruct Q4_K_M GGUF for Docker Model Runner (vision)

Mellum2-12B-A2.5B-Instruct Q8_0 GGUF for Docker Model Runner (chat)

Qwen2.5-Coder-32B-Instruct Q4_K_M GGUF for Docker Model Runner (chat)

Q4_K_M GGUF of a MedGemma health-chat fine-tune for local, private clinical AI prototyping.

Qwen2.5-72B-Instruct Q4_K_M GGUF for Docker Model Runner (chat)

North Mini Code 1.0 UD-Q4_K_M GGUF for Docker Model Runner (chat)