baransels

KAT-Coder-V2.5-Dev Q4_K_M GGUF for Docker Model Runner (chat)

ERNIE-4.5-21B-A3B-Thinking Q4_K_M GGUF for Docker Model Runner (chat)

Mellum2-12B-A2.5B-Instruct Q8_0 GGUF for Docker Model Runner (chat)

GLM-4.6V-Flash Q4_K_M GGUF for Docker Model Runner (vision)

Phi-4-reasoning-plus Q4_K_M GGUF for Docker Model Runner (chat)

LFM2.5-8B-A1B Q4_K_M GGUF for Docker Model Runner (chat)

Qwen3-Omni-30B-A3B-Instruct Q4_K_M GGUF for Docker Model Runner (vision)

Mistral-Small-3.2-24B-Instruct Q4_K_M GGUF for Docker Model Runner (vision)

DeepSeek-R1-Distill-Qwen-14B Q4_K_M GGUF for Docker Model Runner (chat)

DeepSeek-R1-0528-Qwen3-8B Q4_K_M GGUF for Docker Model Runner (chat)

DeepSeek-OCR-2 Q8_0 GGUF for Docker Model Runner (OCR)

Unlimited-OCR Q8_0 GGUF for Docker Model Runner (OCR)

multilingual-e5-large F16 GGUF for Docker Model Runner (embeddings)

BGE-large-en v1.5 F16 GGUF for Docker Model Runner (embeddings)

BGE-small-en v1.5 Q8_0 GGUF for Docker Model Runner (embeddings)

Huihui Qwen3.8-27B abliterated UD-DW-Q4_K_M GGUF for Docker Model Runner (chat)

Olmo 3.1 32B Think Q4_K_M GGUF for Docker Model Runner (chat)

EuroLLM-22B-Instruct Q4_K_M GGUF for Docker Model Runner (chat)

Hermes 4.3 36B Q4_K_M GGUF for Docker Model Runner (chat)

North Mini Code 1.0 UD-Q4_K_M GGUF for Docker Model Runner (chat)

MiMo-V2.6-Distill-Qwen-9B Q4_K_M GGUF for Docker Model Runner (chat)

Nemotron 3.5 Content Safety Q4_K_M GGUF for Docker Model Runner (safety classifier)

Qwen3Guard-Gen-8B Q4_K_M GGUF for Docker Model Runner (safety classifier)

Shieldstral 1.0 3B Q4_K_M GGUF for Docker Model Runner (safety classifier)

DeepSeek-R1-Distill-Qwen-32B Q4_K_M GGUF for Docker Model Runner (chat)

Qwen2.5-Coder-32B-Instruct Q4_K_M GGUF for Docker Model Runner (chat)

Hy-MT2-7B Q4_K_M GGUF for Docker Model Runner (translation)

DeepSeek-OCR Q8_0 GGUF for Docker Model Runner (OCR)

MiniCPM-V 4.6 Q4_K_M GGUF for Docker Model Runner (vision)