DeepSeek-V4-Flash UD-IQ3_XXS GGUF for Docker Model Runner (chat)
156
DeepSeek's 284B mixture-of-experts model (13B active), in Unsloth's dynamic 3-bit quantization.
docker model pull baransels/deepseek-v4-flash:UD-IQ3_XXS
docker model run baransels/deepseek-v4-flash:UD-IQ3_XXS "Summarise the trade-offs between monoliths and microservices."
| Original model | GGUF | Licence |
|---|---|---|
| deepseek-ai/DeepSeek-V4-Flash-0731โ | unsloth/DeepSeek-V4-Flash-0731-GGUFโ | MIT |
Not an official artifact. Packaged by Baransel Sagindaโ .
Content type
Model
Digest
sha256:006166ff4โฆ
Size
97.1 GB
Last updated
3 days ago
docker model pull baransels/deepseek-v4-flash:UD-IQ3_XXS