Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

686

Base only

Active filters: ggml

mudler/parakeet-cpp-gguf

Automatic Speech Recognition • 0.6B • Updated about 21 hours ago • 5.49k • 28

unsloth/LTX-2.3-GGUF

Image-to-Video • 21B • Updated Apr 20 • 351k • 448

unsloth/FLUX.2-klein-9B-GGUF

Image-to-Image • 9B • Updated Jan 16 • 105k • 231

unsloth/Z-Image-Turbo-GGUF

Text-to-Image • 6B • Updated Jan 8 • 58k • 201

unsloth/FLUX.2-dev-GGUF

Image-to-Image • 32B • Updated Dec 10, 2025 • 16k • 66

unsloth/FLUX.2-klein-4B-GGUF

Image-to-Image • 4B • Updated Jan 16 • 163k • 154

LocalAI-io/LocalVQE

Audio-to-Audio • 1.29M • Updated 9 days ago • 2.41k • 39

Serveurperso/OmniVoice-GGUF

Text-to-Speech • 0.6B • Updated Apr 30 • 15.4k • 24

mudler/rfdetr-cpp-nano

Object Detection • 29.5M • Updated 11 days ago • 731 • 9

unsloth/Z-Image-GGUF

Text-to-Image • 6B • Updated Jan 28 • 17.3k • 172

unsloth/ERNIE-Image-Turbo-GGUF

Text-to-Image • 8B • Updated Apr 14 • 24.7k • 217

Serveurperso/Qwen3-TTS-GGUF

Text-to-Speech • 0.9B • Updated 27 days ago • 4.75k • 5

prithivMLmods/chandra-OCR-GGUF

Image-Text-to-Text • 8B • Updated Nov 14, 2025 • 611 • 13

unsloth/FLUX.2-klein-base-4B-GGUF

Image-to-Image • 4B • Updated Jan 15 • 2.44k • 23

cstr/parakeet-tdt-0.6b-v3-GGUF

Automatic Speech Recognition • 0.6B • Updated Apr 27 • 2.66k • 6

cstr/canary-1b-v2-GGUF

Automatic Speech Recognition • 1.0B • Updated Apr 8 • 986 • 1

cstr/qwen3-asr-1.7b-GGUF

Automatic Speech Recognition • 2B • Updated Apr 11 • 4.12k • 10

unsloth/ERNIE-Image-GGUF

Text-to-Image • 8B • Updated Apr 14 • 5.56k • 69

doggy8088/ggml-breeze-asr-26

Automatic Speech Recognition • Updated Apr 19 • 14

cstr/parakeet-tdt-0.6b-ja-GGUF

Automatic Speech Recognition • 0.6B • Updated Apr 28 • 709 • 1

mudler/vibevoice.cpp-models

Updated Apr 28 • 24.9k • 10

cstr/glotlid-GGUF

Text Classification • 0.4B • Updated 28 days ago • 225 • 1

mudler/rfdetr-cpp-seg-small

Image Segmentation • 33.5M • Updated 11 days ago • 287 • 1

cstr/clip-vit-large-patch14-GGUF

Image Feature Extraction • 0.3B • Updated 1 day ago • 99 • 1

CreativeHub008/OmniVoice-GGUF

Text-to-Speech • 0.6B • Updated about 20 hours ago • 1

unsloth/FLUX.2-klein-base-9B-GGUF

Image-to-Image • 9B • Updated Jan 15 • 11.4k • 34

malteos/bloom-6b4-clp-german

Text Generation • 6B • Updated Apr 6, 2024 • 1.25k • 37

nouamanetazi/bloomz-560m-ggml

Updated Mar 15, 2023 • 4

maximeseth/alpaca-native-7B-ggml

Updated Mar 26, 2023 • 6 • 1

bertin-project/bertin-gpt-j-6B-alpaca

Text Generation • 6B • Updated Nov 10, 2024 • 920 • 7