Edit Models filters

Inference status

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

14,846

Full-text search

Active filters: 4-bit

Qwen/Qwen2.5-32B-Instruct-AWQ

Text Generation • Updated 6 days ago • 1.02k • 17

Qwen/Qwen2-VL-72B-Instruct-AWQ

Image-Text-to-Text • Updated 1 day ago • 1.12k • 13

Qwen/Qwen2.5-72B-Instruct-AWQ

Text Generation • Updated 6 days ago • 1.04k • 12

Qwen/Qwen2.5-72B-Instruct-GPTQ-Int4

Text Generation • Updated 6 days ago • 1.21k • 11

Qwen/Qwen2.5-14B-Instruct-AWQ

Text Generation • Updated 6 days ago • 9.16k • 6

MaziyarPanahi/solar-pro-preview-instruct-GGUF

Text Generation • Updated 12 days ago • 7.85k • 15

flowaicom/Flow-Judge-v0.1-AWQ

Text Generation • Updated 7 days ago • 387 • 5

ModelCloud/GRIN-MoE-gptq-4bit

Updated 6 days ago • 10 • 5

unsloth/Meta-Llama-3.1-8B-bnb-4bit

Text Generation • Updated 22 days ago • 298k • 67

openbmb/MiniCPM-V-2_6-int4

Image-Text-to-Text • Updated about 5 hours ago • 12.8k • 55

Qwen/Qwen2.5-32B-Instruct-GPTQ-Int4

Text Generation • Updated 6 days ago • 585 • 4

Qwen/Qwen2.5-7B-Instruct-AWQ

Text Generation • Updated 6 days ago • 758 • 4

CohereForAI/c4ai-command-r-plus-4bit

Text Generation • Updated Aug 13 • 622 • 240

Qwen/Qwen2-VL-7B-Instruct-AWQ

Image-Text-to-Text • Updated about 4 hours ago • 10.8k • 23

Qwen/Qwen2.5-14B-Instruct-GPTQ-Int4

Text Generation • Updated 6 days ago • 387 • 3

unsloth/Qwen2.5-32B-Instruct-bnb-4bit

Text Generation • Updated 2 days ago • 416 • 3

TheBloke/Wizard-Vicuna-13B-Uncensored-GPTQ

Text Generation • Updated Sep 27, 2023 • 7.79k • 315

TheBloke/Wizard-Vicuna-30B-Uncensored-GPTQ

Text Generation • Updated Sep 27, 2023 • 490 • 558

TheBloke/llama2_70b_chat_uncensored-AWQ

Text Generation • Updated Nov 9, 2023 • 16 • 6

unsloth/mistral-7b-instruct-v0.2-bnb-4bit

Text Generation • Updated 14 days ago • 12k • 31

Tann-dev/sex-chat-dirty-girlfriend

Text Generation • Updated Feb 17 • 526 • 18

MaziyarPanahi/BioMistral-7B-GGUF

Text Generation • Updated Feb 19 • 850 • 43

openbmb/MiniCPM-Llama3-V-2_5-int4

Visual Question Answering • Updated Jul 22 • 18.6k • 70

hugging-quants/Meta-Llama-3.1-8B-Instruct-AWQ-INT4

Text Generation • Updated Aug 7 • 340k • 54

unsloth/Meta-Llama-3.1-70B-Instruct-bnb-4bit

Text Generation • Updated 22 days ago • 14k • 18

neuralmagic/Meta-Llama-3.1-70B-Instruct-quantized.w4a16

Text Generation • Updated Aug 13 • 118k • 19

pzc163/MiniCPMv2_6-prompt-generator

Updated Aug 24 • 1.65k • 31

unsloth/Meta-Llama-3.1-405B-Instruct-bnb-4bit

Text Generation • Updated 14 days ago • 4.62k • 2

Qwen/Qwen2-VL-72B-Instruct-GPTQ-Int4

Image-Text-to-Text • Updated 1 day ago • 860 • 2

Qwen/Qwen2.5-7B-Instruct-GPTQ-Int4

Text Generation • Updated 6 days ago • 1.68k • 2