-
-
-
-
-
-
Inference status
Active filters:
int8
neuralmagic/Meta-Llama-3.1-8B-Instruct-quantized.w8a8
Text Generation
•
Updated
•
4.26k
•
9
neuralmagic/Meta-Llama-3.1-70B-Instruct-quantized.w8a8
Text Generation
•
Updated
•
8.38k
•
6
FriendliAI/Meta-Llama-3.1-8B-Instruct-int8
Text Generation
•
Updated
•
9
•
1
Intel/distilbert-base-uncased-finetuned-sst-2-english-int8-static-inc
Text Classification
•
Updated
•
1.21k
•
5
Intel/bert-base-uncased-mrpc-int8-qat-inc
Text Classification
•
Updated
•
33
•
1
Intel/albert-base-v2-sst2-int8-static-inc
Text Classification
•
Updated
•
15
Intel/bert-base-uncased-finetuned-swag-int8-static-inc
Multiple Choice
•
Updated
•
20
•
1
Intel/bert-base-uncased-mrpc-int8-static-inc
Text Classification
•
Updated
•
20
Intel/distilbert-base-uncased-finetuned-conll03-english-int8-static-inc
Token Classification
•
Updated
•
28
•
1
Intel/camembert-base-mrpc-int8-dynamic-inc
Text Classification
•
Updated
•
15
Intel/bert-base-uncased-mrpc-int8-dynamic-inc
Text Classification
•
Updated
•
13
Intel/roberta-base-mrpc-int8-static-inc
Text Classification
•
Updated
•
14
Intel/bart-large-mrpc-int8-dynamic-inc
Text Classification
•
Updated
•
8
Intel/xlnet-base-cased-mrpc-int8-static-inc
Text Classification
•
Updated
•
5
Intel/electra-small-discriminator-mrpc-int8-static-inc
Text Classification
•
Updated
•
8
echarlaix/distilbert-sst2-inc-dynamic-quantization-magnitude-pruning-0.1
Text Classification
•
Updated
•
16
Intel/MiniLM-L12-H384-uncased-mrpc-int8-static-inc
Text Classification
•
Updated
•
8
Intel/MiniLM-L12-H384-uncased-mrpc-int8-qat-inc
Text Classification
•
Updated
•
7
Intel/distilbert-base-cased-distilled-squad-int8-static-inc
Question Answering
•
Updated
•
25
Intel/bert-base-uncased-squad-int8-static-inc
Question Answering
•
Updated
•
19
•
1
echarlaix/t5-small-int8-dynamic
Translation
•
Updated
•
4
•
4
echarlaix/distilbert-base-uncased-finetuned-sst-2-english-int8-dynamic
Text Classification
•
Updated
•
2.07k
•
1
Intel/distilbert-base-uncased-finetuned-sst-2-english-int8-dynamic-inc
Text Classification
•
Updated
•
67
•
1
Intel/distilbert-base-uncased-distilled-squad-int8-static-inc
Question Answering
•
Updated
•
2.08k
•
4
Intel/roberta-base-squad2-int8-static-inc
Intel/roberta-large-mnli-int8-static-inc
Text Classification
•
Updated
•
31
Intel/vit-base-patch16-224-int8-static-inc
Image Classification
•
Updated
•
64
•
1
Intel/t5-small-xsum-int8-dynamic-inc
Text2Text Generation
•
Updated
•
2.42k
•
1
Intel/t5-small-finetuned-cnn-news-int8-dynamic-inc
Text2Text Generation
•
Updated
•
12
AlexKoff88/bert_nm_mnli_sparse_quantized_90
Text Classification
•
Updated
•
9