qwp4w3hyb
/

Mistral-Nemo-Instruct-2407-iMat-GGUF

Text Generation

Model card Files Files and versions Community

qwp4w3hyb commited on Jul 20

Commit

2db829e

•

1 Parent(s): eae6272

Update README.md

Files changed (1) hide show

README.md +1 -3

README.md CHANGED Viewed

@@ -13,10 +13,8 @@ base_model: mistralai/Mistral-Nemo-Instruct-2407
 # Quant Infos
-## Updated for all recent llama.cpp fixes (final logit soft capping+sliding window+tokenizer)
-- needs [#8604](https://github.com/ggerganov/llama.cpp/pull/8604) & latest master with tekken tokenizer fixes applied
 - quants done with an importance matrix for improved quantization loss
 - Requantized ggufs & imatrix from hf bf16
 - Wide coverage of different gguf quant types from Q\_8\_0 down to IQ1\_S

 # Quant Infos
+- needs [#8604](https://github.com/ggerganov/llama.cpp/pull/8604) & latest master with tekken tokenizer fixes applied
 - quants done with an importance matrix for improved quantization loss
 - Requantized ggufs & imatrix from hf bf16
 - Wide coverage of different gguf quant types from Q\_8\_0 down to IQ1\_S