Hugging Face's logo

LoneStriker
/
ExLlamaV2-Measurements

Model card Files Community
LoneStriker commited on
Commit
b077059
•
2 Parent(s): 721f69a 7bfe186

Merge branch 'main' of hf.co:LoneStriker/ExLlamaV2-Measurements

Browse files
Files changed (9) hide show
  1. README.md +7 -0
  2. measurement-Mistral-7B-codealpaca-lora.json +0 -0
  3. measurement-Mistral_7B_Dolphin2.1_LIMA0.5_fp16.json +0 -0
  4. measurement-OpenHermes-2.5-Mistral-7B.json +0 -0
  5. measurement-Skywork-13B-Airo-Claude-Pippa-Puffin.json +0 -0
  6. measurement-Thespis-Mistral-7b-v0.5.json +0 -0
  7. measurement-Yarn-Mistral-7b-128k.json +0 -0
  8. measurement-Yarn-Mistral-7b-64k.json +0 -0
  9. measurement-openchat_3.5.json +0 -0
README.md ADDED
@@ -0,0 +1,7 @@
 
 
 
 
 
 
 
 
1
+ # ExLlamaV2 Measurements
2
+
3
+ Measurement files used to quantize models uploaded here. Depending on the model type one of the following datasets is used for calibration:
4
+ * General chat or instruct model: ThePile [0007.parquet](https://huggingface.co/datasets/EleutherAI/the_pile_deduplicated/resolve/refs%2Fconvert%2Fparquet/default/train/0007.parquet)
5
+ * Coding model: [WizardLM_evol_instruct_V2_196k](https://huggingface.co/datasets/WizardLM/WizardLM_evol_instruct_V2_196k)
6
+ * RP model: pippa.parquet (from users of TheBloke Discord)
7
+ * Japanese model: filtered text from file [Japanese Wiki file jawikibooks-20231023-cirrussearch](https://dumps.wikimedia.org/other/cirrussearch/20231023/jawikibooks-20231023-cirrussearch-content.json.gz)
measurement-Mistral-7B-codealpaca-lora.json ADDED
The diff for this file is too large to render. See raw diff
 
measurement-Mistral_7B_Dolphin2.1_LIMA0.5_fp16.json ADDED
The diff for this file is too large to render. See raw diff
 
measurement-OpenHermes-2.5-Mistral-7B.json ADDED
The diff for this file is too large to render. See raw diff
 
measurement-Skywork-13B-Airo-Claude-Pippa-Puffin.json ADDED
The diff for this file is too large to render. See raw diff
 
measurement-Thespis-Mistral-7b-v0.5.json ADDED
The diff for this file is too large to render. See raw diff
 
measurement-Yarn-Mistral-7b-128k.json ADDED
The diff for this file is too large to render. See raw diff
 
measurement-Yarn-Mistral-7b-64k.json ADDED
The diff for this file is too large to render. See raw diff
 
measurement-openchat_3.5.json ADDED
The diff for this file is too large to render. See raw diff