Hugging Face's logo

tsavage68
/
UTI_M2_1000steps_1e8rate_SFT

Text Generation
Transformers
Safetensors
mistral
trl
sft
Generated from Trainer
conversational
text-generation-inference
Inference Endpoints
Model card Files Community
tsavage68 commited on
Commit
3d5d6a6
•
1 Parent(s): 4eac412

End of training

Browse files
Files changed (12) hide show
  1. README.md +43 -43
  2. config.json +1 -1
  3. final_checkpoint/config.json +1 -1
  4. final_checkpoint/generation_config.json +1 -1
  5. final_checkpoint/model-00001-of-00003.safetensors +1 -1
  6. final_checkpoint/model-00002-of-00003.safetensors +1 -1
  7. final_checkpoint/model-00003-of-00003.safetensors +1 -1
  8. generation_config.json +1 -1
  9. model-00001-of-00003.safetensors +1 -1
  10. model-00002-of-00003.safetensors +1 -1
  11. model-00003-of-00003.safetensors +1 -1
  12. training_args.bin +1 -1
README.md CHANGED
@@ -17,7 +17,7 @@ should probably proofread and complete it, then remove this comment. -->
17
 
18
  This model is a fine-tuned version of [mistralai/Mistral-7B-Instruct-v0.2](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2) on an unknown dataset.
19
  It achieves the following results on the evaluation set:
20
- - Loss: 2.3011
21
 
22
  ## Model description
23
 
@@ -51,51 +51,51 @@ The following hyperparameters were used during training:
51
 
52
  | Training Loss | Epoch | Step | Validation Loss |
53
  |:-------------:|:-------:|:----:|:---------------:|
54
- | 2.3117 | 0.3333 | 25 | 2.3034 |
55
- | 2.3191 | 0.6667 | 50 | 2.3033 |
56
- | 2.2988 | 1.0 | 75 | 2.3031 |
57
- | 2.2814 | 1.3333 | 100 | 2.3034 |
58
- | 2.2647 | 1.6667 | 125 | 2.3032 |
59
- | 2.2066 | 2.0 | 150 | 2.3033 |
60
- | 2.2613 | 2.3333 | 175 | 2.3018 |
61
- | 2.3477 | 2.6667 | 200 | 2.3025 |
62
- | 2.3242 | 3.0 | 225 | 2.3021 |
63
- | 2.2664 | 3.3333 | 250 | 2.3019 |
64
- | 2.276 | 3.6667 | 275 | 2.3018 |
65
- | 2.2806 | 4.0 | 300 | 2.3013 |
66
- | 2.396 | 4.3333 | 325 | 2.3010 |
67
- | 2.2584 | 4.6667 | 350 | 2.3007 |
68
- | 2.338 | 5.0 | 375 | 2.3016 |
69
- | 2.3104 | 5.3333 | 400 | 2.3007 |
70
- | 2.3331 | 5.6667 | 425 | 2.3006 |
71
- | 2.2907 | 6.0 | 450 | 2.3013 |
72
- | 2.3097 | 6.3333 | 475 | 2.3008 |
73
- | 2.2248 | 6.6667 | 500 | 2.3014 |
74
- | 2.3946 | 7.0 | 525 | 2.3006 |
75
- | 2.3879 | 7.3333 | 550 | 2.3010 |
76
- | 2.3363 | 7.6667 | 575 | 2.3010 |
77
- | 2.2718 | 8.0 | 600 | 2.3013 |
78
- | 2.3193 | 8.3333 | 625 | 2.3013 |
79
- | 2.2909 | 8.6667 | 650 | 2.3010 |
80
- | 2.3979 | 9.0 | 675 | 2.3012 |
81
- | 2.3177 | 9.3333 | 700 | 2.3013 |
82
- | 2.3343 | 9.6667 | 725 | 2.3014 |
83
- | 2.3969 | 10.0 | 750 | 2.3015 |
84
- | 2.2702 | 10.3333 | 775 | 2.3012 |
85
- | 2.2423 | 10.6667 | 800 | 2.3011 |
86
- | 2.3562 | 11.0 | 825 | 2.3011 |
87
- | 2.3429 | 11.3333 | 850 | 2.3011 |
88
- | 2.2779 | 11.6667 | 875 | 2.3011 |
89
- | 2.3524 | 12.0 | 900 | 2.3011 |
90
- | 2.3005 | 12.3333 | 925 | 2.3011 |
91
- | 2.2195 | 12.6667 | 950 | 2.3011 |
92
- | 2.3219 | 13.0 | 975 | 2.3011 |
93
- | 2.2917 | 13.3333 | 1000 | 2.3011 |
94
 
95
 
96
  ### Framework versions
97
 
98
- - Transformers 4.41.1
99
  - Pytorch 2.0.0+cu117
100
- - Datasets 2.19.1
101
  - Tokenizers 0.19.1
 
17
 
18
  This model is a fine-tuned version of [mistralai/Mistral-7B-Instruct-v0.2](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2) on an unknown dataset.
19
  It achieves the following results on the evaluation set:
20
+ - Loss: 2.6170
21
 
22
  ## Model description
23
 
 
51
 
52
  | Training Loss | Epoch | Step | Validation Loss |
53
  |:-------------:|:-------:|:----:|:---------------:|
54
+ | 2.6263 | 0.3333 | 25 | 2.6302 |
55
+ | 2.6415 | 0.6667 | 50 | 2.6306 |
56
+ | 2.6336 | 1.0 | 75 | 2.6298 |
57
+ | 2.6804 | 1.3333 | 100 | 2.6284 |
58
+ | 2.5885 | 1.6667 | 125 | 2.6291 |
59
+ | 2.542 | 2.0 | 150 | 2.6286 |
60
+ | 2.6601 | 2.3333 | 175 | 2.6249 |
61
+ | 2.6936 | 2.6667 | 200 | 2.6240 |
62
+ | 2.6593 | 3.0 | 225 | 2.6238 |
63
+ | 2.6088 | 3.3333 | 250 | 2.6237 |
64
+ | 2.542 | 3.6667 | 275 | 2.6208 |
65
+ | 2.5635 | 4.0 | 300 | 2.6185 |
66
+ | 2.6825 | 4.3333 | 325 | 2.6183 |
67
+ | 2.5987 | 4.6667 | 350 | 2.6198 |
68
+ | 2.6421 | 5.0 | 375 | 2.6196 |
69
+ | 2.6426 | 5.3333 | 400 | 2.6183 |
70
+ | 2.6517 | 5.6667 | 425 | 2.6189 |
71
+ | 2.5762 | 6.0 | 450 | 2.6190 |
72
+ | 2.6801 | 6.3333 | 475 | 2.6190 |
73
+ | 2.5918 | 6.6667 | 500 | 2.6169 |
74
+ | 2.6354 | 7.0 | 525 | 2.6163 |
75
+ | 2.6433 | 7.3333 | 550 | 2.6156 |
76
+ | 2.7024 | 7.6667 | 575 | 2.6172 |
77
+ | 2.575 | 8.0 | 600 | 2.6176 |
78
+ | 2.6109 | 8.3333 | 625 | 2.6165 |
79
+ | 2.6088 | 8.6667 | 650 | 2.6195 |
80
+ | 2.698 | 9.0 | 675 | 2.6185 |
81
+ | 2.612 | 9.3333 | 700 | 2.6166 |
82
+ | 2.615 | 9.6667 | 725 | 2.6188 |
83
+ | 2.681 | 10.0 | 750 | 2.6165 |
84
+ | 2.6118 | 10.3333 | 775 | 2.6190 |
85
+ | 2.5875 | 10.6667 | 800 | 2.6168 |
86
+ | 2.6859 | 11.0 | 825 | 2.6170 |
87
+ | 2.5953 | 11.3333 | 850 | 2.6171 |
88
+ | 2.5884 | 11.6667 | 875 | 2.6169 |
89
+ | 2.6721 | 12.0 | 900 | 2.6170 |
90
+ | 2.5951 | 12.3333 | 925 | 2.6170 |
91
+ | 2.6112 | 12.6667 | 950 | 2.6170 |
92
+ | 2.5842 | 13.0 | 975 | 2.6170 |
93
+ | 2.5962 | 13.3333 | 1000 | 2.6170 |
94
 
95
 
96
  ### Framework versions
97
 
98
+ - Transformers 4.41.2
99
  - Pytorch 2.0.0+cu117
100
+ - Datasets 2.19.2
101
  - Tokenizers 0.19.1
config.json CHANGED
@@ -20,7 +20,7 @@
20
  "sliding_window": null,
21
  "tie_word_embeddings": false,
22
  "torch_dtype": "float16",
23
- "transformers_version": "4.41.1",
24
  "use_cache": false,
25
  "vocab_size": 32000
26
  }
 
20
  "sliding_window": null,
21
  "tie_word_embeddings": false,
22
  "torch_dtype": "float16",
23
+ "transformers_version": "4.41.2",
24
  "use_cache": false,
25
  "vocab_size": 32000
26
  }
final_checkpoint/config.json CHANGED
@@ -20,7 +20,7 @@
20
  "sliding_window": null,
21
  "tie_word_embeddings": false,
22
  "torch_dtype": "float16",
23
- "transformers_version": "4.41.1",
24
  "use_cache": false,
25
  "vocab_size": 32000
26
  }
 
20
  "sliding_window": null,
21
  "tie_word_embeddings": false,
22
  "torch_dtype": "float16",
23
+ "transformers_version": "4.41.2",
24
  "use_cache": false,
25
  "vocab_size": 32000
26
  }
final_checkpoint/generation_config.json CHANGED
@@ -2,5 +2,5 @@
2
  "_from_model_config": true,
3
  "bos_token_id": 1,
4
  "eos_token_id": 2,
5
- "transformers_version": "4.41.1"
6
  }
 
2
  "_from_model_config": true,
3
  "bos_token_id": 1,
4
  "eos_token_id": 2,
5
+ "transformers_version": "4.41.2"
6
  }
final_checkpoint/model-00001-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f835f88bfe8c2f05e02c857c615d5368fde346b84d6ae7a4de45ec568120846c
3
  size 4943162240
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:771b3e2a4e4c67595f42aad53b2e668ba2abc14d75e248f479138b9467f2eae2
3
  size 4943162240
final_checkpoint/model-00002-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5558fffd9e38959ddbbae183a6ad127acf9ce790a37b831fc5974085bd321e21
3
  size 4999819232
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:85424ab8a7cfc8d954bd3bc072a8088e3e6d7bc47a383e2f1c665ac8e9149f7d
3
  size 4999819232
final_checkpoint/model-00003-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c37df2f0f60b7ccd24493e3b7fa02c282cf4c3f8f067498a1ab43d0efd30ae21
3
  size 4540516256
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8afd2c68a0ed136727c962b020bf6fba7da1fddb5651b2296f300f9e303522b8
3
  size 4540516256
generation_config.json CHANGED
@@ -2,5 +2,5 @@
2
  "_from_model_config": true,
3
  "bos_token_id": 1,
4
  "eos_token_id": 2,
5
- "transformers_version": "4.41.1"
6
  }
 
2
  "_from_model_config": true,
3
  "bos_token_id": 1,
4
  "eos_token_id": 2,
5
+ "transformers_version": "4.41.2"
6
  }
model-00001-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f835f88bfe8c2f05e02c857c615d5368fde346b84d6ae7a4de45ec568120846c
3
  size 4943162240
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:771b3e2a4e4c67595f42aad53b2e668ba2abc14d75e248f479138b9467f2eae2
3
  size 4943162240
model-00002-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5558fffd9e38959ddbbae183a6ad127acf9ce790a37b831fc5974085bd321e21
3
  size 4999819232
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:85424ab8a7cfc8d954bd3bc072a8088e3e6d7bc47a383e2f1c665ac8e9149f7d
3
  size 4999819232
model-00003-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c37df2f0f60b7ccd24493e3b7fa02c282cf4c3f8f067498a1ab43d0efd30ae21
3
  size 4540516256
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8afd2c68a0ed136727c962b020bf6fba7da1fddb5651b2296f300f9e303522b8
3
  size 4540516256
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:4a3bb73631f45648374bf22e7411c7313a2d0a703dbc9d2f5500b6a2846ddd9c
3
  size 4603
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:36e9d2ad9c1eb887f03ed64284158b5f652abf8655c829e29ab0cae88f14fc14
3
  size 4603