naoto0804 commited on
Commit
3f57594
1 Parent(s): 67aaf20

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +69 -54
README.md CHANGED
@@ -6,7 +6,7 @@ library_name: diffusers
6
 
7
  <!-- Provide a quick summary of what the model is/does. -->
8
 
9
-
10
 
11
  ## Model Details
12
 
@@ -16,56 +16,61 @@ library_name: diffusers
16
 
17
  This is the model card of a 🧨 diffusers model that has been pushed on the Hub. This model card has been automatically generated.
18
 
19
- - **Developed by:** [More Information Needed]
 
 
 
 
20
  - **Funded by [optional]:** [More Information Needed]
21
  - **Shared by [optional]:** [More Information Needed]
22
  - **Model type:** [More Information Needed]
23
- - **Language(s) (NLP):** [More Information Needed]
24
- - **License:** [More Information Needed]
25
- - **Finetuned from model [optional]:** [More Information Needed]
26
 
27
  ### Model Sources [optional]
28
 
29
  <!-- Provide the basic links for the model. -->
30
 
31
- - **Repository:** [More Information Needed]
32
- - **Paper [optional]:** [More Information Needed]
33
- - **Demo [optional]:** [More Information Needed]
34
 
35
  ## Uses
36
 
 
 
37
  <!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
38
 
39
- ### Direct Use
40
 
41
  <!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
42
 
43
- [More Information Needed]
44
 
45
- ### Downstream Use [optional]
46
 
47
  <!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
48
 
49
- [More Information Needed]
50
 
51
- ### Out-of-Scope Use
52
 
53
  <!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
54
 
55
- [More Information Needed]
56
 
57
- ## Bias, Risks, and Limitations
58
 
59
  <!-- This section is meant to convey both technical and sociotechnical limitations. -->
60
 
61
- [More Information Needed]
62
 
63
- ### Recommendations
64
 
65
  <!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
66
 
67
- Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
68
 
 
69
  ## How to Get Started with the Model
70
 
71
  Use the code below to get started with the model.
@@ -75,72 +80,73 @@ Use the code below to get started with the model.
75
  ## Training Details
76
 
77
  ### Training Data
 
78
 
79
  <!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
80
 
81
- [More Information Needed]
82
 
83
  ### Training Procedure
84
 
85
  <!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
86
 
87
- #### Preprocessing [optional]
88
 
89
  [More Information Needed]
90
 
91
 
92
- #### Training Hyperparameters
93
-
94
- - **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
95
 
96
- #### Speeds, Sizes, Times [optional]
97
 
98
  <!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
99
 
100
- [More Information Needed]
101
 
102
- ## Evaluation
103
 
104
  <!-- This section describes the evaluation protocols and provides the results. -->
105
 
106
- ### Testing Data, Factors & Metrics
107
 
108
- #### Testing Data
109
 
110
  <!-- This should link to a Dataset Card if possible. -->
111
 
112
- [More Information Needed]
113
 
114
- #### Factors
115
 
116
  <!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
117
 
118
- [More Information Needed]
119
 
120
- #### Metrics
121
 
122
  <!-- These are the evaluation metrics being used, ideally with a description of why. -->
123
 
124
- [More Information Needed]
125
 
126
- ### Results
127
 
128
- [More Information Needed]
129
 
130
- #### Summary
131
 
132
 
133
 
134
- ## Model Examination [optional]
135
 
136
  <!-- Relevant interpretability work for the model goes here -->
137
 
138
- [More Information Needed]
139
 
140
- ## Environmental Impact
141
 
142
  <!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
143
 
 
144
  Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
145
 
146
  - **Hardware Type:** [More Information Needed]
@@ -148,13 +154,13 @@ Carbon emissions can be estimated using the [Machine Learning Impact calculator]
148
  - **Cloud Provider:** [More Information Needed]
149
  - **Compute Region:** [More Information Needed]
150
  - **Carbon Emitted:** [More Information Needed]
 
151
 
152
- ## Technical Specifications [optional]
 
153
 
154
  ### Model Architecture and Objective
155
 
156
- [More Information Needed]
157
-
158
  ### Compute Infrastructure
159
 
160
  [More Information Needed]
@@ -167,32 +173,41 @@ Carbon emissions can be estimated using the [Machine Learning Impact calculator]
167
 
168
  [More Information Needed]
169
 
170
- ## Citation [optional]
 
 
171
 
172
  <!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
173
 
174
- **BibTeX:**
175
 
176
- [More Information Needed]
 
 
 
 
 
 
 
177
 
178
- **APA:**
179
 
180
- [More Information Needed]
181
 
182
- ## Glossary [optional]
183
 
184
  <!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
185
 
186
- [More Information Needed]
187
 
188
- ## More Information [optional]
189
 
190
- [More Information Needed]
191
 
192
- ## Model Card Authors [optional]
193
 
194
- [More Information Needed]
195
 
196
  ## Model Card Contact
197
 
198
- [More Information Needed]
 
6
 
7
  <!-- Provide a quick summary of what the model is/does. -->
8
 
9
+ This model is a fine-tuned SDXL1.0 model. UNet of the model is fine-tuned on the [OpenCOLE1.0 dataset](naoto0804/opencole) to generate images that looks like graphic design but without texts.
10
 
11
  ## Model Details
12
 
 
16
 
17
  This is the model card of a 🧨 diffusers model that has been pushed on the Hub. This model card has been automatically generated.
18
 
19
+ - **Language(s) (NLP):** English
20
+ - **License:** Apache-2.0
21
+ - **Finetuned from model:** [SDXL1.0](https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0).
22
+
23
+ <!--
24
  - **Funded by [optional]:** [More Information Needed]
25
  - **Shared by [optional]:** [More Information Needed]
26
  - **Model type:** [More Information Needed]
27
+ -->
 
 
28
 
29
  ### Model Sources [optional]
30
 
31
  <!-- Provide the basic links for the model. -->
32
 
33
+ - **Repository:** [CyberAgentAILab/OpenCOLE](https://github.com/CyberAgentAILab/OpenCOLE)
34
+ - **Paper:** [OpenCOLE: Towards Reproducible Automatic Graphic Design Generation]()
35
+ <!-- - **Demo [optional]:** [More Information Needed] -->
36
 
37
  ## Uses
38
 
39
+ Please refer to [OpenCOLE](https://github.com/CyberAgentAILab/OpenCOLE).
40
+
41
  <!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
42
 
43
+ <!--### Direct Use -->
44
 
45
  <!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
46
 
47
+ <!--[More Information Needed] -->
48
 
49
+ <!-- ### Downstream Use [optional] -->
50
 
51
  <!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
52
 
53
+ <!-- [More Information Needed] -->
54
 
55
+ <!--### Out-of-Scope Use -->
56
 
57
  <!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
58
 
59
+ <!--[More Information Needed] -->
60
 
61
+ <!-- ## Bias, Risks, and Limitations -->
62
 
63
  <!-- This section is meant to convey both technical and sociotechnical limitations. -->
64
 
65
+ <!-- [More Information Needed] -->
66
 
67
+ <!-- ### Recommendations -->
68
 
69
  <!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
70
 
71
+ <!-- Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations. -->
72
 
73
+ <!--
74
  ## How to Get Started with the Model
75
 
76
  Use the code below to get started with the model.
 
80
  ## Training Details
81
 
82
  ### Training Data
83
+ -->
84
 
85
  <!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
86
 
87
+ <!-- [More Information Needed]
88
 
89
  ### Training Procedure
90
 
91
  <!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
92
 
93
+ <!-- #### Preprocessing [optional]
94
 
95
  [More Information Needed]
96
 
97
 
98
+ <!-- #### Training Hyperparameters -->
99
+ <!-- - **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
 
100
 
101
+ <!-- #### Speeds, Sizes, Times [optional] -->
102
 
103
  <!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
104
 
105
+ <!-- [More Information Needed] -->
106
 
107
+ <!-- ## Evaluation -->
108
 
109
  <!-- This section describes the evaluation protocols and provides the results. -->
110
 
111
+ <!-- ### Testing Data, Factors & Metrics -->
112
 
113
+ <!-- #### Testing Data -->
114
 
115
  <!-- This should link to a Dataset Card if possible. -->
116
 
117
+ <!-- [More Information Needed] -->
118
 
119
+ <!-- #### Factors -->
120
 
121
  <!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
122
 
123
+ <!-- [More Information Needed] -->
124
 
125
+ <!-- #### Metrics -->
126
 
127
  <!-- These are the evaluation metrics being used, ideally with a description of why. -->
128
 
129
+ <!-- [More Information Needed] -->
130
 
131
+ <!-- ### Results -->
132
 
133
+ <!-- [More Information Needed] -->
134
 
135
+ <!-- #### Summary -->
136
 
137
 
138
 
139
+ <!-- ## Model Examination [optional] -->
140
 
141
  <!-- Relevant interpretability work for the model goes here -->
142
 
143
+ <!-- [More Information Needed] -->
144
 
145
+ <!-- ## Environmental Impact -->
146
 
147
  <!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
148
 
149
+ <!--
150
  Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
151
 
152
  - **Hardware Type:** [More Information Needed]
 
154
  - **Cloud Provider:** [More Information Needed]
155
  - **Compute Region:** [More Information Needed]
156
  - **Carbon Emitted:** [More Information Needed]
157
+ -->
158
 
159
+ <!--
160
+ ## Technical Specifications
161
 
162
  ### Model Architecture and Objective
163
 
 
 
164
  ### Compute Infrastructure
165
 
166
  [More Information Needed]
 
173
 
174
  [More Information Needed]
175
 
176
+ -->
177
+
178
+ ## Citation
179
 
180
  <!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
181
 
182
+ <!--**BibTeX:** -->
183
 
184
+ ```
185
+ @inproceedings{inoue2024opencole,
186
+ title={{OpenCOLE: Towards Reproducible Automatic Graphic Design Generation}},
187
+ author={Naoto Inoue and Kento Masui and Wataru Shimoda and Kota Yamaguchi},
188
+ booktitle={Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)},
189
+ year={2024},
190
+ }
191
+ ```
192
 
193
+ <!--**APA:** -->
194
 
195
+ <!--[More Information Needed] -->
196
 
197
+ <!--## Glossary [optional] -->
198
 
199
  <!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
200
 
201
+ <!-- [More Information Needed] -->
202
 
203
+ <!-- ## More Information [optional] -->
204
 
205
+ <!-- [More Information Needed] -->
206
 
207
+ <!-- ## Model Card Authors [optional] -->
208
 
209
+ <!-- [More Information Needed] -->
210
 
211
  ## Model Card Contact
212
 
213
+ [Naoto Inoue](https://github.com/naoto0804)