File size: 1,623 Bytes
29ea446 37dce0c 6889e39 2d13f3d 37b48b5 37dce0c 37b48b5 2d13f3d 37b48b5 8a8870f 37b48b5 8a8870f 37b48b5 8a8870f ca4af5f 8a8870f |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 |
---
license: mit
---
# This repo contains the pretrained checkpoints for Ctrl-Adapter
CTRL-Adapter is an efficient and versatile framework for adding diverse
spatial controls to any image or video diffusion model. It supports a variety of useful
applications, including video control, video control with multiple conditions, video control with
sparse frame conditions, image control, zero-shot transfer to unseen conditions, and video editing.
See also: https://github.com/HL-hanlin/Ctrl-Adapter
<br>
<img width="800" src="assets/teaser.gif"/>
<br>
# Description of Model Checkpoints
## SDXL
Depth map
- Ctrl-Adapter/sdxl_depth/diffusion_pytorch_model.safetensors
Canny edge
- Ctrl-Adapter/sdxl_canny/diffusion_pytorch_model.safetensors
## I2VGen-XL
Depth map
- Ctrl-Adapter/i2vgenxl_depth/diffusion_pytorch_model.safetensors
Canny edge
- Ctrl-Adapter/i2vgenxl_canny/diffusion_pytorch_model.safetensors
Soft edge
- Ctrl-Adapter/i2vgenxl_softedge/diffusion_pytorch_model.safetensors
Sparse control with user scribbles
- Ctrl-Adapter/i2vgenxl_scribble_sparse/diffusion_pytorch_model.safetensors
Multi-condition control trained on depth map, canny edge, normal map, soft edge, segmentation, line art, and openpose
- Ctrl-Adapter/i2vgenxl_multi_control_adapter/diffusion_pytorch_model.safetensors
- Ctrl-Adapter/i2vgenxl_multi_control_router/diffusion_pytorch_model.safetensors
## SVD
Depth map
- Ctrl-Adapter/svd_depth/diffusion_pytorch_model.safetensors
Canny edge
- Ctrl-Adapter/svd_canny/diffusion_pytorch_model.safetensors
Soft edge
- Ctrl-Adapter/svd_softedge/diffusion_pytorch_model.safetensors
|