Update README.md
Browse files
README.md
CHANGED
|
@@ -1,3 +1,91 @@
|
|
| 1 |
---
|
| 2 |
license: creativeml-openrail-m
|
|
|
|
|
|
|
|
|
|
|
|
|
| 3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
license: creativeml-openrail-m
|
| 3 |
+
tags:
|
| 4 |
+
- coreml
|
| 5 |
+
- stable-diffusion
|
| 6 |
+
- text-to-image
|
| 7 |
---
|
| 8 |
+
# Core ML Converted Model:
|
| 9 |
+
|
| 10 |
+
- This model was converted to [Core ML for use on Apple Silicon devices](https://github.com/apple/ml-stable-diffusion). Conversion instructions can be found [here](https://github.com/godly-devotion/MochiDiffusion/wiki/How-to-convert-ckpt-or-safetensors-files-to-Core-ML).<br>
|
| 11 |
+
- Provide the model to an app such as Mochi Diffusion [Github](https://github.com/godly-devotion/MochiDiffusion) - [Discord](https://discord.gg/x2kartzxGv) to generate images.<br>
|
| 12 |
+
- `split_einsum` version is compatible with all compute unit options including Neural Engine.<br>
|
| 13 |
+
- `original` version is only compatible with CPU & GPU option.<br>
|
| 14 |
+
|
| 15 |
+
# Note: Some models do not have the [unet split into chunks](https://github.com/apple/ml-stable-diffusion#-converting-models-to-core-ml).
|
| 16 |
+
|
| 17 |
+
# Vintedois (22h) Diffusion:
|
| 18 |
+
Source(s): [Hugging Face](https://huggingface.co/22h/vintedois-diffusion-v0-1) - [CivitAI](https://civitai.com/models/2781/vintedois-diffusion-v0-1)
|
| 19 |
+
|
| 20 |
+
### Vintedois (22h) Diffusion model trained by [Predogl](https://twitter.com/Predogl) and [piEsposito](https://twitter.com/piesposi_to) with open weights, configs and prompts (as it should be)
|
| 21 |
+
|
| 22 |
+
This model was trained on a large amount of high quality images with simple prompts to generate beautiful images without a lot of prompt engineering.
|
| 23 |
+
|
| 24 |
+
You can enforce style by prepending your prompt with `estilovintedois` if it is not good enough.
|
| 25 |
+
|
| 26 |
+
It should also be very dreamboothable, being able to generate high fidelity faces with a little amount of steps.
|
| 27 |
+
|
| 28 |
+
**You can use this model commercially or whatever, but we are not liable if you do messed up stuff with it.**
|
| 29 |
+
|
| 30 |
+
### Gradio
|
| 31 |
+
|
| 32 |
+
We support a [Gradio](https://github.com/gradio-app/gradio) Web UI to run vintedois-diffusion-v0-1 :
|
| 33 |
+
[](https://huggingface.co/spaces/22h/vintedois-diffusion-v0-1)
|
| 34 |
+
|
| 35 |
+
|
| 36 |
+
### Model card
|
| 37 |
+
|
| 38 |
+
Everything from [Stable Diffusion v1-5](https://huggingface.co/runwayml/stable-diffusion-v1-5), plus the fact that this is being built by two indie devs, so it was not extensively tested for new biases.
|
| 39 |
+
|
| 40 |
+
You can run this concept via `diffusers` [Colab Notebook for Inference](https://colab.research.google.com/github/huggingface/notebooks/blob/main/diffusers/sd_dreambooth_inference.ipynb)
|
| 41 |
+
|
| 42 |
+
### Sample results
|
| 43 |
+
|
| 44 |
+
<img src="https://huggingface.co/22h/vintedois-diffusion-v0-1/resolve/main/joined.png" width=1024/>
|
| 45 |
+
|
| 46 |
+
### Example prompts
|
| 47 |
+
|
| 48 |
+
- Prompt: photo of an old man in a jungle, looking at the camera
|
| 49 |
+
- CFG Scale: 7.5
|
| 50 |
+
- Scheduler: `diffusers.EulerAncestralDiscreteScheduler`
|
| 51 |
+
- Steps: 30
|
| 52 |
+
- Seed: 44
|
| 53 |
+
<img src="https://huggingface.co/22h/vintedois-diffusion-v0-1/resolve/main/44-euler-a-photo%20of%20an%20old%20man%20in%20a%20jungle%2C%20looking%20at%C2%A0the%C2%A0camera.png" width=512/>
|
| 54 |
+
|
| 55 |
+
- Prompt: kneeling cat knight, portrait, finely detailed armor, intricate design, silver, silk, cinematic lighting, 4k
|
| 56 |
+
- CFG Scale: 7.5
|
| 57 |
+
- Scheduler: `diffusers.EulerAncestralDiscreteScheduler`
|
| 58 |
+
- Steps: 50
|
| 59 |
+
- Seed: 44
|
| 60 |
+
<img src="https://huggingface.co/22h/vintedois-diffusion-v0-1/resolve/main/44-euler-a-kneeling%20cat%20knight%2C%20portrait%2C%20finely%20detailed%20armor%2C%20intricate%20design%2C%20silver%2C%20silk%2C%20cinematic%20lighting%2C%204k.png" width=512/>
|
| 61 |
+
|
| 62 |
+
|
| 63 |
+
- Prompt: a beautiful girl In front of the cabin, the country, by Artgerm Lau and Krenz Cushart,hyperdetailed, trending on artstation, trending on deviantart
|
| 64 |
+
- CFG Scale: 7.5
|
| 65 |
+
- Scheduler: `diffusers.EulerAncestralDiscreteScheduler`
|
| 66 |
+
- Steps: 50
|
| 67 |
+
- Seed: 44
|
| 68 |
+
<img src="https://huggingface.co/22h/vintedois-diffusion-v0-1/resolve/main/44-euler-a-a%20beautiful%20girl%20In%20front%20of%20the%20cabin%2C%20the%20country%2C%20by%20Artgerm%20Lau%20and%20Krenz%20Cushart%EF%BC%8Chyperdetailed%2C%20trending%20on%20artstation%2C%20tre.png" width=512/>
|
| 69 |
+
|
| 70 |
+
- Prompt: destroyed city
|
| 71 |
+
- CFG Scale: 7.5
|
| 72 |
+
- Scheduler: `diffusers.EulerAncestralDiscreteScheduler`
|
| 73 |
+
- Steps: 50
|
| 74 |
+
- Seed: 44
|
| 75 |
+
<img src="https://huggingface.co/22h/vintedois-diffusion-v0-1/resolve/main/44-euler-a-destroyed%20city.png" width=512/>
|
| 76 |
+
|
| 77 |
+
- Prompt: victorian city landscape
|
| 78 |
+
- CFG Scale: 7.5
|
| 79 |
+
- Scheduler: `diffusers.EulerAncestralDiscreteScheduler`
|
| 80 |
+
- Steps: 50
|
| 81 |
+
- Seed: 44
|
| 82 |
+
<img src="https://huggingface.co/22h/vintedois-diffusion-v0-1/resolve/main/44-euler-a-victorian%20city%20landscape.png" width=512/>
|
| 83 |
+
|
| 84 |
+
- Prompt: prehistoric native living room
|
| 85 |
+
- CFG Scale: 7.5
|
| 86 |
+
- Scheduler: `diffusers.EulerAncestralDiscreteScheduler`
|
| 87 |
+
- Steps: 50
|
| 88 |
+
- Seed: 44
|
| 89 |
+
<img src="https://huggingface.co/22h/vintedois-diffusion-v0-1/resolve/main/44-euler-a-prehistoric%20native%20living%20room.png" width=512/>
|
| 90 |
+
|
| 91 |
+
Thanks for the Google Developer Expert program for providing us with a GCP credits grant.
|