---
description: Now that we're past all of that install stuff this next part will seem easy.
---

# Using ControlNet

This guide was made using the version 1.0 ControlNet models, but all the concepts still apply.



Fair warning, ControlNet takes up a lot more VRAM than a regular image generation. You may not be able to get as big of an image as you would get normally.

<figure><img src="https://2463013151-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FrjzSinvVPe17AZtDte0Z%2Fuploads%2ForLBVRUhTMJrBZOp4JrI%2Fthe_line.png?alt=media&#x26;token=1bf137fe-5b91-486d-bb1b-affd4e3d193c" alt=""><figcaption></figcaption></figure>

Start by placing an image into the Starting Image space.\
\
Note, when using Controlnet in the Paint Tab the area inside the bounding box is used instead of the starting image.

<figure><img src="https://2463013151-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FrjzSinvVPe17AZtDte0Z%2Fuploads%2F2CrQo4NK0shmUjM5QNCw%2F014.png?alt=media&#x26;token=6277bc17-9689-491e-9f56-754874df711a" alt=""><figcaption></figcaption></figure>



Open up the ControlNet tab and choose one of the models from the drop-down list. Leave 'Use Preprocess ControlNet' unchecked for now.

<figure><img src="https://2463013151-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FrjzSinvVPe17AZtDte0Z%2Fuploads%2FqHk8mDakq5EyEAPLRvOv%2F015.png?alt=media&#x26;token=78342adb-bac4-472d-b0dc-0a132a547ba0" alt=""><figcaption></figcaption></figure>



You can preview the preprocessed image for the selected model with the preview button. \
You can also save this preprocessed image to use or edit later

<div><figure><img src="https://2463013151-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FrjzSinvVPe17AZtDte0Z%2Fuploads%2FpxqZLp96uZojK5rL7E7t%2F016.png?alt=media&#x26;token=12ded5d5-7ca9-498a-8614-2aca43267ccc" alt=""><figcaption><p>Preview Result</p></figcaption></figure> <figure><img src="https://2463013151-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FrjzSinvVPe17AZtDte0Z%2Fuploads%2FFS8grcHQfHYKS2jgGJA6%2F017.png?alt=media&#x26;token=df024496-8699-4ebe-b2e9-21d9425b0f71" alt=""><figcaption><p>Save for later</p></figcaption></figure></div>

This is convenient for making edits to some preprocessed images to add in details, or remove defective parts more easily. \
These images get saved in a folder called ControlNet in your listed image output folder.

<figure><img src="https://2463013151-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FrjzSinvVPe17AZtDte0Z%2Fuploads%2F08u7f3gsfAM5bMSep21S%2F018.png?alt=media&#x26;token=19ab0a50-c978-4990-bdb5-0a75a25a9539" alt=""><figcaption></figcaption></figure>



Enter the prompts you want, choose your favorite model, and enter other settings as you would for regular text to image.&#x20;

\
Image Variation (from 0.05 to 0.99) will alter how much of the base image is used in the final ControlNet images.\
Setting variation to 1 will use just the ControlNet preprocessed image.

\
You can also add on Loras.

<figure><img src="https://2463013151-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FrjzSinvVPe17AZtDte0Z%2Fuploads%2F9q7c1X7lrNtEFktAbKBc%2F019.png?alt=media&#x26;token=430e07b2-2e65-4787-b27c-f1a463e6be73" alt=""><figcaption></figcaption></figure>

Using these ControlNet models will take a bit longer to generate.\
But eventually it will output an image very similar to the input base image, with some alterations from your prompt and base model.

<figure><img src="https://2463013151-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FrjzSinvVPe17AZtDte0Z%2Fuploads%2FAP3XjZ3AlKEFrz9WeEAR%2F020.png?alt=media&#x26;token=96ea7aba-206e-496e-9b01-45772570279e" alt=""><figcaption></figcaption></figure>



Experiment trying out all of the different models, and even chain the other ControlNet models by right clicking on the generated image and setting it as the new starting image.

<figure><img src="https://2463013151-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FrjzSinvVPe17AZtDte0Z%2Fuploads%2FLamR5q1QKiqH6Yv2Kext%2F021.png?alt=media&#x26;token=f403822e-37b5-4101-8036-5dccb6821a08" alt=""><figcaption></figcaption></figure>

<figure><img src="https://2463013151-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FrjzSinvVPe17AZtDte0Z%2Fuploads%2FOp8ybrGsw6IQaOUlhti4%2F022.png?alt=media&#x26;token=9c2c74bc-e289-4107-9add-1faffa25be07" alt=""><figcaption></figcaption></figure>

