AI Art Tutorials - Local Version
  • Artroom Basics
    • Overview
    • Downloading and Installing Artroom
    • Common Issues and Solutions
      • Debugging Installation
    • Upcoming features and Feature requests.
    • Link to Artroom Web Version Tutorial
  • Resources
    • Settings Tutorials
      • Starter Settings
        • Video tutorial
      • Image Scale
      • Steps
      • Prompt Strength (CFG)
      • Base Image (img2img)
      • Variation Strength
      • Sampler
      • Clip Skip
      • Seed
      • VAE
      • SD Settings (Importing settings)
    • Prompting Tutorials
      • Basic Prompt Structure
      • Prompt order
      • Negative Prompts
      • Weights
      • Example Prompts
        • Art Styles
        • Art Medium
        • Attributes
          • Camera Specific Attributes
          • Effects
        • Artists
          • Asian
          • Glamour Style
          • Renaissance
          • Splash
          • Misc
        • Prompt Repositories
        • Prompt Generators
          • Clip Interrogator
          • Deep Danbooru
      • Prompt Pitfalls
      • Prompt Myths
    • Models
      • Recommended Models
        • Realistic
        • Anime/Drawn
        • Artistic
        • Tabletop Gaming
      • How to test your models?
    • Extra Features Tutorials
      • The Paint Tab
        • Tools and Functions
          • The Workspace
          • The Tools - in depth
          • Canvas Settings
        • Inpaint
        • Outpaint
        • Image Editor (GIMP/Photoshop) Assist
        • Palette Fix
        • Paint Tab Video Tutorials
      • Loras
      • Control Net
        • Installing ControlNet
        • Using ControlNet
        • Pose kits and Saved Preprocessed Images
      • Removing Backgrounds
      • Upscaling
        • Standard Upscalers
        • Highres Fix
      • Model Merging
      • Image Viewer
      • Settings Tab
  • Glossary
  • Guides By AI Artists
    • About this Category
    • Generating Characters for Tabletop Games
    • Turning Your Scribble Into an Image
Powered by GitBook
On this page
  1. Resources
  2. Extra Features Tutorials

Control Net

How to install and use ControlNet

PreviousLorasNextInstalling ControlNet

Last updated 1 year ago

  • Using preprocessed images, (ie. posekits), Aren't currently working with Artroom 2.0

  • Not compatable with SD2.0 or SDXL

  • The HED model has been superseded by the Soft Edge model. Soft Edge is the better option, and HED is on the list for legacy only.

  • Tested to be fully compatible with graphics cards that have 6GB VRAM and up.

  • Tile ControlNet isn't working in Artroom yet.

What is ControlNet?

ControlNet is a method for copying the features of an image, much more accurately than a regular image to image process. First the ControlNet model makes a 'preprocessed image' of a starting image, and uses that to guide your regular model Each ControlNet model has its own style for preprocessing. It will take some practice and experimentation to find the right one.

Below are some examples of each model, what the preprocessor does, and several output images. Just note that these are just some good examples of what it can do, and may not always be perfect.

These five work well with just about any image you use with them, with no special requirements for using.

Attempts to predict the distance of objects from the viewer. Good for getting the general shape of an image, without copying specific details.

This model attempts to figure out what way a subject is facing. Like Depth, it creates a general shape without copying details.

Creates a wire-frame of the subject in an image. Copies the exact pose without any other details from the original image. Now with better face and hands.

Traces an outline of the image. Similar to canny, but is less strict when copying the smaller details.

The most commonly used ControlNet model. Creates a fine line to trace an image. Good for copying the subject in an image very accurately.

These next five are a bit more specific on how they want to be used, and will be explained in each tab.

Used to copy the general shape of the scenery. Does not pick up on subjects very well.

Used with lineart/monochrome images, adding color and details to them. Doesn't work well with regular colored images. Can sometimes work better with inverted colors if the outline is too strong.

Used with lineart/monochrome images, adding color and details to them. Doesn't usually work well with regular colored images or non anime models. Can sometimes work better with inverted colors if the outline is too strong.

Takes a crude drawing made in msPaint and roughly follows it. This model has more freedom to deviate from the base image than others, and can lead to some interesting results.

This model s meant to take the base image and, using plain English, change specific details of it. Like, "make her hair blue" or "change the season to winter" As simple as it sounds, this can be one of the more difficult models to get working right. Inpaint may be a better option for more controlled changes. The Paint Tab

These last ones are the old version 1.0 ControlNet models. Leaving them here as a reference.

Installing ControlNet
Using ControlNet
Pose kits and Saved Preprocessed Images
The listed prompts are the only prompts used on that image
This was replaced by Soft Edge