SDLX ControlNet

What is controlnet? well it's AI on top of AI, it's a neural network (controlnet) used to extract information from images, to be used as the inputs of the Stable Diffusing model, instead of the image directly, doing so leverages AI to gain better insights in the details we would like to capture.

(this is a bit of an over simplification, if you would like more details on how these things work, I recommend checking out this video by code_your_own_ai on YouTube.)

Checkout the repo on Hugginface

The Code

Let's start by installing & importing required libraries:

Install libraries in needed:

Copy

Import:

Copy

After that is as simple as this

Copy