33
votes
Generative AI for Krita
Link information
This data is scraped automatically and may be incorrect.
- Title
- GitHub - Acly/krita-ai-diffusion: Streamlined interface for generating images with AI in Krita. Inpaint and outpaint with optional text prompt, no tweaking required.
- Authors
- Acly
- Word count
- 691 words
This plugin for SD in Krita is awesome, it allows you to draw and get "instant" (pretty quick) generations from your drawing. I find having it in a full fledge art software instead of a hacky web control center really change the dynamic, you can use the generation just to refine your drawing, it will fix your pose and proportion, show you the muscle, it's fun and makes you want to draw, etc. It's a great learning tool and it makes you feel much more in control than prompt based systems. It's also very well integrated in Krita and easy to setup. I think we're getting pretty close to the "end-product" for that type of models with this.
Some quick sketches I've made :
https://imgur.com/a/QFMJsHj
Neat! Can it draw the rest of the owl?
Yep! That’s in the demo linked in the repo at 2:18.
FYI, you can add timestamps to youtube URLs by right clicking and hitting "Copy video URL at current time"
e.g. demo
I was on my phone, and the share button didn’t support that :( but thank you!
You can also add the
&t=xto the URL manually if you want to, wherexis the timestamp in seconds. In this case 2:18 would make it&t=138. Also very valid not to do that, though. YouTube is good about making it easy to scroll.No need to convert to seconds, something like t=2m18s works, too.
Ah, I thought they'd removed that but it was just formatted differently than I remembered. Yes, that works too and is simpler!
It really and truly can.
I've integrated this in to my regular workflow, and it's been a tremendous amount of fun. I fully agree with @Staross - these tools flourish as elements of an overall art system.
A complementary AI-based tool for Krita is object-aware masking. https://github.com/Acly/krita-ai-tools
I have fun with the generative AI plugin, but this masking tool probably saves me more actual time. I almost shudder when I think how much time this would have saved me back in the day.
I was able to install it on a Macbook Air (M2) and generated an image, but the cloud service doesn't seem to support the "refine" action. I'm not sure I want to bother with installing locally. 8 GB of memory probably isn't enough?
I don't know about this specific implementation, it depends on the resolution it's generating, what else needs to be running etc., but for bare SD 1.5 and SDXL (what the plugin uses) 8 GB is enough.
I installed it locally and it did run but was unusably slow.
Havent played with Krita for over a year but this definitely looks like something worth trying. The power of AI creation blows me away.
I had never heard of Krita before but I've been a GIMP user for many, many years. Anyone familiar enough with the two to do a comparison?
For Krita, the comparison is more with something like Clipart or Procreate. It's for digital creation (albeit still bitmap, unlike illustrator), as opposed to manipulation of bitmap images.
Although Photoshop has enough tooling for both purposes.
Krita is more digital art oriented with advanced brushes and workflow tailored for tablet use, but at this point it can do most thing GIMP can with a better interface, maybe some filters are not available but I'm not totally sure.
I'm no expert (and not an artist), but I turn to GIMP for general photo or image manipulation, and Krita for actual drawing, painting, and visual art. In my mind, they don't compete with each other. The Venn diagram circles have some overlap, and some distinction.