Although DALL-E 2 was the first Artificial Intelligence to be popularized to generate unique images from text, Stable Difussion is the one that has surprised us the most and it is all thanks to its open nature and community. Unlike DALL-E, Stable Diffusion is open source and allows anyone to train and modify it with specific patterns to generate certain types of images. This is how Text-to-Pokémon, the AI for creating unique Pokémon based on Stable Diffusion, was created.
This time, we bring you another AI based on Stable Diffusion that has become popular on Reddit thanks to lovers of anime and Japanese culture. This is Waifu Diffusion, a latent text-to-image diffusion model that has been conditioned to create high quality anime girl images. Next, we explain a little more what this AI is like and how you can use it from your mobile to create your own waifus.
What is Waifu Diffusion and what does it do
Waifu Diffusion is an AI based on Stable Diffusion 1.4 that creates anime-style girl images from a text description. Technically, it is a latent diffusion model that has been trained with 680 thousand anime images. It was created for entertainment purposes, although it can also be used as an art assistant.
It has the same license to use CreativeML OpenRAIL-M from Stable Diffusion, as well you can use it totally free without restrictionsas long as you do not use the generated content for illegal or harmful purposes.
2 ways to use Waifu Diffusion from mobile
Do you want to try Waifu Diffusion to create your own waifus? Until recently, the only way to use it was to install it on your own PC, which requires a fairly powerful graphics card. Fortunately, they already exist. two methods to use Waifu Difussion without even having a pc. One of them is to use the cloud services of Google Colab (the most complicated) and the other is to use a demo of the AI available in Hugging Face (easier, but with limitations).
How to use Waifu Diffusion from mobile with the demo
Hakurei, the main developer of Waifu Diffusion, has created a demo of his AI on the Hugging Face web for you to anyone can use it without complications. If you want to try it, simply enter the following link and that’s it.
Link | Waifu Diffusion Demo
With only enter the text description and press Run, you can now create the anime girl you want. The problem with this method is that it depends on a common server that is often saturated and has queues (although they are not long at all). Also, it seems that the version of Waifu Diffusion available in this demo was trained with fewer images, according to the description of it.
oh! And you will not be able to customize any parameters of the generation. You can only enter the text description and by default the app will generate two different images depending on what you wrote. If you just want to see what this AI is like and come up with some waifu girl ideas for your projects or to prank your friends, it’s not a bad option. Now, if you want to explore further and find out what this AI is capable of, and you don’t have a powerful GPU to install on your PC, take a look at the next method.
How to use Waifu Diffusion from mobile with Google Colab
How to use Waifu Diffusion with Google Colab
If you want to try the latest version of Waifu Diffusion no long waiting times and no limitationsfollow these steps to use it from your mobile:
- First, access this version of Stable Diffusion in Google Colab. You should sign in with your Google account if you haven’t already done so on your device.
- If you have Google Colab Pro (the paid subscription for the service), we recommend that you go to Runtime > Change runtime type and choose the option High-RAM for better AI performance. This is optional, so don’t worry if you can’t select this option.
- Now press the play button next to the “import os” code, select run anyway and wait for it to load completely. You may not see this button with the Play icon, but as two square brackets. Likewise, it should be clarified that this procedure will cause Google Colab to give an error, but don’t worry, it’s normal.
- Then also press the Play button next to the “!git clone” code and wait for it to load completely.
- Next, go to the Waifu Diffusion page on Hugging Face. In the “Files and versions” section look for the latest available version which, at the time of writing this article, is “model-epoch09“. As you can see, there are several sub-versions of this version. If you are using Googla Colab for free, you must click on the one that ends in “float16.ckpt“but if you have Colab Pro you can click on the one that ends in “full.ckpt”.
- On the page that will open, you will see the option Download. Hold down that option and in the menu that will open press on copy link (you just need the link, you don’t have to download anything).
- Go back to the Google Colab window and in the “Normal 1.4 model” section delete everything to paste this: !wget -O /content/stable-diffusion-webui/model.ckpt (replace the huggingface address in this code with the link you copied earlier).
- Press the play button which is next to the code you just pasted.
- Also press the Play button next to the code !COMMANDLINE_ARGS=. And wait for it to finish loading. When finished, also press the Play button on the next line of code.
- Now, in the next “!COMMANDLINE_ARGS=” you have to replace the word “me” with a username of your choice and the word “qwerty” with a password of your choice. In my case, I replaced it with “androidphoria” and “1234” respectively. Then press the Play button corresponding to that line of code.
- When it finishes loading, you will see that at the end it says «Running on public URL«. Click the link next to that message (this link only remains active for 72 hours).
- On the page that will open, enter the username and password you defined earlier in the Username and Password boxes respectively. Tap Submit to enter.
Clever! Now you will enter a web app where you just have to write in the Prompt box the description of the waifu that you want the AI to create. Press the Generate button to generate it. From now on, you just have to enter the link generated by Google Colab to create your own anime girls with Waifu Diffusion.
What do I do if I can no longer access the Waifu Diffusion web app link?
If the link goes down, you just have to generate it again from Google Colab. In order not to repeat all the steps again, we recommend you click on File > Save a copy to Google Drive in the Google Colab file that you modified. This will save a personal copy in your Google account of the exact code to generate the link of the Waifu Diffusion web app every time you want without having to configure everything from scratch (save the link of the address of the copy created in case you don’t know later how to access it).
By the way, remember to check every once in a while on Hugging Face if there’s a new version of Waifu Diffusion to change the link that is placed in the “Download the model from huggingface. See link at the start for different ways» and thus enjoy the latest news and improvements of this AI.
Tips to create the exact waifu you want with Waifu Difussion
Please note that the AI only understands the English language, so you can only enter words in English. Also, you have to follow a specific description format so that Waifu Diffusion understands exactly what you want. This is the ideal format: original, 1girl, solo, portrait, hoodie, wearing hoodie, red hoodie, long sleeves, simple background, backlighting, rain, night, depth of field. I mean, you have to put the characteristics in English of the image you want, separated by commas.
Its developers recommend following these tips when entering the text description:
- Add more tags to your description, especially composition tags. You can find a complete list here.
- Includes a copyright label that is associated with high-quality art such as genshin impact either arknights.
- Be specific. Use specific tags. The model can’t assume what you want, so you have to be specific.
- Don’t use underscores. They are deprecated as of Waifu Diffusion 1.2.
So let your imagination run wild create the anime characters you want without having to draw them. Do not forget that using this AI to generate images for illegal or harmful purposes is prohibited according to the license of use. Use it wisely for whatever you want, but always without affecting anyone.
