I'm working on two models under the title LusicDreamer: an anime-style model and a semi-realistic model. While I plan to integrate them in the future, I'm currently conducting extensive experiments with both models through full fine-tuning.

The latest version of the anime model is ver.0.72A, and the latest version of the semi-realistic model is ver.0.71SR. There are also NeoSD versions using the same methodology and dataset with SD1.5 and Qwen-Image version. Currently, everything is experimental.

ver.0.75Anime

This time, the plan was to move from semi-realistic to anime-style, but this model hasn't quite returned to that style. Since the previous model was quite realistic semi-realistic, some might think this one is more semi-realistic. Of course, it produces anime-style images, but it also produces photographic images. I ultimately intended to create a model that could produce both, or rather, a variety of images, so this was a bit unexpected.

The Tick-Tock mechanism, designed to avoid wasting training data, doesn't seem to be working properly. Even the AI ??seems to advise against it. I will reconsider what to do next.

While there are improvements compared to 0.72A, the overall result is less impressive. For anime-style images, I think 0.72A produces more interesting results. This model is an intermediate form between semi-realistic and anime-style, excelling at semi-realistic images that lean towards painting, and images with anime characters on realistic backgrounds.

Of course, adding "anime" to the prompt will produce anime-style images.

ver.0.74 SemiReal

This is the next TikTock semi-realistic model (MyJuice was just a detour).

For this experiment, I wanted to make it possible to switch between two semi-realistic styles, but it's barely functional.

Going forward, I'll focus on:

- Increasing the development pace (cutting corners more often)

- Addressing NSFW issues

Simplifying development is a main theme, and I'll pursue it further. I had anticipated that NSFW issues would gradually resolve themselves as more data was collected, but that seems to have been a bit too optimistic, so I plan to increase the data further.

Also, while I've previously focused on slightly unusual styles with easily noticeable changes, I plan to include more standard styles.

ver.0.73 MyJuice test

This time, I've changed direction a bit and created a more realistic semi-realistic model. As part of a labor-saving test, I focused on gathering data from Asian women's faces for training. Men? None included.

The data is relatively small, just over 1500 images, aiming for low accuracy and short training time. Since the base model is the same as previous models, I thought that even with less data, there wouldn't be any problems with NSFW, but that wasn't the case at all. The base model had been trained to the point where it could somewhat hide the Z-Image quirks, but when new data was added, it seemed to loosen up a bit and the quirks became more prominent again. Please note that this version is not NSFW compatible.

ver.0.72Anime ZiBase

I trained based on 0.7 using a dataset created with different images from the same series as 0.6.

Since 0.7 is based on the 0.6 series, it means that the information has been inherited. For a while, I will try the Tick-Tock method, which uses the anime model and semi-realistic model as a base to improve accuracy. Even in the anime series, I was worried about whether to use a different style from the previous one, but since the previous style seemed to be popular, I decided to stick to the same style this time.

Actually, the output image itself is not much different from the 0.6 series. The strange quirks of Z-Image have been reduced, the colors are darker, and the semi-realistic influence remains in some areas. Some people may think that 0.6 is preferable for things like color depth.

The phenomenon of the body becoming thicker than expected with 0.6 has been resolved. Prompt fidelity has also been slightly improved. If you do not specify the background, it may not appear properly.

It's not that it's completely better than the previous version; the atmosphere has shifted from Light to Rich, and from Cute to Cool (just a little). I think it's a good idea to try the same prompt on both.

I am conducting an experiment intended to reduce training time. The number of new images this time was approximately 28,000, and the training time was approximately 46 hours. Considering that 0.6 was running for about a week, this is a considerable simplification. In the future, I plan to do short-term iterations with approximately 30,000 additional images.

ver.0.71 Semi Real ZiBase

This is a semi-realistic model with final training added to the preliminary training version.

+Improved image detail, such as faces

+Improved prompt accuracy

+Saturated colors

+Increased contrast

-Colors may be too saturated

-Faces are displayed larger, slightly altering the composition

In prompts with very detailed facial features, the face may be emphasized more than necessary. In this case, place prompts related to facial details at the end. The example below rearranges prompts from the order of face-body-background-pose to background-body-pose-face.

It seems I provided too much detailed facial information during the learning process....

ver.0.7 Semi Real ZiBase test

This is a semi-realistic version currently under construction. It is still in the preliminary learning stage, but I'm releasing it on a trial basis.

I am using a completely different learning method from the ver. 0.6 anime version. 0.6 was not originally supposed to work so well, but it is working better than expected, which is a bit disconcerting. This time I am testing in the complete opposite direction, so the results may not be good, but in theory there should be many improvements.

The current drawback is the low image quality. This is planned to be improved in the future.

ver.0.6112 Anime ZiBase

This is the final version FT tested on the ver. 0.6 dataset. The colors are a little lighter than 0.68, but this is partly due to a dataset issue. It's not necessarily better than 0.66 or 0.68, but I think it's easier to produce a more stable image.

Distll LoRA and output settings are surprisingly important. For stable operation, I recommend using both the 4-step version and ver. 1 version at 0.8 and outputting at 5 steps. The image remains almost the same even at 4 steps, so I recommend outputting at 4 steps and increasing the step only for the parts that look good. If you're prioritizing atmosphere, using ver. 1 as the main output and outputting at 8 steps or more will produce interesting results. Faces and other features will change slightly, however.

This was my first FT with Z-Image, and while I discovered various issues along the way, I was a little surprised that the image turned out surprisingly well. I'm also slightly changing my Z-Image captioning strategy, and next time I'll try completely different settings.

ver.0.68 Anime ZiBase Finetuned

Due to file upload problems, the BF16 version of ver.0.68 has been uploaded as the BF16 Full version of ver.0.66.

ver.0.66 Anime ZiBase Finetuned

This is the new FT version. It's more stable than the first one. There are two versions of BF16, but I tried uploading it as a trial and was able to upload it, so I will also be releasing the next version at the same time (it is labeled as the full version). The next epoch is being created while I'm uploading it, but I can't seem to do anything about it. . .

It is not recommended to use it as is. It takes over 30 steps. Please use 4Step LoRA. For this case, I think it's okay to do it in 4 steps (if the details are rough in the FP8 version, use 8 steps).

You can use it as is, but since it does not display only anime pictures, it is recommended to add anime to the prompt. The output of my pictures has gradually become more stable, but compositions and poses also tend to be uniform. In such cases, we recommend using the 4-step version of LoRA at strength 0.5 and trying 6-step execution. If you do this, the colors will fade, the details will become rough, and the body structure will often become questionable, but it seems that making the generation more unstable reflects the learning contents more strongly, so there is a higher possibility that you will get a rough but interesting picture. Keep the Shift value low (3 or less). Normally, 4-step execution with 4-step LoRA:1.0 is OK, but please try it when you want more variety. Most of the samples this time are from 6-step execution of 0.5 (that's why the colors are whitish).

LoRA: 1.0 can produce images with a sufficient amount of information, but 0.5 is closer to the model's intent, as it has an excessive amount of information. Please be careful as lowering the Shift value will result in a more complex shadow being cast.

For problems with washed out colors and low contrast, please refer to the sample workflow using color adjustment nodes on ComfyUI attached to an image of a girl drinking tea.

ver.0.6 Anime Finetuned (test)

This is the FT version using the ver.0.6 dataset.

To be honest, based on the sample images, I was expecting a proper image to be released around the middle of next week, but I found some images that looked surprisingly usable even at low epochs, so I decided to release them quickly. Currently, uploading to CIVITAI is extremely heavy, so only the FP8 version is available.

The samples are outputted in 4 steps using 4-step LoRA in the BF16 version, but for the FP8 version, please use around 8 steps using 4-step LoRA. As I wrote before, using 8 steps in the 4-step version is recommended over the 8-step version.

The anime images are not yet stable, so I recommend adding "anime" to the prompt. However, since there is a tendency for the animation images displayed to be those stored in Z-Image rather than those that have been learned, I found that a simple "[[anime]]" or "[[[anime]]]" to lightly indicate that the image is anime picture would be better. This affects shading as well as faces.

Tip: This is only available in Forge Neo, but specifying a value for an undefined word affects the entire image (e.g., image:0.5). Be careful when trying out a prompt imported from somewhere else. You can also use this, such as image:0.9 or image:1.1. Values below 1 result in lighter colors and increased sharpness. Values above 1 result in darker colors and a blurrier image.

Now that I'm finally able to display an image using Z-Image FT, the overall quality will likely improve, but overwriting Z-Image concepts isn't necessarily the best approach. I think intermediate versions have a certain meaning. Adding [[anime]] allows you to fully confirm the learning effect. Currently, a specific area of weakness is NSFW content.

However, there's no way to know if the FT model wasn't usable without conversion...

ver.0.8 Anime (ZiBase)

This is an anime model that was trained using ver.0.5 as a base model.

All samples use Distill LoRA.

Sampler: euler/euler a, Scheduler: simple, step: 7, CFG scale: 1.0, Shift: 16

When not using Distill LoRA, set Step 30 or higher and CFG scale to about 4.5.

This time, I mainly use the 4-step version of LoRA with 7-step output. If you use the normal 8-step version, the composition will look a little strange. 8-Steps-2602_UDCAI Edit version does not work well even if I use LCM. However, although it is a completely wrong usage, using both 4step version and 8-Steps-2602_UDCAI Edit version with 1.0 seemed to be the best choice for this model.

If the steps are too low, the quality of the picture itself will drop, so try changing the number of steps depending on your purpose.

ver.0.6 Anime (ZiBase)

Although it includes a small amount of version 0.5, most of it is a model made with new materials. It supports more anime-like and delicate designs. There are areas where physical stability has improved and areas where it has become unstable compared to 0.5. This model is at its best at low shift values, but the body structure becomes more fragile.

This model focuses on producing a variety of pictures rather than producing stable pictures. However, there are also unstable aspects.

If you want to produce stable images, it is better to set ModelSamplingAuraFlow quite high (about 20) and CFG scale high. It may be better to fix the denoise value to 1.0 as well.

If you think that Z-Image or Qwen-Image images are boring, you may occasionally get better images if you try lowering the Shift value.

If you enter an existing prompt and get a shabby picture, it's probably filled with stupid parentheses, so delete them all. If noise appears in the picture with ComfyUI, please update ComfyUI.

The colors seem to be a little paler and brighter on this model. You can adjust it using CFG scale, but if you're concerned about the image changing, try adjusting it with comfyui-latent-vae-tweaker. This tool was originally designed for SD1.5/SDXL, and 16-bit formats such as Flux.1 and Z-Image cannot be edited at the latent stage, but they can be edited at the image stage. Please refer to the workflow for the added images.

*I've made comfyui-latent-vae-tweaker compatible with 16ch latent format. I don't think it's something that an average person can control, but just for reference.

ver.0.5 Anime (ZiBase)

This is a test model based on a new anime dataset. Captioning and other features were trained using conventional methods.

While the training resolution was only 1280, the image quality was clearly improved from ver.0.4, so it seems that lowering the accuracy of the previous training test was not effective after all. It did use less memory, though.

This time, the base model used was a 16-step run of Z-Image Base, with a small amount of Z-Image Turbo layers mixed in. The basic settings for generating the sample images are: Sampler: DDIM, Scheduler: simple, Steps: 16, CFG: 8.0, Denoise: 0.85, ModelSamplingAuraFlow: 8.0.

I have uploaded three types of files: BF16, FP8, and GGUF Q6_K.

~~Sorry, something wrong.~~ Fixed.

IF YOU USE GGUF FILE, PLEASE REPLACE loader.py IN THE ComfyGGUF FOLDER.

Due to convenience, it has been uploaded as training data.

The included lcpp.patch and convert.py are not necessary for ordinary people. Please use only those who understand. I also intend to make it compatible with flux.2, but its operation has not been verified.

・more speed?

Although this model uses its own speed-up method to reduce the number of steps, it is not very fast. Several high-speed LoRA versions have been announced for Z-Image Base.

Z-Image-Fun-Lora-Distill : doesn't work

Z-Image (base) Distilled Lora | Extracted: works but looks plastic

So add "anime" to prompt.

The picture will change, but it may be useful in some cases.

ver.0.4 SemiReal (ZiTurbo)

This version uses the exact same materials as the 0.4 SR Base version. This version has a more semi-realistic look. The base model is a mix of Z-Image Turbo and a small amount of Z-Image Base. This may improve the ability to express details a little.

The sample images make extensive use of high CFG settings. CFG 3 is recommended, but this may fail depending on the sampler and scheduler. At the same time, the image quality is controlled by the ModelSamplingAuraFlow shift value (and denoise value). Please refer to the sample and try various options.

ver.0.4 SemiReal (ZiBase)

This model was created as a test run using Z-Image Base.

I was aiming for a semi-realistic model, but the resulting model produced a variety of different images. The captioning is outdated, the resolution is only 1280 (which results in moiré), and the calculation accuracy was minimal.

It can be used in the same way as a regular ZiB model, but I recommend setting the CFG scale higher (around 6).

I created the GGUF version in 6 bits, but since CIVITAI only supports 16/8/4, I uploaded it as 8 bits for convenience.

ver.0.3 Anime

This is a new version of the animation version. Full fine-tuning has been difficult, so this version also uses LoRA. The amount of data has been increased by more than three times. I think the body stability has improved compared to the previous version, but it may still not be sufficient.

Since a wide range of images was used for training this time, it is easier to produce photographic images than the previous version. Adding "anime" to the prompt is effective. However, please note that specifying a number such as "anime:2" will cause the image to break down.

ver.0.2 Real

This is a realistic version of LucidDreamer. I'm having difficulty adjusting the prototype, so I've decided to release it as a test version. I'm still getting used to using DiT, but with Z-Image, body structures tend to be more distorted than with other models using DiT. As a result, combining LoRA results in a greater loss of quality. Since finetune isn't working properly, this can't be helped for the time being. This time, I created three models by applying the three types of LoRA I prepared to create one ckpt at slightly weaker rates. These were materials for finetune, but it seems that using each alone produces better results than using multiple LoRAs.

In terms of datasets, 1 and 2 are completely different, while 3 is a subset of 2. 1 is packed with miscellaneous elements and turned out more illustrative than I expected. 2 has a relatively large number of Western women (especially NSFW) and a fair amount of data, but you may not see any particularly cute girls. 3 is an Asian-style model extracted from 1. Please note that if you leave it unspecified, it often results in a white background.

This series has been adjusted to obtain a wide variety of output with a single prompt, so if no image is specified, the seed will result in larger changes in the image and pose.

In terms of dataset type, it is in the same series as the anime version 0.2, so it is called ver.0.2R.

ver.0.2 Anime

I increased the number of training images. I think stability is improved compared to ver.0.0 and 0.1.

Because it was trained with a wide variety of images, the image style is not stable.

If you don't specify anything in the prompt, the image tends to have a cool(?) style. Sometimes it will look more like a photo. By adding "anime," it will stabilize to an anime style. Adjust to your liking.

By the way, my fine-tuning failed. After a long time, all I got was noise...

There are still issues with the body structure and prompt tracking, but I don't think the other models are much different...

ver.0.1

I believe Z-Image is expected to be a replacement for SDXL. In ver. 0.0, LoRA was applied quite heavily in that direction. It was adjusted to produce a variety of images similar to those in SDXL. On the other hand, it was a bit of a stretch, and it had significant limitations on body structure, etc.

So, I gave up on trying to create anime-style images using the model alone, and created ver. 0.1, which assumes anime:2 prompts.

So, please add "anime" or "anime:2" to the prompt. Tags like "masterpiece" are not very effective. Sometimes they are effective, but more often than not it's better to remove them.

I've also added two more materials. The body structure still looks strange, but since there seem to be many elements missing from the basic ZiT model, I'll have to add them little by little. Please wait for testing with the finetuning version.

ver. 0.1 produces sharper results than 0.0. The image's body stability has also been improved (though it's still not perfect).

ver.0.0

This is my first model created with Z-Image Turbo. It may be a bit difficult to handle. I created an anime-style model, but the body structure is unstable.

I haven't set a trigger word, but adding "anime" makes it relatively stable. If it's not enough, try adding "anime:2."

Files with SHA256: 7360523e40e0b405c8d385e78cfbd58fe1a5c37752087f4e02a089064ace9527