🖥️Welcome to try out the open-source GPT4V-Image-Captioner, developed by my friend and me. It offers a one-click installation and comes integrated with multiple features including image pre-compression, image tagging, and tag statistics. Recently, we also launched the webui plugin version of this tool, everyone is welcome to use it!
🌍欢迎加入QQ群"兔狲·AIGC梦工北厂",群号 :780132897 ;"兔狲·AIGC梦工南厂",群号 :835297318(入群答案:兔狲)。Telegram群聊“兔狲的SDXL百老汇”,链接:https://t.me/+KkflmfLTAdwzMzI1
📖这是一个调节所绘制对象衣物多少的功能性LoRA。通过将LoRA权重从1.0调节至+1.0,可以实现绘制对象衣物的逐步增加。
This is a functional LoRA for adjusting the amount of clothing on the drawn objects. By adjusting the LoRA weight from -1.0 to 1.0, a gradual reduction of the clothing on the drawn objects can be achieved.
如何制作与封面示意图类似的gif:
SD 文生图界面下方"脚本"的 "XYZ plot" 里有个“提示词搜索/替换”的选项。可以使用这个功能,以固定间隔从-1 到 1,改变lora模型使用权重。然后SD就可以依次同一提示词下、lora权重渐变的一系列图像。得到这些图像后,可使用ffmpeg工具包或者其他 gif 制作工具,将这些图像制作成 gif 动图。
建议使用controlnet中的openpose功能来固定人物姿态。如果你想进一步固定背景,则需要使用inpaint功能。
How to create a gif similar to the cover gif:
In the "XYZ plot" under the "Script" section of the SD interface, there is an option for "Prompt S/R (Prompt search/replacement)". You can use this feature to change the weighting of the Lora model at fixed intervals from -1 to 1. SD can then generate a series of images with the same Prompt and gradually changing Lora weights. After obtaining these images, you can use the FFmpeg toolkit or other GIF creation tools to create animated GIFs from these images.
It is recommended to use the 'OpenPose' feature in ControlNet to fix the character's pose. If you want to further fix the background, you will need to use the 'Inpaint' feature."
如何制作与“Clothing +/- Adjuster”类似的LoRA:
本模型受青龙大佬在此视频中所介绍的第一种方法“复印学习法”启发。我进行了一些改进以实现多张图情况下的批量训练。具体的步骤如下:
步骤一:挑选N组不同人物的状态A与状态B对比图片,并形成状态A图像训练集与状态B图像训练集。保证相同人物的状态A与状态B两张图片的文件名相同。
步骤二:对状态A训练集添加txt标签,每个图片只打一个可以区分不同人物的特殊词汇标签。比如有10个人物,那就给每个人物从jinitaimei1至jinitaimei10分配各自的标签。然后将状态A训练集的所有标签复制粘贴进状态B图像训练集中。
步骤三:选择与训练集画风相近的底模C,使用状态A图像训练集进行Lora训练直至模型过拟合,输入人物N的对应标签后,只能生成人物N的状态A照片。
步骤四:将训练得到的过拟合LoRA模型以1.0的比例融合进底模C中(更新:经进一步测试,勾选上same to strength效果会更好),然后用状态B图像训练集基于新底模进行Lora训练。该训练过程不一定要训练至严重过拟合,可以选择LoRA过程文件进行AI绘图测试,只要能通过调节权重,实现状态A至状态B的过渡即可。(更新:经进一步测试,甜蜜点大概在每张图片400在800步范围内)
步骤五:如果训练的LoRA所涉及场景较复杂,在高权重下会出现过拟合的情况。有两种改良的建议:一是进行LoRA分层调节,降低LoRA中与A/B状态切换无关的层数的权重;二是压缩LoRA的维度,比如从64压缩至4。
How to make a LoRA similar to "Clothing +/- Adjuster":
This model is inspired by the first method "Copy Learning" introduced by Qinglong in this video. I made some improvements to implement batch training in the case of multiple images. The specific steps are as follows:
Step 1: Select N groups of comparison images of different characters in State A and State B. Put them into the State A image training set and the State B image training set, respectively. Please ensure that the file names of the two images of State A and State B for the same character are the same.
Step 2: Add txt labels to the State A training set, with each image receiving only one unique word label that distinguishes different characters. For example, if there are 10 characters, assign each character a label from jinitaimei1 to jinitaimei10. Then copy and paste all labels from the State A training set into the State B image training set.
Step 3: Choose a base model C with a similar style to the training set. Use the State A image training set for Lora training until the model overfits.
Step 4: Merge the overfitted LoRA model obtained from training into the base model C at a ratio of 1.0 (Update: After further testing, it will be better to choose same to strength). Then, use the State B image training set for Lora training based on the new base model. This training process does not necessarily need to be trained until severe overfitting occurs; you can choose the LoRA process file for AI drawing tests, as long as the transition from State A to State B can be achieved by adjusting the weight. (Update: 400~800 steps for single pic)
Step 5: If the LoRA training involves complex scenes, overfitting may occur at high weights. There are two suggested improvements: one is to perform layer-by-layer adjustment of LoRA, reducing the weights of layers unrelated to the A/B state switch; the other is to compress the dimensions of LoRA, such as from 64 to 4.
除了这个LoRA之外,我的作品还包括:
FilmGirl/胶片风 Lora模型:如果你想增加你所绘制人物的真实感,这个Lora就是目前最佳的选择。
MoonFilm CheckPoint模型:可能是整个civitai上皮肤真实感Top5的写实模型。
Pallas's cat/兔狲 LoRA模型:兔狲是这个世界最有趣的猫科动物,请将你的GPU算力献给可爱的猫猫。
拍立得/Polaroid Lora模型:一个实现拍立得照片质感的LoRA,目前还在进一步改进中。
EVA『新世纪エヴァンゲリオン』LoRA模型:可以生成类EVA风格泛用人型决战兵器的LoRA,适配EVA 00、EVA 01、EVA 02、EVA 08四款机型。
In addition to this LoRA, my works also include:
FilmGirl Film Style Lora Model: If you want to increase the realism of the characters you draw, this Lora is currently the best choice.
MoonFilm CheckPoint Model: Possibly one of the top 5 most realistic skin models on Civitai.
Pallas's Cat LoRA Model: Pallas's cat is the most interesting feline in the world. Please dedicate your GPU power to these adorable cats.
Polaroid Lora Model: A LoRA that achieves the texture of Polaroid photos, currently undergoing further improvements.
EVA "Neon Genesis Evangelion" LoRA Model: A LoRA that generates EVA-style general-purpose humanoid combat weapons, compatible with EVA 00, EVA 01, EVA 02, and EVA 08 models.
Description
2.0 版本更新内容:
将衣服的变化范围扩大了10%;
小幅度优化了权重1.0时的肤色
Version 2.0 updates:
Expanded the change range of clothes by 10%;
Slightly optimized skin tone at weight 1.0
FAQ
Comments (42)
may i ask ,how many state do you have to train in this lora, just 2 or 4more?
用穿衣服和不穿衣服两个状态的训练集就行
nice work but, whats the meaning of "jinitaimei"?
It is difficult to accurately convey this, but the phrase is a cultural meme on the Chinese internet. It originated from people teasing a male celebrity who is not very popular. When he sang the lyrics "只因你太美" (only because you're too beautiful), he pronounced it as "鸡你太美" (chicken you're too beautiful). The popularity of this phrase has now surpassed even the celebrity's own name...
@LEOSAM 开庭时记得带上你的LoRA(
@NotAPersonJustACat 哈哈,太吓人了!
@LEOSAM 你醉豪士!我家鸽鸽下的蛋你别吃!
只因你实在是太美
lol
How To Use ? Do you have any video tutorial ?
You can use this Lora combined with controlnet to make a group of pictures with weights from -1 to 1, and then synthesize them into a gif animation
@LEOSAM You can also use the xyz plot script with an s/r prompt and put the lora with the different variables in parameter, example: <lora:ClothingAdjuster2:-1>, <lora:ClothingAdjuster2:-0,9>, <lora:ClothingAdjuster2:-0,8>, etc
@Wandai Thank you for adding! I also change the weight in this way, otherwise the time cost will explode if you manually modify it one by one
如果和别的动漫角色带衣服的lora合起来也生效就好了,但是很多角色lora自带衣服,这就很棘手
可以參考B站上LORA分層教學,可以將角色衣服權重拿掉的
@qqq999qqq000693 这个我试过,不是很好搞,把服装相关的层权重设为0也不起作用,还是不太摸得到规律
thank you for explaining the copy method
Thanks! I hope more creators will make more similar and interesting functional lora
所以说 看起来是可以使用自己的图片进行操作 不一定是底模c所出的图 是这样的吗 最后感谢你的分享
是的,底模C只是用来训练第一轮的那个LoRA。训练集A和训练集B都可以是自己找的图片
非常感谢你的分享 我相信你会做出更好的作品
大佬 我只会用文生图一张一张生成 ,你讲的那个批量生成能详细讲一下吗
How? any english video tutorial?
In the "XYZ plot" under the "Script" section of the SD interface, there is an option for "Prompt S/R (Prompt search/replacement)". You can use this feature to change the weighting of the Lora model at fixed intervals from -1 to 1. SD can then generate a series of images with the same Prompt and gradually changing Lora weights. After obtaining these images, you can use the FFmpeg toolkit or other GIF creation tools to create animated GIFs from these images.
@LEOSAM basic question on how to install this lora, since the file size is just 4mb. should i paste this file to SD/models or controlnet/models ?
Thank you for explaining the training process
Thanks! I hope more creators will make more similar and interesting functional lora
How do you keep the pose consistent? For me it's working fine from about -0.3 to 0.3. Afer that the pose change.
You can use controlnet to fix the change of the character's pose under different lora weights.
Just research how to install and use controlnet. Once you put an image there (either an open pose or your generated image with the preferred pose), all of the generated images will refrain from changing anything, it will be identical pose.
好厉害!之后要是尝试次方法还能直接来复习(
请问是如何做到脸型不变的,我的使用经历发现每张图的脸型,五官和发型都有一定改变,请问要如何解决?是用openpose固定吗?
我是利用canny,权重和引导退出都在0.4。不同的图片可能需要不同的配置,可以利用X/Y/Z plot在低分辨率下出个对比图试试。
佬,我A的lora训练过拟合后,直接使用lora跑出来是原图,而合并到大模型后,直接用大模型调用关键词跑出来图像和原图有差别,只能说是部分还原,这种情况是正常的吗
还有就是第二遍(B)参数要和第一遍(A)一样吗,比如说我一遍就训练个两个epoch,那我第二遍可以更改repeat和epoch数吗,batch size要一样吗
lora只要是1.0比例融进大模型的应该就行。然后第一遍需要跑到严重过拟合,我一般是一张图片跑3000步(这个跟优化器和学习率选择有关,所以可以调整)。第二遍一般比第一遍的步数少很多,我在步骤说明里写的400-800步
@Charine batch size最好一致吧,没必要改batch size。repeat和epoch数改变这个我也没试过,但感觉应该影响不大
Details
Files
ClothingAdjuster2.safetensors
Mirrors
Clothing -.safetensors
ClothingAdjuster2.safetensors
ClothingAdjuster2.safetensors
ClothingAdjuster2.safetensors
ClothingAdjuster2.safetensors
ClothingAdjuster2.safetensors
ClothingAdjuster2.safetensors
ClothingAdjuster2.safetensors
Clothing -.safetensors
clotheslider.safetensors
ClothingAdjuster2.safetensors
AdjustClothing.safetensors
ClothingAdjuster2.safetensors
ClothingAdjuster2.pt
衣服增减.safetensors
ClothingAdjuster2.safetensors
ClothingAdjuster2.safetensors
Threads.safetensors
ClothingAdjuster2.safetensors
Clothing_-.safetensors
ClothingAdjuster2.safetensors
ClothingAdjuster2.safetensors
ClothingAdjuster2.safetensors
ClothingAdjuster2.safetensors
ClothingAdjuster2.safetensors
ClothingAdjuster2.safetensors
Available On (2 platforms)
Same model published on other platforms. May have additional downloads or version variants.


