<h1 id="anima-telescopa">Anima-Telescopa</h1>Telescopa is a full matrix LoKr (basically poor man finetuning) of <a target="_blank" rel="ugc" href="https://huggingface.co/circlestone-labs/Anima/blob/main/split_files/diffusion_models/anima-base-v1.0.safetensors">Anima Base v1.0</a> by <a target="_blank" rel="ugc" href="https://huggingface.co/circlestone-labs">CircleStone Labs</a>, trained using the <a target="_blank" rel="ugc" href="https://github.com/kohakublueleaf/lycoris">LyCoRIS</a> full matrix LoKr method (<a target="_blank" rel="ugc" href="https://arxiv.org/abs/2309.14859">paper</a>).This was my first attempt at fine-tuning an image model on a dataset above 10k samples. Alongside general practice, the run was also used to:<ul><li>Test whether a carefully hand-curated aesthetic dataset could improve Anima's background generation quality</li><li>Compare full matrix LoKr training against a true full finetune on the same settings</li></ul>Compared to other Anima fine-tunes such as Tdrussel's Aes B, Motimalu's KirazuriV4, duongve's AnimaYume, and the Silvermoon mixes,ect,.... Telescopa is perhaps a lil worse on fine detail, stability, and knowledge/style retention — but it shows slightly stronger background composition and detail than the base model and most contemporaries. For a first larger-scale training run, I'm happy with the result and want to release it anyway as a open source showcase and as a lesson/milestone for myself.This model is produced independently, as a hobbyist project, with no external funding. The model page contain 3 model variant, the ideal epoch 10 LoKR, a earlier and more unstable epoch 3 that also doesnt have as much style bias or potential knowledge forgetting, and a failed epoch 10 full finetune.For in-depth details of training and tooling, see:<ul><li><a target="_blank" rel="ugc" href="https://github.com/RicemanT/model-training-configs/blob/main/diffusion-pipe/Anima/notes/TelescopaLOKR-diary.md">Anima-Telescopa Training Diary</a></li></ul><h3 id="training-details-summary">Training Details Summary</h3>Trainer: <a target="_blank" rel="ugc" href="https://github.com/bluvoll/diffusion-pipe">diffusion-pipe-bluvoll-fork</a>Training device: x2 NVIDIA RTX™ A4000 16GB VRAM provided by Astromahdi <a target="_blank" rel="ugc" href="https://gpu.garden/">gpu-garden</a>Total training time: ~3 days or ~68 hours (more accurately about 2 days at best, I screwed up and had multiple failed runs/restarts)Total samples seen(unbatched steps): ~100,0000 samplesTraining resolutions:<ul><li>1024^2</li><li>1280^2</li></ul><h3 id="training-run-(-initial-3-epoch-run-into-a-further-7-epoch-2nd-run)">Training run ( initial 3 epoch run into a further 7 epoch 2nd run)</h3>See: <a target="_blank" rel="ugc" href="https://github.com/RicemanT/model-training-configs/blob/main/diffusion-pipe/Anima/configs/TelescopaLOKR.toml">TelescopaLOKR training config</a><ul><li>Samples seen(unbatched steps): ~30,000 + ~70,000 samples</li><li>Learning Rate: 3e-6</li><li>Learning Rate Scheduler: Constant with Warmups</li><li>LLM Adaptor Learning Rate: Disabled</li><li>Precision: Full BF16</li><li>Optimizer: AdamW8bit with Kahan Summation, utilizing Kahan summation to prevent precision roundoff errors during pure BF16 weight</li><li>Weight Decay: 0.01</li><li>Timestep Sampling Strategy: Logit-Normal with Shift 4 and Sigmoid Scale=1.3</li></ul><h3 id="additional-features">Additional Features</h3><ul><li>Tag Dropout: 10%</li><li>Caption Dropout: 5%</li><li>Mixed caption with ratio of 25/25/25/25</li><li>Tag Shuffle</li><li>Enable Full Matrix LoKR with: dim/rank = 16 alpha = 16 dtype = 'bfloat16' dropout = 0.0 factor = 2 (~800mb file size)</li></ul><h2 id="dataset">Dataset</h2>Collected through various online sources, mainly danbooru and <a target="_blank" rel="ugc" href="https://www.reddit.com/r/anime/comments/4lhd5l/complete_monogatari_series_background_art/">Akanyan personal collection of anime screencap, scattered throughout his account.</a>I fully open source the dataset as a gesture of goodwill towards general open source, which I've depended on for all my times of using AI/machine learning. And also because open sourced datasets are rare and doing this gain me more credibility lol: <a target="_blank" rel="ugc" href="https://huggingface.co/datasets/RicemanT/Anime-Background-Finetuning-V1.1">RicemanT/Anime-Background-Finetuning-V1.1 · Datasets at Hugging Face</a>Installing and runningWorkflow:<img src="https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/6a4f9570-1a34-43e1-9b0c-0d1e906cdedb/original=true/6a4f9570-1a34-43e1-9b0c-0d1e906cdedb.jpeg" />Reference the <a target="_blank" rel="ugc" href="https://huggingface.co/circlestone-labs/Anima#installing-and-running">anima base instructions</a>. The model is natively supported in ComfyUI. The above image contains a workflow; you can open it in ComfyUI or drag-and-drop to get the workflow.Note: This is just my personal simple workflow, you can realistically use whatever you want as long as the setup work well.The model files go in their respective folders inside your model directory:<ul><li>The failed epoch 10 finetune goes in <code>ComfyUI/models/diffusion_models</code></li><li>The actual successful LOKR models (which is a LoRA variant at its core) goes in <code>ComfyUI/models/loras</code></li><li><a target="_blank" rel="ugc" href="https://huggingface.co/circlestone-labs/Anima/tree/main/split_files/text_encoders">qwen_3_06b_base.safetensors</a> goes in <code>ComfyUI/models/text_encoders</code></li><li><a target="_blank" rel="ugc" href="https://huggingface.co/circlestone-labs/Anima/tree/main/split_files/vae">qwen_image_vae.safetensors</a> goes in <code>ComfyUI/models/vae</code></li></ul>Generation SettingsThese are the settings used for the sample images above (ComfyUI, <code>ModelSamplingAuraFlow</code> node):<ul><li>Shift: 5.0</li><li>Steps: 28</li><li>CFG: 4.0</li><li>Sampler: <code>er_sde</code></li><li>Scheduler: simple</li></ul>These are just my usual settings — feel free to experiment and really go buck wild with it, euler a at same steps and <code>sa_solver_pece</code> at a lower 15–20 steps also recommended.PromptingLike the base model, this model is trained on booru-style tags and natural language captions.Quality and Aesthetic tags + Negatives (same as base model)<span style="background-color:rgb(11, 15, 25);color:rgb(179, 188, 201);font-family:&quot;Source Sans Pro&quot;, -apple-system, BlinkMacSystemFont, &quot;Segoe UI&quot;, Roboto, &quot;Helvetica Neue&quot;, &quot;Noto Sans&quot;, Arial, sans-serif, &quot;Apple Color Emoji&quot;, &quot;Segoe UI Emoji&quot;, &quot;Segoe UI Symbol&quot;, &quot;Noto Color Emoji&quot;;font-size:16.8px">masterpiece, best quality, score_7, safe<span style="background-color:rgb(11, 15, 25);color:rgb(179, 188, 201);font-family:&quot;Source Sans Pro&quot;, -apple-system, BlinkMacSystemFont, &quot;Segoe UI&quot;, Roboto, &quot;Helvetica Neue&quot;, &quot;Noto Sans&quot;, Arial, sans-serif, &quot;Apple Color Emoji&quot;, &quot;Segoe UI Emoji&quot;, &quot;Segoe UI Symbol&quot;, &quot;Noto Color Emoji&quot;;font-size:16.8px">worst quality, low quality, score_1, score_2, score_3, artist name, blurry, jpeg artifacts<span style="background-color:rgb(11, 15, 25);color:rgb(179, 188, 201);font-family:&quot;Source Sans Pro&quot;, -apple-system, BlinkMacSystemFont, &quot;Segoe UI&quot;, Roboto, &quot;Helvetica Neue&quot;, &quot;Noto Sans&quot;, Arial, sans-serif, &quot;Apple Color Emoji&quot;, &quot;Segoe UI Emoji&quot;, &quot;Segoe UI Symbol&quot;, &quot;Noto Color Emoji&quot;;font-size:16.8px">or anything you prefer.Known Limitations &amp; Issues:<ul><li>Some instability is noticeable when using short prompts, this behavior is similar to the base model and several other finetunes.</li><li>Slightly degraded text performance from some of my initial testing and personal experience.</li><li>Mentioned above, artist tags are not as faithful as I hope, the model seems to diverge a bit and have a orange bias.</li></ul>There are probably more but I haven't got enough uses on this model myself to completely explore. If you guys encounter major quirks or problems, do tell in the comments, I do actively read them and knowing there are problems means I can learn from it and solve it in future projects.RecognitionsBeeg thanks to:<ul><li><a target="_blank" rel="ugc" href="https://huggingface.co/circlestone-labs">CircleStone Labs</a> — for Anima and the original diffusion-pipe trainer</li><li><a target="_blank" rel="ugc" href="https://civarchive.com/user/motimalu">Motimalu</a> — Inspiration behind finetuning practices and configs, his diary was such a huge help for a completely beginner like me to get an idea behind how finetuning a model looks like</li><li><a target="_blank" rel="ugc" href="https://github.com/bluvoll/diffusion-pipe">Bluvoll</a> — diffusion-pipe fork used for training, and general training advice</li><li><a target="_blank" rel="ugc" href="https://huggingface.co/Anzhc">Anzhc</a> — general training advice</li><li><a target="_blank" rel="ugc" href="https://www.reddit.com/user/akanyan/">Akanyan</a> — for the goated collection of anime screencap from 9 years ago</li><li><a target="_blank" rel="ugc" href="https://gpu.garden/">Astromahdi</a> — compute via <a target="_blank" rel="ugc" href="http://gpu.garden">gpu.garden</a></li><li><a target="_blank" rel="ugc" href="https://github.com/kohakublueleaf/lycoris">KohakuBlueleaf</a> — LyCoRIS / LoKr library</li><li><a target="_blank" rel="ugc" href="https://huggingface.co/animetimm/convnextv2_huge.dbv4-full">animetimm/DeepGHS</a> — tagging model</li><li>Model description format inspired by <a target="_blank" rel="ugc" href="https://civarchive.com/models/2495369/kirazuri-anima">Motimalu's</a></li></ul>LicenseThis model is released under the same license as the base model.See the base model for details of the <a target="_blank" rel="ugc" href="https://huggingface.co/circlestone-labs/Anima/blob/main/LICENSE.md">CircleStone Labs Non-Commercial License.</a> Built on NVIDIA Cosmos

Files with SHA256: 4a76634d04ea5f632ddfda3e33dbe16cd5cff92849ccdf766e57494dfa677769