This is an experiment lora only train with 1 image.adamw constant 1e-4 trained with my custom training script <a target="_blank" rel="ugc" href="https://github.com/lrzjason/T2ITrainer">https://github.com/lrzjason/T2ITrainer</a>The lora is a dora with diffusers format.You could load the lora with the custom hunyuanDit pipeline in T2ITrainer.It added the SD3LoraLoaderMixin to the pipeline.Code:lora_state_dict = HunyuanDiTPipeline.lora_state_dict(lora_path)
HunyuanDiTPipeline.load_lora_into_transformer(lora_state_dict,transformer_)

Files with SHA256: fb6685c673a5f219a446300aec60d213b16d87eb9467ce6047cafeaf7d0f4971