泠鸢yousa吧 关注:22,246贴子:328,056

[Ai]自制 泠鸢yousa SDXL LoRA模型v1.1发布

只看楼主收藏回复




IP属地:江苏1楼2024-03-28 21:45回复
    距离上次SD1.5的v1.00模型发布已将近1年,其实之后也时不时在不同的大模型上训练LoRA模型,但始终没有一个令我满意的。直到上个月我才意识到并不是我训练的LoRA有什么大问题,而是我的测试Prompt过于简单而没有对生成图像有过多干预。我曾经想过更新几个小版本,但在SDXL1.0发布后大半年仍在SD1.5LoRA上修修补补实在是有些跟不上时代,所以年初我去了解一下SDXL的特性及不同大模型的优缺点及SDXL的LoRA的训练方法。
    终于在SDXL大模型发布大半年后我又制作了基于SDXL1.0训练的v1.1模型。 本次发布的SDXL LoRA模型共使用145张图片,所有图片均为官方配布MMD模型不同动作的截图,(部分训练图片如图1、图2所示)。本人发布此模型仅用于爱好者的学习和讨论,严禁商用和公开的非法内容的传播以及对原创画师、其他模型作者的踩一捧一。


    IP属地:江苏2楼2024-03-28 21:48
    回复
      v1.1模型与v1.00模型模型的主要区别:
      1、使用底模从SD1.5升级到SDXL,使得LoRA的身体姿势、手脚准确性、对文字的识别均有较大幅度的提升。
      2、训练集的基础分辨率从768x768升级为1024x1024。
      3、修改更正了触发词,为逗猫辫单独标注了触发词,使得它更易出现(不同mmd发型有区别,所以有的服装的逗猫辫较难触发)。
      4、泛化度与SD1.5相比存在下降,但本质原因是不同SDXL大模型的训练参数及层级都不同引起的。


      IP属地:江苏3楼2024-03-28 21:49
      回复
        本次LoRA模型使用的底模是sdxl_base_1.0。作为最初的SDXL模型,其拥有很多融合模型,本身质量也很高。在不同的11个SDXL1.0模型中,经过我的测试,本次发布的LoRA模型具有较好的泛化度,可以触发人物与不同服装。但也有个别例外,比如:CounterfeitXL_v2.5、kohakuXLDelta...它们可以触发人物但无法触发服装。本LoRA模型不兼容Pony及其融合模型,后续可能会更新基于tPonynai3_v30的LoRA模型。
        本模型共包含8个训练得较好的服装:
        1、石英式泠鸢yousa(对应Prompt: yousa, yousa_Origin, DMB_hair, Origin_hair_ornament, Origin_suits, Origin_single_leg_ring, Origin_footwear)
        2、登门喜鹊(对应Prompt: yousa, yousa_MagpiesVisit, DMB_hair, MagpiesVisit_hair_ornament, MagpiesVisit_gloves, MagpiesVisit_suits, MagpiesVisit_single_leg_ring, MagpiesVisit_footwear)
        3、海盐柠檬(对应Prompt: yousa, yousa_SeaSaltLemon, SeaSaltLemon_minihat, SeaSaltLemon_earrings, SeaSaltLemon_suits, SeaSaltLemon_single_leg_ring, SeaSaltLemon_footwear)
        4、随舰海鸥(对应Prompt: yousa, yousa_WithShipSeagull, DMB_hair, WithShipSeagull_hat, WithShipSeagull_hair_ornament, WithShipSeagull_suits, WithShipSeagull_footwear)
        5、披风朋克(但没有披风)(对应Prompt: yousa, yousa_Punk, DMB_hair, Punk_hair_ornament, Punk_suits, Punk_stockings, Punk_footwear)
        6、舞台之星(对应Prompt: yousa, yousa_StageStar, DMB_hair, StageStar_hat, StageStar_suits, StageStar_single_leg_ring, StageStar_footwear)
        7、小红鸢石英式(洛丽塔)(对应Prompt: yousa, yousa_LittleKite, DMB_hair, LittleKite_hair_ornament, LittleKite_earrings, LittleKite_suits, LittleKite_socks, LittleKite_footwear)
        8、时光标记(对应Prompt: yousa, yousa_TimeMark, DMB_hair, TimeMark_hair_ornament, TimeMark_earrings, TimeMark_single_gloves, TimeMark_suits, TimeMark_footwear)
        以上服饰皆可通过 yousa_服饰名(例如yousa_Origin、yousa_SeaSaltLemon)来进行调用,其他服饰部件可搭配使用,但需要注意可能会影响背景及其他细节。
        11种不同SDXL1.0模型的泛化度测试,均使用相同的正面提示词、负面提示词、CFG、采样方法、步数、随机种子。可触发人物及服装的进行过相同参数的高清修复。结果如图3所示。


        IP属地:江苏4楼2024-03-28 21:50
        回复
          建议权重设置为0.6~1,采样方法和迭代步数请根据实际情况自行调整,推荐使用Hires. fix或Tiled Diffusion + Tiled VAE 或Ultimate SD upscale进行图片放大。


          IP属地:江苏5楼2024-03-28 21:51
          回复

            Prompt: lora:sdxl_base_yousa v1.1:1, masterpiece, best quality, yousa, yousa_TimeMark, 1girl, solo, red eyes, DMB_hair, (TimeMark_hair_ornament:1.2), single gloves, TimeMark_single_gloves, (TimeMark_suits:1.5), looking at viewer, roses, petals, night background, fireflies, light particle
            Negative prompt: (low quality, worst quality:1.4), negativeXL_D, cgi, text, signature, watermark, extra limbs
            Steps: 24, Sampler: Euler a, CFG scale: 6, Seed: 1999988850, Size: 2560x4096, Model hash: d48c2391e0, Model: aamXLAnimeMix_v10, VAE hash: 63aeecb90f, VAE: sdxl_vae.safetensors, Denoising strength: 0.35, Clip skip: 2, ENSD: 31337, Tiled Diffusion upscaler: R-ESRGAN 4x+ Anime6B, Tiled Diffusion scale factor: 2, Tiled Diffusion: {"Method": "Mixture of Diffusers", "Tile tile width": 128, "Tile tile height": 128, "Tile Overlap": 16, "Tile batch size": 8, "Upscaler": "R-ESRGAN 4x+ Anime6B", "Upscale factor": 2, "Keep input size": true}, Lora hashes: "sdxl_base_yousa v1.1: b1823ef0b6b2", TI hashes: "negativeXL_D: fff5d51ab655, negativeXL_D: fff5d51ab655", Downcast alphas_cumprod: True, Version: v1.8.0


            IP属地:江苏6楼2024-03-28 21:52
            回复

              Prompt: lora:sdxl_base_yousa v1.1:0.8, masterpiece, best quality, yousa, yousa_MagpiesVisit, 1girl, solo, red eyes, DMB_hair, MagpiesVisit_hair_ornament, MagpiesVisit_gloves, (MagpiesVisit_suits:1.2), looking at viewer, cloudy sky, lake, forest, mountain
              Negative prompt: (low quality, worst quality:1.4), negativeXL_D, cgi, text, signature, watermark, extra limbs
              Steps: 30, Sampler: Euler a, CFG scale: 6, Seed: 2198758036, Size: 2560x4096, Model hash: 43c75e6831, Model: kohakuXLBeta_beta7, VAE hash: 63aeecb90f, VAE: sdxl_vae.safetensors, Denoising strength: 0.37, Clip skip: 2, ENSD: 31337, Tiled Diffusion upscaler: R-ESRGAN 4x+ Anime6B, Tiled Diffusion scale factor: 2, Tiled Diffusion: {"Method": "Mixture of Diffusers", "Tile tile width": 128, "Tile tile height": 128, "Tile Overlap": 16, "Tile batch size": 8, "Upscaler": "R-ESRGAN 4x+ Anime6B", "Upscale factor": 2, "Keep input size": true}, Lora hashes: "sdxl_base_yousa v1.1: b1823ef0b6b2", TI hashes: "negativeXL_D: fff5d51ab655, negativeXL_D: fff5d51ab655", Downcast alphas_cumprod: True, Version: v1.8.0


              IP属地:江苏7楼2024-03-28 21:52
              回复

                Prompt: lora:sdxl_base_yousa v1.1:0.9, masterpiece, best quality, yousa, yousa_Origin, 1girl, solo, red eyes, DMB_hair, Origin_hair_ornament, (Origin_suits:1.2), looking at viewer, dusk,in spring, stars, in the rain, the top of the hill, beautiful flowers
                Negative prompt: (low quality, worst quality:1.4), negativeXL_D, cgi, text, signature, watermark, extra limbs
                Steps: 24, Sampler: Euler a, CFG scale: 4.5, Seed: 2916549401, Size: 4096x2560, Model hash: 3e704e365b, Model: reproductionSDXL_2v12, VAE hash: 63aeecb90f, VAE: sdxl_vae.safetensors, Denoising strength: 0.37, Clip skip: 2, ENSD: 31337, Tiled Diffusion upscaler: sudo_RealESRGAN2x_3.332.758_G, Tiled Diffusion scale factor: 2, Tiled Diffusion: {"Method": "Mixture of Diffusers", "Tile tile width": 128, "Tile tile height": 128, "Tile Overlap": 16, "Tile batch size": 8, "Upscaler": "sudo_RealESRGAN2x_3.332.758_G", "Upscale factor": 2, "Keep input size": true}, Lora hashes: "sdxl_base_yousa v1.1: b1823ef0b6b2", TI hashes: "negativeXL_D: fff5d51ab655, negativeXL_D: fff5d51ab655", Downcast alphas_cumprod: True, Version: v1.8.0


                IP属地:江苏8楼2024-03-28 21:53
                回复

                  Prompt: lora:sdxl_base_yousa v1.1:0.9, masterpiece, best quality, yousa, yousa_StageStar, 1girl, solo, red eyes, DMB_hair, StageStar_hair_ornament, (StageStar_suits:1.2), looking at viewer, city, street, night, night sky
                  Negative prompt: (low quality, worst quality:1.4), negativeXL_D, cgi, text, signature, watermark, extra limbs
                  Steps: 30, Sampler: Euler a, CFG scale: 4.5, Seed: 3307054641, Size: 2560x4096, Model hash: 3e704e365b, Model: reproductionSDXL_2v12, VAE hash: 63aeecb90f, VAE: sdxl_vae.safetensors, Denoising strength: 0.37, Clip skip: 2, ENSD: 31337, Tiled Diffusion upscaler: sudo_RealESRGAN2x_3.332.758_G, Tiled Diffusion scale factor: 2, Tiled Diffusion: {"Method": "Mixture of Diffusers", "Tile tile width": 128, "Tile tile height": 128, "Tile Overlap": 16, "Tile batch size": 8, "Upscaler": "sudo_RealESRGAN2x_3.332.758_G", "Upscale factor": 2, "Keep input size": true}, Lora hashes: "sdxl_base_yousa v1.1: b1823ef0b6b2", Downcast alphas_cumprod: True, Version: v1.8.0


                  IP属地:江苏9楼2024-03-28 21:54
                  回复

                    Prompt: lora:sdxl_base_yousa v1.1:0.8, masterpiece, best quality, yousa, yousa_LittleKite, 1girl, solo, red eyes, DMB_hair, LittleKite_hair_ornament, (LittleKite_suits:1.2), looking at viewer, cloudy, desert
                    Negative prompt: (low quality, worst quality:1.4), negativeXL_D, cgi, text, signature, watermark, extra limbs
                    Steps: 24, Sampler: Euler a, CFG scale: 6, Seed: 3777623968, Size: 4096x2560, Model hash: d48c2391e0, Model: aamXLAnimeMix_v10, VAE hash: 63aeecb90f, VAE: sdxl_vae.safetensors, Denoising strength: 0.37, Clip skip: 2, ENSD: 31337, Tiled Diffusion upscaler: sudo_RealESRGAN2x_3.332.758_G, Tiled Diffusion scale factor: 2, Tiled Diffusion: {"Method": "Mixture of Diffusers", "Tile tile width": 128, "Tile tile height": 128, "Tile Overlap": 16, "Tile batch size": 8, "Upscaler": "sudo_RealESRGAN2x_3.332.758_G", "Upscale factor": 2, "Keep input size": true}, Lora hashes: "sdxl_base_yousa v1.1: b1823ef0b6b2", Downcast alphas_cumprod: True, Version: v1.8.0


                    IP属地:江苏10楼2024-03-28 21:55
                    回复

                      Prompt: lora:sdxl_base_yousa v1.1:0.8, masterpiece, best quality, cute, yousa, yousa_SeaSaltLemon, 1girl, solo, red eyes, DMB_hair, SeaSaltLemon_minihat, (SeaSaltLemon_suits:1.2), looking at viewer, full body, leaf, plant
                      Negative prompt: (low quality, worst quality:1.4), negativeXL_D, cgi, text, signature, watermark, extra limbs
                      Steps: 24, Sampler: Euler a, CFG scale: 7, Seed: 2554096243, Size: 2560x4096, Model hash: d48c2391e0, Model: aamXLAnimeMix_v10, VAE hash: 63aeecb90f, VAE: sdxl_vae.safetensors, Denoising strength: 0.35, Clip skip: 2, ENSD: 31337, Tiled Diffusion upscaler: sudo_RealESRGAN2x_3.332.758_G, Tiled Diffusion scale factor: 2, Tiled Diffusion: {"Method": "Mixture of Diffusers", "Tile tile width": 128, "Tile tile height": 128, "Tile Overlap": 16, "Tile batch size": 8, "Upscaler": "sudo_RealESRGAN2x_3.332.758_G", "Upscale factor": 2, "Keep input size": true}, Lora hashes: "sdxl_base_yousa v1.1: b1823ef0b6b2", Downcast alphas_cumprod: True, Version: v1.8.0


                      IP属地:江苏11楼2024-03-28 21:55
                      回复

                        Prompt: lora:sdxl_base_yousa v1.1:0.9, masterpiece, best quality, yousa, yousa_Punk, 1girl, solo, DMB_hair, Punk_hair_ornament, (Punk_suits:1.2), looking at viewer, cafe, corner cafe, room corner, corner room, hang out, tables, chairs, sofas, pillows, window views, comfortable, coffee cups
                        Negative prompt: (low quality, worst quality:1.4), negativeXL_D, cgi, text, signature, watermark, extra limbs
                        Steps: 24, Sampler: Euler a, CFG scale: 7, Seed: 2017890991, Size: 2560x4096, Model hash: d48c2391e0, Model: aamXLAnimeMix_v10, VAE hash: 63aeecb90f, VAE: sdxl_vae.safetensors, Denoising strength: 0.38, Clip skip: 2, ENSD: 31337, Tiled Diffusion upscaler: sudo_RealESRGAN2x_3.332.758_G, Tiled Diffusion scale factor: 2, Tiled Diffusion: {"Method": "Mixture of Diffusers", "Tile tile width": 128, "Tile tile height": 128, "Tile Overlap": 16, "Tile batch size": 8, "Upscaler": "sudo_RealESRGAN2x_3.332.758_G", "Upscale factor": 2, "Keep input size": true}, Lora hashes: "sdxl_base_yousa v1.1: b1823ef0b6b2", TI hashes: "negativeXL_D: fff5d51ab655, negativeXL_D: fff5d51ab655", Downcast alphas_cumprod: True, Version: v1.8.0


                        IP属地:江苏12楼2024-03-28 21:56
                        回复

                          Prompt: lora:sdxl_base_yousa v1.1:0.9, masterpiece, best quality, yousa, yousa_WithShipSeagull, 1girl, solo, red eyes,DMB_hair, WithShipSeagull_hair_ornament, (WithShipSeagull_suits:1.2), looking at viewer, beach, night, galaxy
                          Negative prompt: (low quality, worst quality:1.4), negativeXL_D, cgi, text, signature, watermark, extra limbs
                          Steps: 24, Sampler: Euler a, CFG scale: 5.5, Seed: 451219278, Size: 4096x2560, Model hash: d48c2391e0, Model: aamXLAnimeMix_v10, VAE hash: 63aeecb90f, VAE: sdxl_vae.safetensors, Denoising strength: 0.37, Clip skip: 2, ENSD: 31337, Tiled Diffusion upscaler: R-ESRGAN 4x+ Anime6B, Tiled Diffusion scale factor: 2, Tiled Diffusion: {"Method": "Mixture of Diffusers", "Tile tile width": 128, "Tile tile height": 128, "Tile Overlap": 16, "Tile batch size": 8, "Upscaler": "R-ESRGAN 4x+ Anime6B", "Upscale factor": 2, "Keep input size": true}, Lora hashes: "sdxl_base_yousa v1.1: b1823ef0b6b2", TI hashes: "negativeXL_D: fff5d51ab655, negativeXL_D: fff5d51ab655", Downcast alphas_cumprod: True, Version: v1.8.0


                          IP属地:江苏13楼2024-03-28 21:57
                          回复
                            * *若您使用此模型,则表明您已阅读并愿意遵守以下使用规约 **
                            1.严禁用此模型参与任何盈利和商业性质活动和内容制作。
                            2.严禁用此模型参与政治、血腥、暴力、色情、反社会、宗教传播性质的内容制作。
                            3.严禁用此模型进行侮辱性或猎奇的创作,严禁用于任何损害泠鸢yousa名誉的行为。
                            4.任何由于不当使用此模型产生的后果由使用者自行承担,与模型训练者无关。


                            IP属地:江苏14楼2024-03-28 21:57
                            回复
                              b站专栏地址 https://www.bilibili.com/read/cv33456222/
                              c站下载地址 https://civitai.com/models/371986
                              网盘下载地址放在本层。大家如果可以,去b站专栏或者c站点点赞,限流严重都没多少人看到


                              IP属地:江苏15楼2024-03-28 22:00
                              收起回复