[ComfyUI]Flux:完美平衡!更适合F1反推模型!30秒速率&1G低显存&CLIP和T5双通道提示&反推和标注皆可用
在之前文章已经过一些LLM智能反推的ComfyUI插件,在AI迅猛发展的当下,技术日新月异层出不穷。今天文章主题将介绍一款更适合于Flux模型的提示词反推。当前版本为,这是专门为ComfyUI的MiaoshouAI Tagger训练的模型。是基于模型的精心微调版本。• 保持了与Joy模型相近的优秀详细的反推提示词能力(实测接近joy性能,但略逊色一筹基于精选的 Civitai 图像和清洗标签数据集
大家好我是安琪!!!
在数字艺术领域,AI绘画技术已经逐渐成为艺术创作的新趋势。现在,ComfyUI的Flux功能结合F1反推模型,为用户提供了完美的平衡,让你在创作中更加得心应手。
Florence2PromptGen简介
在之前文章已经过一些LLM智能反推的ComfyUI插件,在AI迅猛发展的当下,技术日新月异层出不穷。今天文章主题将介绍一款更适合于Flux模型的提示词反推大模型:Florence2PromptGen。当前版本为Florence-2-large-PromptGen v1.5,这是专门为ComfyUI的MiaoshouAI Tagger训练的模型。是基于Microsoft Florence-2模型的精心微调版本。
-
• 保持了与Joy模型相近的优秀详细的反推提示词能力(实测接近joy性能,但略逊色一筹)。基于精选的 Civitai 图像和清洗标签数据集进行微调,生成高度精确和上下文相关的标签。
-
• 仅需最小1G显存可运行(注:JOY需要7G显存运行)
-
• 同时还保持了Microsoft Florence-2模型的快速高效性能(本地测试仅需不到30秒反推时间)。
-
• 支持SD CLIP tag词组、T5自然语言多种反推提示语格式。还增加了CLIP和T5混合提示,能够完全的与Flux双通道相融合
-
• 提供了MiaoshouAI Tagger ComfyUI组件,能够实现自动化快速高级图像标注工具,也可用于Flux炼丹的自动化标注方案。利用 ComfyUI 的节点系统的强大功能,将标注节点连接起来,结合描述性打标和关键词标注以获得最佳效果。
官方演示
Florence2PromptGen ComfyUI体验
官方团队通过精心训练了Florence-2-large-PromptGen v1.5模型,同时还提供了ComfyUI-Miaoshouai-Tagger ComfyUI插件。在插件中集成了一系列COmfyUI节点,特别对Flux定制化MiaoshouAI Flux CLIP Text Encode界面实现提示词双通道介入。无需下载任何模型,首次运行时会自动下载。其中模型包含Base和 Large 两个版本,推荐使用 Large 版本。
- • ComfyUI-Miaoshouai-Tagger插件地址 (需要相关模型的同学可自行扫描获取)
Flux 文生图工作流
Florence2PromptGen工作流
插件新增反推节点如下。这里可以选择多种模型,SD模型使用tag词组方式:SD3类T5自然语言模型使用details方式;Flux更建议选择mixed混合T5和CLIP双通道模式。使用模型建议直接large模型,整体并不耗显存和性能,直接默写large更大精调版本。
01. 出水芙蓉
T5自然语言提示:
a digital illustration in a realistic, hyper-realistic style, depicting a young woman with a serene, ethereal appearance, she has fair skin, large, expressive blue eyes, and long, dark brown hair styled in a loose, elegant updo, her facial features are delicate, with a slight blush on her cheeks and a soft, inviting smile, she wears a white, long-sleeved blouse with a high collar and intricate lace trim, which adds a touch of elegance and softness to her appearance, the blouse is slightly transparent, allowing the viewer to see the delicate petals and the softness of her skin, she is seated in a shallow pool of water, surrounded by white flowers with delicate, white petals, which are partially submerged in the water, creating a tranquil, serene atmosphere, the background is a gradient of soft, pastel green hues, enhancing the ethereal quality of the scene, the overall composition is balanced and harmonious, with the woman’s serene expression and the delicate beauty of the flowers in the background, the illustration is highly detailed, with smooth textures and subtle shading that enhances the realism and depth of the subject’s features, making it appear almost three-dimensional, the image exudes a sense of tranquility and serenity, blending elements of natural beauty and tranquility in a harmonious blend of realism and fantasy (realism)
CLIP词组提示:
korean, 1girl, solo, long hair, looking at viewer, smile, black hair, shirt, long sleeves, jewelry, sitting, closed mouth, white shirt, upper body, flower, earrings, outdoors, water, white flower, lips, fingernails, parted lips, white pants, lily pad
02. 樱花盛开
T5自然语言提示:
a digital illustration in a realistic, semi-realistic style, depicting a young woman with a delicate, ethereal appearance, she has fair skin, large, expressive blue eyes, and long, straight black hair that cascades over her shoulders, her facial features are delicate, with a slight blush on her cheeks and a soft, inviting smile, she is dressed in a traditional white ao dai, a traditional Vietnamese dress with a high collar and long sleeves, adorned with intricate lace and floral patterns, the dress is flowing gracefully, adding a sense of movement and elegance, she holds a large, white parasol with a wooden handle, which is adorned with delicate pink cherry blossom petals, the background features a serene, pastel-colored landscape with a hint of green foliage, suggesting a tranquil, possibly a park or garden setting, the overall color palette is soft and muted, with soft pastel hues that enhance the ethereal quality of the scene, the illustration is highly detailed, with smooth textures and subtle shading, giving it a lifelike quality, the artist’s signature is visible in the bottom right corner, indicating the work’s creator
CLIP词组提示:
1girl, solo, long hair, looking at viewer, blush, black hair, dress, holding, jewelry, closed mouth, standing, flower, earrings, outdoors, sky, day, cloud, white dress, tree, lips, umbrella, white umbrella, cherry blossoms, holding umbrella
03. 金钱袋
T5自然语言提示:
a high-resolution photograph featuring a golden, intricately embroidered pouch with a double happiness symbol in the center, surrounded by floral motifs in pastel colors, the pouch is intricately designed with a smooth, satin-like texture, and it is tied with a thin, golden ribbon at the top, in front of the pouch, a red beaded necklace with white pearls strung around it is placed on a dark surface, possibly a table, the background is a solid black, which contrasts sharply with the golden pouch and beads, creating a striking visual effect, the beads are round and smooth, with a glossy finish, and the pouch itself is adorned with intricate floral patterns in shades of pink, purple, and yellow, adding a touch of elegance to the overall composition, the overall mood is festive and celebratory, likely celebrating the chinese new year, as indicated by the golden coins scattered around the pouch and the vibrant red beads, the texture of the beads and pouch is smooth and polished, enhancing the luxurious and festive feel of the scene
CLIP词组提示:
1girl, solo, closed mouth, flower, blurry, no humans, blurry background, beads, coin, drawstring bag, pearl, red beads
04. 顽强的活下去
T5自然语言提示:
a photograph captures a solitary ant carrying a piece of driftwood during sunset, the ant is positioned on a rocky surface, with its body facing towards the left side of the frame, the background is a gradient of warm, golden hues, transitioning from a deep orange at the top to a bright yellow at the bottom, with the sun partially visible behind it, creating a dramatic, almost ethereal effect, the driftwood is held in place by thin, wooden sticks that are attached to the ant’s legs, forming a bridge-like structure that extends from its head to its antennae, the texture of the wood appears rough and slightly weathered, with visible cracks and crevices, adding to the ruggedness of the surface beneath the ant, the overall mood of the photograph is serene and contemplative, emphasizing the contrast between the natural beauty of the sunset and the stark contrast of the ant and its surroundings, the image exudes a sense of solitude and introspection, as if the ant carries the piece of wood as a symbol of resilience and strength in the face of adversity, the photograph captures the essence of a moment of isolation and resilience in the midst of a natural, untamed landscape during sunset
CLIP词组提示:
solo, outdoors, sky, day, blurry, no humans, sun, blurry background, ant, nature, scenery, sunset, ant on rock
资料软件免费放送
次日同一发放请耐心等待
学好 AI绘画 不论是就业还是做副业赚钱都不错,但要学会 AI绘画 还是要有一个学习规划。最后大家分享一份全套的 AI绘画 学习资料,给那些想学习 AI绘画 的小伙伴们一点帮助!
需要的可以扫描下方CSDN官方认证二维码免费领取【保证100%免费】
**一、AIGC所有方向的学习路线**
AIGC所有方向的技术点做的整理,形成各个领域的知识点汇总,它的用处就在于,你可以按照下面的知识点去找对应的学习资源,保证自己学得较为全面。
二、AIGC必备工具
工具都帮大家整理好了,安装就可直接上手!
三、最新AIGC学习笔记
当我学到一定基础,有自己的理解能力的时候,会去阅读一些前辈整理的书籍或者手写的笔记资料,这些笔记详细记载了他们对一些技术点的理解,这些理解是比较独到,可以学到不一样的思路。
四、AIGC视频教程合集
观看全面零基础学习视频,看视频学习是最快捷也是最有效果的方式,跟着视频中老师的思路,从基础到深入,还是很容易入门的。
五、实战案例
纸上得来终觉浅,要学会跟着视频一起敲,要动手实操,才能将自己的所学运用到实际当中去,这时候可以搞点实战案例来学习。
这份完整版的学习资料已经上传CSDN,朋友们如果需要可以微信扫描下方CSDN官方认证二维码免费领取【保证100%免费】
开放原子开发者工作坊旨在鼓励更多人参与开源活动,与志同道合的开发者们相互交流开发经验、分享开发心得、获取前沿技术趋势。工作坊有多种形式的开发者活动,如meetup、训练营等,主打技术交流,干货满满,真诚地邀请各位开发者共同参与!
更多推荐
所有评论(0)