The Ultimate Z-Image Turbo, NSFW Character Lora Training Guide (Runpod + Workflow)

The Ultimate Z-Image Turbo, NSFW Character Lora Training Guide (Runpod + Workflow)

Introduction to Zimage Turbo

Overview of Zimage Turbo Model

  • The Zimage Turbo is a new text-to-image AI model developed by Alibaba Group, gaining traction in the open-source image generation community.
  • It boasts high efficiency, producing photorealistic images with only 6 billion parameters, competing with larger commercial models.
  • Known for its high prompt adherence, it effectively follows complex instructions without ignoring parts of prompts.

Workflow and Automation Tools

  • Previous discussions included workflows using automation tools like Nano Banana 2 for creating datasets and face-swapping AI influencers' faces.
  • A full guide on dataset creation and generating trained images is available on a members-only page, encouraging community engagement.

Creating Character Laura

Steps to Create Character Laura Model

  • The first step involves generating a base portrait image of the AI influencer, ideally front-facing for consistency across angles.
  • Recommended workflows include one 2.2 Instagram portrait workflow, Quen image one girl workflow, and using the Zimage Turbo model itself.

Detailed Workflow Instructions

  • For each workflow, users should deploy runpod templates specific to their GPU setup and follow prompts in the guide to generate desired facial images.
  • Each model has unique styles; experimentation is encouraged as no single model is definitively superior.

Training Data Set Creation

Importance of Quality Training Images

  • Creating high-quality dataset images is crucial for training character Laura effectively; quality trumps quantity in this context.
  • Members typically use Cream 4.0 and Nano Banana 2 models for generating diverse facial angles essential for robust training data.

Techniques for Generating Diverse Angles

  • Using specific prompts with Nano Banana 2 can help create variations in facial angles (e.g., turning left or right).
  • Once multiple angle photos are collected, they can be used alongside reference photos for effective face swapping during training.

Creating a Character Model with AI Toolkit

Preparing Facial Photos for AI Influencer

  • Use two consistent facial photos of your AI influencer from Nano Banana 2, taken at different angles. A third reference photo is needed for face swapping.
  • Aim to create at least 20 dataset images that maintain consistent facial features and body type. An automation tool can connect your Dropbox account to make.com for easier image creation.

Automating Dataset Creation

  • Utilize Wavespeed APIs (Nano Banana 2 and Cream 4.0) to automate the dataset image creation process with a single click, significantly reducing manual effort.
  • Guidance on selecting appropriate dataset images is provided in the accompanying guide, along with a manual face swap workflow using flux context if individual creation is preferred.

Generating Captions for Training Images

  • After preparing around 20 training images for the character Laura model, generate caption text files by dragging and dropping photos onto ChatGPT.
  • Use a specific prompt in ChatGPT to analyze images and create captions, ensuring each caption corresponds correctly to its respective image file name.

Training the Character Model

  • The AI toolkit will be used to train the Laura model; captions should include a trigger name followed by descriptions of the images.
  • Launch AI toolkit via the RPMA template link; select an appropriate consumer-grade GPU (e.g., 3090, 4090, or 5090).

Setting Up Training Parameters

  • Create a dataset folder within AI toolkit by naming it appropriately and adding corresponding caption-image pairs.
  • Initiate a new training job by identifying it with a name (e.g., ARA), selecting Z image turbo model architecture, and adjusting VRAM settings as necessary.

Fine-Tuning Training Settings

  • Set training steps between 3,000 to 5,000 based on previous testing results; lower learning rates are recommended for optimal performance.
  • Sample prompts generated through ChatGPT can be utilized every 250 steps during training to monitor progress effectively.

Completing Model Training

  • Differential guidance may be tested against standard methods during training; once completed, all models will appear in the interface.
  • Uploading options include drag-and-drop into Jupyter notebook or alternative methods if upload speeds are slow.

How to Download and Use the Laura Model in Comfy UI

Downloading the Laura Model

  • To download your Laura model, upload it to Hugging Face and retrieve the download link. Use wget followed by the link for a faster and more reliable download into the Comfy/model/Laure folder.

Setting Up in Comfy UI

  • After loading the Rompa template, navigate to the Comfy UI interface. Drag and drop the Z image turbo workflow, which includes a section for loading your character Laura model.

Generating Images with Laura Models

  • An example generation prompt is "Lara Dreamcore in front of a purple Lamborghini." The quality matches that of previous models but benefits from faster generation times.
  • The Z image turbo model requires only eight steps for image generation compared to 50 steps for other models. While this speeds up creation, it may affect image quality.

Upscaling and Quality Considerations

  • For better results, use an upscale method like seed VR2 available to members. This can enhance images generated with lower-quality settings.
  • Consistency issues arise when generating multiple images; backgrounds and facial features may vary. More training data on consistent features could improve results.

Accessing Resources and Community Support

  • A guide for character Laura generation is available through a members-only page or Patreon. If unable to subscribe, joining a community school will provide access to similar resources.
  • The video concludes with an invitation for viewers to engage further as more content will be shared in future updates.
Video description

In this video, I'll share the ultimate guide to train a character lora model on the new NSFW model, Z-Image Turbo Access the Z-Image Turbo Character Training Guide: https://www.skool.com/aiorbust For anyone not able to join Patreon, join Skool to access same resources: https://www.skool.com/aiorbust-9435 Join Our Discord Community or ask questions: https://discord.gg/46rQstKPW2