FLUX.2-based Image Identity Consistency Enhancement

Oct 2026 · 2 min read

Developed during an algorithm internship with the face team at Meitu MT-Lab, this project addresses identity drift in AIGC portrait editing. The module takes an edited portrait and a user reference image as inputs, then refines identity while retaining the intended edit.

I built the data pipeline for face detection, identity clustering, mask generation, canonical alignment, reference matching, and quality filtering. I also designed joint perceptual, identity, and contour objectives for multi-step FLUX.2 LoRA training and developed evaluation tools for identity similarity, facial contour change, and denoising trajectories.

The resulting model improved reference identity similarity across internal test sets and was deployed in the telephoto portrait feature of AI Camera.

Qualitative Results

Frontal Face Reshaping × JJ Lin

Identity Similarity +0.186
Input image for Frontal Face Reshaping × JJ Lin
Input
Reference image for Frontal Face Reshaping × JJ Lin
Reference
Refined output for Frontal Face Reshaping × JJ Lin
Output
Input–Reference 0.410 → Output–Reference 0.596

Half-Profile Face Reshaping × Jackson Yee

Identity Similarity +0.298
Input image for Half-Profile Face Reshaping × Jackson Yee
Input
Reference image for Half-Profile Face Reshaping × Jackson Yee
Reference
Refined output for Half-Profile Face Reshaping × Jackson Yee
Output
Input–Reference 0.561 → Output–Reference 0.859

Strong Stage Lighting × G-Dragon

Identity Similarity +0.389
Input image for Strong Stage Lighting × G-Dragon
Input
Reference image for Strong Stage Lighting × G-Dragon
Reference
Refined output for Strong Stage Lighting × G-Dragon
Output
Input–Reference 0.286 → Output–Reference 0.675

Overall Evaluation

Input → ReferenceOutput → Reference

Identity similarity improves consistently across all three test sets, while pose changes and non-face-region differences remain limited.