FLUX.2-based Image Identity Consistency Enhancement

Thu, 01 Oct 2026 00:00:00 +0000

Developed during an algorithm internship with the face team at Meitu MT-Lab, this project addresses identity drift in AIGC portrait editing. The module takes an edited portrait and a user reference image as inputs, then refines identity while retaining the intended edit.

I built the data pipeline for face detection, identity clustering, mask generation, canonical alignment, reference matching, and quality filtering. I also designed joint perceptual, identity, and contour objectives for multi-step FLUX.2 LoRA training and developed evaluation tools for identity similarity, facial contour change, and denoising trajectories.

The resulting model improved reference identity similarity across internal test sets and was deployed in the telephoto portrait feature of AI Camera.

Qualitative Results

Frontal Face Reshaping × JJ Lin

Identity Similarity +0.186

Input

Reference

Output

Input–Reference 0.410　→　Output–Reference 0.596

Half-Profile Face Reshaping × Jackson Yee

Identity Similarity +0.298

Input

Reference

Output

Input–Reference 0.561　→　Output–Reference 0.859

Strong Stage Lighting × G-Dragon

Identity Similarity +0.389

Input

Reference

Output

Input–Reference 0.286　→　Output–Reference 0.675

Overall Evaluation

0.406

0.680

Celeb-new

+0.274

115 cases, 100.0% improved
Median pose gap 1.8°, non-face MAE 0.060

0.272

0.600

Celeb-old

+0.328

28 cases, 96.4% improved
Median pose gap 1.4°, non-face MAE 0.043

0.338

0.721

Colleague

+0.383

440 cases, 99.8% improved
Median pose gap 3.1°, non-face MAE 0.227

Input → ReferenceOutput → Reference

Identity similarity improves consistently across all three test sets, while pose changes and non-face-region differences remain limited.

Identity Consistency | Yufei Liu's Homepages

FLUX.2-based Image Identity Consistency Enhancement

Qualitative Results

Frontal Face Reshaping × JJ Lin

Half-Profile Face Reshaping × Jackson Yee

Strong Stage Lighting × G-Dragon

Overall Evaluation