WithEveryone: Unified Planning and Identity Grounding for Group Image Generation

arXiv:2608.203362026-08-19

Before drawing a group photo, this AI first plans who goes where, and that cuts down face mix-ups

AI models that generate group photos from multiple reference faces tend to mix up identities or produce obvious copy-paste artifacts once the group grows to five to ten people. WithEveryone fixes this by first planning who appears, where, and in what pose before rendering the image, and by supervising each person's identity directly using the planned face location instead of relying on shaky face-matching during training. As a result, it reached a face similarity of 0.499 versus GPT-Image 2's 0.462, while slashing copy-paste artifacts from 0.169 to 0.055.

What they did

Prior methods struggle to keep track of which generated face belongs to which reference once several people are in one scene, causing identities to blend together during training
WithEveryone gives each person a dedicated identity token and, before generating the image, autoregressively predicts a structured plan (Layout CoT) covering positions, poses, and identity-to-person bindings, then renders that plan as a visual condition
Its core technique, the Layout-Grounded ID Loss, supervises each identity using the annotated face region from the plan instead of unstable embedding-based face matching, avoiding the confusion that occurs when many faces look similar during noisy training steps
On a five-to-ten-person benchmark, it achieved the highest identity similarity in the target image (0.499), covered 97.3% of requested identities, and kept the duplicate-face rate to just 2.8%
It also had the lowest copy-paste artifact score (0.055) among compared systems, showing the similarity comes from genuine likeness rather than pasting reference faces directly

Figure 1: Overview of WithEveryone. WithEveryone generates coherent group images from five to ten reference identities. A single model reasons about which references participate, plans identity–layout bindings, person regions, and poses, and generates the image conditioned on that plan, so identity and composition are decided in one context rather than by separate modules.

Figure 2: Group images generated by WithEveryone. The samples cover different group sizes, scene types, and visual styles.

Table 1: Quantitative comparison on our 5–10-person benchmark. All models are scored on the same 210 examples, and the identity similarities are averaged over the three face encoders of the main protocol. Coverage is the fraction of references whose best-matching generated face reaches a similarity of 0.20, and Dup the fraction that collapse onto a face already claimed by another identity. , , and mark the first-, second-, and third-best results; for Copy-Paste only the three methods with the highest Sim(Ref) are ranked, since lower similarity means less copying naturally.
Method	Identity Similarity	Identity Coverage	Generation Quality
Sim(Tgt) ↑	Sim(Ref) ↑	Copy-Paste ↓	Coverage ↑	Dup ↓	CLIP-I ↑	DINO-I ↑	CLIP-T ↑
Academic identity-preserving methods
WithAnyone	0.405	0.483	0.096	0.957	0.045	0.807	0.695	0.281
UMO	0.371	0.484	0.112	0.630	0.258	0.780	0.663	0.286
UniPortrait	0.339	0.464	0.115	0.635	0.187	0.679	0.415	0.301
DreamO	0.297	0.331	0.027	0.298	0.299	0.724	0.611	0.282
ID-Patch	0.225	0.259	0.032	0.247	0.224	0.609	0.320	0.331
Open-source general-purpose models
FLUX.2 Klein	0.264	0.265	0.002	0.314	0.265	0.787	0.685	0.291
Qwen-Image-Edit	0.253	0.289	0.018	0.176	0.291	0.614	0.312	0.227
LongCat-Image-Edit	0.287	0.288	−0.001	0.381	0.264	0.802	0.657	0.288
OmniGen2	0.267	0.275	−0.002	0.418	0.267	0.774	0.633	0.288
SenseNova U1	0.253	0.243	−0.009	0.213	0.256	0.797	0.686	0.289
BAGEL	0.223	0.225	0.003	0.136	0.276	0.752	0.635	0.282
HiDream-O1	0.353	0.376	0.026	0.780	0.190	0.806	0.692	0.286
Proprietary systems
Nano Banana Pro	0.453	0.478	0.041	0.674	0.148	0.839	0.712	0.275
Nano Banana 2	0.451	0.480	0.045	0.884	0.099	0.860	0.731	0.276
GPT-Image 2	0.462	0.583	0.169	0.905	0.075	0.853	0.719	0.270
Seedream 4.5	0.407	0.495	0.114	0.859	0.175	0.829	0.698	0.286
Seedream 5.0 Pro	0.436	0.522	0.114	0.913	0.065	0.850	0.715	0.275
WithEveryone	0.499	0.540	0.055	0.973	0.028	0.861	0.716	0.273

Figure 3: Overview of WithEveryone. The model loads selected reference identities as ID tokens, predicts structured Layout CoT, renders a visual layout condition, and predicts identity representations before generating the target group image. Modality-switch tokens that mark the boundaries between autoregressive reasoning and flow-based image generation are used in the sequence but omitted from the figure.

Figure 4: Data statistics, pipeline, and example. We report the distributions of identity occurrence frequency, reference count, and real photographs versus collage and poster images; the data-construction pipeline; and an example training sample. The corpus contains 400K group-image samples, and the reference-count distribution covers the five-to-ten-person range used at evaluation time.

Table 3: Dispersion of the main comparison. Per-example means on the 210 benchmark examples with their standard errors. The last column is the single-encoder ArcFace similarity to the references used in Section 4.2.
Method	Sim(Tgt) ↑	Sim(Ref) ↑	CLIP-I ↑	ArcFace Sim(Ref) ↑
WithEveryone	0.499±0.004	0.540±0.004	0.861±0.004	0.614±0.005
GPT-Image 2	0.462±0.004	0.583±0.008	0.853±0.004	0.566±0.009
Nano Banana 2	0.451±0.005	0.480±0.007	0.860±0.004	0.471±0.008
Seedream 5.0 Pro	0.436±0.005	0.522±0.008	0.850±0.004	0.506±0.009

Figure 6: Qualitative comparison with proprietary models. , , and mark faces that reproduce a person already generated elsewhere in the image, that are not recognizable as their bound reference, and that appear transplanted without adapting to the pose, lighting, or viewpoint of the scene. These author annotations are illustrative; their quantitative counterparts are the duplicate rate, Sim(Ref), and Copy-Paste.

Figure 7: Identity similarity against face size. Curves are local means with 95% confidence bands, annotated with the fitted slope. The lower panel of (a) shows the distribution of relative face size for each group size, and the lower panel of (b) shows the face-size distribution of each system.

Table 4: High-resolution comparison. The first two rows use the same internal pipeline; the last row uses the main 2K benchmark pipeline.
Train / test	Sim(Ref) ↑	Sim(Tgt) ↑	Layout∗ ↑	Plan IoU ↑
1K / 1K	0.546	0.460	0.740	0.773
2K / 1K	0.555	0.461	0.759	0.814
2K / 2K†	0.614	0.511	–	–

(b) Absolute face size in pixels; the dashed line marks 112 px, the input resolution of the ArcFace encoder, below which a face has to be upsampled before it can be compared.

Figure 10: Additional group images generated by WithEveryone.

Table 5: Effect of the LG-ID Loss. It gives the largest individual identity gain while preserving or improving all reported layout measures.
Variant	Sim(Ref) ↑	Sim(Tgt) ↑	Layout ↑	Count ↑	Coverage ↑
Default	0.339	0.304	0.690	0.771	0.741
+ ID Loss	0.506	0.435	0.700	0.845	0.947
Full	0.555	0.461	0.759	0.869	0.960

Figure 11: Additional group images generated by WithEveryone.

Figure 12: High-resolution training. We compare the Full model trained at 1K and 2K while evaluating both at 1K. The horizontal references in (a) show the final 2K benchmark scores from a different evaluation pipeline.

Why it matters

Demand is growing for AI-generated group photos, posters, and collages featuring many real people, but existing tools degrade sharply as the group size increases. This work shows that planning composition before rendering can genuinely solve the identity-preservation problem at larger group sizes rather than just patching it.

(b) Planning quality and plan execution.

Figure 13: Representation Forcing convergence. The supervised identity prediction is steadily optimized during training and becomes increasingly aligned with both the target and reference identity embeddings.

Terms in this paper

Identity-preserving generation · Generating a new image of a specific person using their reference photo so the output still looks like them
Copy-Paste artifact · A visual glitch where a generated face looks pasted from the reference photo without matching the scene's lighting, pose, or angle
Layout CoT · A step-by-step textual plan predicted before image generation that specifies each person's position, pose, and identity assignment
ArcFace · A face-recognition model that converts a face photo into a numeric vector used to measure similarity between two faces
ID token · A compact signal representing one person's identity information that the model can attend to during generation

Original abstract (English)

Identity-preserving image generation becomes increasingly unreliable when a scene must contain many specified people. Beyond retaining each identity, the model must bind every reference to a distinct person and location, while training-time identity losses must establish correspondence among several noisy predicted faces. We introduce WithEveryone, a unified framework for generating group images up to ten reference identities. WithEveryone injects each selected identity as an addressed token, predicts a structured identity--layout plan, and renders the plan as a visual condition. Its key objective, Layout-Grounded ID Loss, uses annotated face regions to supervise the intended identities directly, avoiding unstable embedding-based face matching; ID Representation Forcing additionally trains a prediction for each identity before image synthesis. On an identity-disjoint benchmark, WithEveryone achieves the highest target-context identity similarity, improving face similarity from 0.462 for GPT-Image-2 to 0.499, while reducing copy-paste artifacts from 0.169 to 0.055. It further covers 97.3\% of the requested identities with a duplicate rate of only 2.8\%. These results show that explicit identity--layout grounding enables identity-preserving generation to scale to larger groups without relying on direct reference-face copying.

Authors · Hengyuan Xu

Read on arXiv

Latest papers

All papers →

Latest from METAL LAB

Figures: Hengyuan Xu et al., arXiv:2608.20336, cc-by-nc-sa-4.0