CVDec 7, 2023

DemoCaricature: Democratising Caricature Generation with a Rough Sketch

arXiv:2312.04364v213 citationsh-index: 33CVPR
Originality Incremental advance
AI Analysis

It democratizes caricature generation for enthusiasts by eliminating accessibility barriers, though it is incremental as it builds on existing personalization and editing methods.

The paper tackles the problem of generating personalized caricatures from a photo and a rough sketch, achieving a balance between abstraction and identity while preserving sketch creativity, with results enabling effortless creation by non-artists.

In this paper, we democratise caricature generation, empowering individuals to effortlessly craft personalised caricatures with just a photo and a conceptual sketch. Our objective is to strike a delicate balance between abstraction and identity, while preserving the creativity and subjectivity inherent in a sketch. To achieve this, we present Explicit Rank-1 Model Editing alongside single-image personalisation, selectively applying nuanced edits to cross-attention layers for a seamless merge of identity and style. Additionally, we propose Random Mask Reconstruction to enhance robustness, directing the model to focus on distinctive identity and style features. Crucially, our aim is not to replace artists but to eliminate accessibility barriers, allowing enthusiasts to engage in the artistry.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes