IRJul 4

Beyond Item Order: Temporal Gap Tokenization for Generative Recommendation with Semantic IDs

arXiv:2607.039183.21 citations
Predicted impact top 93% in IR · last 90 daysOriginality Incremental advance
AI Analysis

For sequential recommendation, this work addresses the temporal blindness of existing generative models by incorporating inter-interaction gaps, yielding practical gains in interest drift modeling.

ChronoSID injects temporal signals into semantic-ID-based generative recommendation via time-aware masked auto-encoding and discretized gap tokens, achieving consistent improvements over baselines on Amazon benchmarks, especially in long-gap scenarios.

Semantic-ID-based generative recommendation has recently emerged as a scalable paradigm for sequential recommendation, where each item is represented by a compact sequence of discrete codes and next-item prediction is formulated as code generation. Existing methods, however, typically construct user histories as sequences of static item identifiers, leaving the elapsed time between consecutive interactions outside the generative input. This temporal blindness is problematic because inter-interaction gaps provide useful cues about interest continuity and preference drift. In this paper, we propose ChronoSID, a lightweight temporal augmentation framework for semantic-ID-based generative recommendation. ChronoSID injects temporal signals into the standard three-stage semantic-ID pipeline from two complementary perspectives. First, we introduce Time-Aware Field-Aware Masked Auto-Encoding (TA-FAMAE), which regularizes item representation learning with an auxiliary time-gap prediction objective. Second, we discretize historical interaction intervals into fixed log-scale gap tokens and interleave them with semantic ID tuples as the encoder input of the sequence-to sequence generator. This design preserves the compact SID generation paradigm while enabling the model to capture time-aware transition patterns. Experiments on Amazon review benchmarks show that ChronoSID consistently improves over ReSID and other competitive generative recommendation baselines. Ablation studies further verify the contribution of both temporal components, and diagnostic analyses show clearer gains under long-gap scenarios where user interests are more likely to drift.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes