Speculative Rollback Correction for Quality-Diverse Web Agent ImitationLongkun Hao, Hongyu Lin, Hao Li et al.
Training interactive web agents through imitation learning from expert trajectories has emerged as a highly effective approach. However, determining the optimal timing for expert intervention presents a critical challenge in this context. Delayed intervention often leads to the accumulation of early-stage errors, pushing the page state into an irrecoverable regime. Conversely, premature or excessive intervention causes the agent to become overly reliant on expert policies, trapping the model in local optima characterized by a single, rigid trajectory. We propose Speculative Rollback Correction (SRC), a branch-level imitation framework for resettable agent environments. Instead of requesting teacher labels at every visited state or correcting only after a completed trajectory, SRC uses fixed-horizon branch review: the student executes a short speculative segment before teacher review, and the teacher localizes the first harmful deviation only when local progress breaks. Rollback preserves useful prefixes, while successful rollouts are filtered by a hard verifier and retained in a lightweight quality-diversity archive. The resulting data supports next-action supervised fine-tuning on both localized corrections and verifier-passing trajectories. On WebArena-Infinity, SRC collects 977 verifier-passing trajectories and 9,183 next-action examples; fixed-horizon review improves the recovery-versus-query tradeoff over step-level review while retaining verifier-passing solution variants. Code is available at https://github.com/LongkunHao/SRC_gui_agent.
3.4ITJun 22
Stable Image Reconstruction via Two-Parameter Power-Scale Variation MinimizationZiwei Li, Wengu Chen, Huanmin Ge et al.
In this article, we introduce a power-scale variation (PSV$_{a,p}$) with two tunable parameters: the sparsity-inducing exponent $p\in(0,1]$ and the scaling factor $a\in(0,\infty)$. By minimizing the PSV$_{a,p}$, we establish stable reconstructions in both the gradient and the image domains under the restricted isometry property (RIP) framework. Furthermore, we design an iteratively re-weighted least squares algorithm IRLSPSV to solve the unconstrained PSV$_{a,p}$ minimization. Numerical experiments demonstrate its superior performance and broad applicability. The main novelties are: (i) the PSV$_{a,p}$ minimization enjoys great flexibility and wide applicability due to its two tunable parameters $a$ and $p$, (ii) as $a\to\infty$, the PSV$_{a,p}$ minimization reduces to the $p$-th power total variation (TV$_p$) minimization and, even in this limiting case, the established RIP condition for image reconstruction is also new, (iii) the derived RIP upper bound $\overlineδ$ is proved to be asymptotically optimal in $a$ for gradient recovery, (iv) sensitivity analysis confirms the distinct roles of $a$ and $p$, thereby motivating a practical parameter tuning scheme for the proposed model.
21.9CVJun 15
What Should a Streaming Video Model Remember?Haonan Ge, Yiwei Wang, Hang Wu et al.
Streaming video understanding models must answer queries at any moment during an ongoing stream, using only what they have observed so far and under fixed memory and computation budgets. Existing methods address this by adding memory banks, retrieval modules, or visual token compression to preserve long-range history. However, strong recent-window baselines show that indiscriminate history injection can dilute current-scene perception, suggesting that the key challenge is not whether to use memory, but how to allocate it selectively. We formulate this as budgeted online latent evidence allocation and propose \textbf{SelectStream}, a selective latent-memory framework that keeps the current observation directly visible to a frozen VLM while exposing historical information only through a compact, query-conditioned evidence budget. Three coordinated mechanisms govern when to write, what to preserve, and how to retrieve: surprise-driven adaptive windowing, priority-preserving consolidation, and query-conditioned graph reasoning over a fixed-capacity latent memory graph. Retrieved evidence is calibrated and injected as latent tokens for answer generation, without replaying frames or growing the context with stream length. Experimental results show that SelectStream achieves strong online streaming performance and preserves general video understanding, reaching 82.67\% on StreamingBench, 67.03\% on OVO-Bench, and 74.4\% average accuracy on offline video benchmarks, while outperforming strong recent-window baselines and prior streaming memory methods.