CVSPOPTICSNov 6, 2024

Prion-ViT: Prions-Inspired Vision Transformers for Temperature prediction with Specklegrams

arXiv:2411.05836v32 citationsh-index: 2
Originality Incremental advance
AI Analysis

This work addresses temperature prediction for environmental monitoring using specklegrams, presenting an incremental improvement with a novel hybrid method.

The paper tackled temperature prediction from complex Fiber Specklegram Sensors data by introducing Prion-ViT, a prion-inspired Vision Transformer model, achieving a mean absolute error of 0.71°C and outperforming models like ResNet and Standard Vision Transformers.

Fiber Specklegram Sensors (FSS) are vital for environmental monitoring due to their high temperature sensitivity, but their complex data poses challenges for predictive models. This study introduces Prion-ViT, a prion-inspired Vision Transformer model, inspired by biological prion memory mechanisms, to improve long-term dependency modeling and temperature prediction accuracy using FSS data. Prion-ViT leverages a persistent memory state to retain and propagate key features across layers, reducing mean absolute error (MAE) to 0.71$^\circ$C and outperforming models like ResNet, Inception Net V2, and Standard Vision Transformers. This paper also discusses Explainable AI (XAI) techniques, providing a perspective on specklegrams through attention and saliency maps, which highlight key regions contributing to predictions

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes