Rituraj Singh

Debjyoti Mondal, Suraj Modi, Subhadarshi Panda et al.

Large Language Models (LLMs) have demonstrated impressive performance in natural language processing tasks by leveraging chain of thought (CoT) that enables step-by-step thinking. Extending LLMs with multimodal capabilities is the recent interest, but incurs computational cost and requires substantial hardware resources. To address these challenges, we propose KAM-CoT a framework that integrates CoT reasoning, Knowledge Graphs (KGs), and multiple modalities for a comprehensive understanding of multimodal tasks. KAM-CoT adopts a two-stage training process with KG grounding to generate effective rationales and answers. By incorporating external knowledge from KGs during reasoning, the model gains a deeper contextual understanding reducing hallucinations and enhancing the quality of answers. This knowledge-augmented CoT reasoning empowers the model to handle questions requiring external context, providing more informed answers. Experimental findings show KAM-CoT outperforms the state-of-the-art methods. On the ScienceQA dataset, we achieve an average accuracy of 93.87%, surpassing GPT-3.5 (75.17%) by 18% and GPT-4 (83.99%) by 10%. Remarkably, KAM-CoT achieves these results with only 280M trainable parameters at a time, demonstrating its cost-efficiency and effectiveness.

Arijit Ukil, Soma Bandyopadhyay, Chetanya Puri et al.

Computational analysis on physiological signals would provide immense impact for enabling automated clinical analytics. However, the class imbalance issue where negative or minority class instances are rare in number impairs the robustness of the practical solution. The key idea of our approach is intelligent augmentation of minority class examples to construct smooth, unbiased decision boundary for robust semi-supervised learning. This solves the practical class imbalance problem in anomaly detection task for computational clinical analytics using physiological signals. We choose two critical cardiac marker physiological signals: Heart sound or Phonocardiogram (PCG) and Electrocardiogram (ECG) to validate our claim of robust anomaly detection of clinical events under augmented class learning, where intelligent synthesis of minority class instances attempt to balance the class distribution. We perform extensive experiments on publicly available expert-labelled MIT-Physionet PCG and ECG datasets that establish high performance merit of the proposed scheme, and our scheme fittingly performs better than the state-of-the-art algorithms.