CLOct 31, 2023Code
ChipNeMo: Domain-Adapted LLMs for Chip DesignMingjie Liu, Teodor-Dumitru Ene, Robert Kirby et al.
ChipNeMo aims to explore the applications of large language models (LLMs) for industrial chip design. Instead of directly deploying off-the-shelf commercial or open-source LLMs, we instead adopt the following domain adaptation techniques: domain-adaptive tokenization, domain-adaptive continued pretraining, model alignment with domain-specific instructions, and domain-adapted retrieval models. We evaluate these methods on three selected LLM applications for chip design: an engineering assistant chatbot, EDA script generation, and bug summarization and analysis. Our evaluations demonstrate that domain-adaptive pretraining of language models, can lead to superior performance in domain related downstream tasks compared to their base LLaMA2 counterparts, without degradations in generic capabilities. In particular, our largest model, ChipNeMo-70B, outperforms the highly capable GPT-4 on two of our use cases, namely engineering assistant chatbot and EDA scripts generation, while exhibiting competitive performance on bug summarization and analysis. These results underscore the potential of domain-specific customization for enhancing the effectiveness of large language models in specialized applications.
CRAug 25, 2024
SPICED: Syntactical Bug and Trojan Pattern Identification in A/MS Circuits using LLM-Enhanced DetectionJayeeta Chaudhuri, Dhruv Thapar, Arjun Chaudhuri et al.
Analog and mixed-signal (A/MS) integrated circuits (ICs) are crucial in modern electronics, playing key roles in signal processing, amplification, sensing, and power management. Many IC companies outsource manufacturing to third-party foundries, creating security risks such as stealthy analog Trojans. Traditional detection methods, including embedding circuit watermarks or conducting hardware-based monitoring, often impose significant area and power overheads, and may not effectively identify all types of Trojans. To address these shortcomings, we propose SPICED, a Large Language Model (LLM)-based framework that operates within the software domain, eliminating the need for hardware modifications for Trojan detection and localization. This is the first work using LLM-aided techniques for detecting and localizing syntactical bugs and analog Trojans in circuit netlists, requiring no explicit training and incurring zero area overhead. Our framework employs chain-of-thought reasoning and few-shot examples to teach anomaly detection rules to LLMs. With the proposed method, we achieve an average Trojan coverage of 93.32% and an average true positive rate of 93.4% in identifying Trojan-impacted nodes for the evaluated analog benchmark circuits. These experimental results validate the effectiveness of LLMs in detecting and locating both syntactical bugs and Trojans within analog netlists.
SYNov 16, 2016
Single Chip Self-Tunable N-Input N-Output PID Control System with Integrated Analog Front-end for Miniature RoboticsAnindya Shankar Bhandari, Arjun Chaudhuri, Mrigank Sharad
In this work, we explore the design of an integrated, low power single chip multi-channel Proportional-Integral-Derivative (PID) controller for emerging miniature robotics, that includes N inputs and N corresponding outputs thereby resulting in N parallel channels in the control system. It includes analog front-end (AFE) and analog PID controllers for PID parameter tuning based on PSO algorithm. The AFE incorporates adaptive biasing to ensure low power. The PSO is optimized with respect to tuning precision, power and area. This makes it attractive for real-time tuning of multiple miniaturized robotic devices with a single PSO tuning algorithm block assigned for the task. For simulation and testing purposes, we take N as 3 with the channels being defined by their application-ends or plants, namely: dc motor, temperature sensor and gyroscope.
CVOct 29, 2016
Selective De-noising of Sparse-Coloured ImagesArjun Chaudhuri
Since time immemorial, noise has been a constant source of disturbance to the various entities known to mankind. Noise models of different kinds have been developed to study noise in more detailed fashion over the years. Image processing, particularly, has extensively implemented several algorithms to reduce noise in photographs and pictorial documents to alleviate the effect of noise. Images with sparse colours-lesser number of distinct colours in them-are common nowadays, especially in astronomy and astrophysics where black and white colours form the main components. Additive noise of Gaussian type is the most common form of noise to be studied and analysed in majority of communication channels, namely-satellite links, mobile base station to local cellular tower communication channel,et. al. Most of the time, we encounter images from astronomical sources being distorted with noise maximally as they travel long distance from telescopes in outer space to Earth. Considering Additive White Gaussian Noise(AWGN) to be the common noise in these long distance channels, this paper provides an insight and an algorithmic approach to pixel-specific de-noising of sparse-coloured images affected by AWGN. The paper concludes with some essential future avenues and applications of this de-noising method in industry and academia.