Rachel Grange

LG
3papers
6citations
Novelty40%
AI Score39

3 Papers

89.9SIMay 21
Fostering cultural change in research through innovative knowledge sharing, evaluation, and community engagement strategies

Junsuk Rho, Jinn-Kong Sheu, Andrew Forbes et al.

Scientific research needs a system that better values rigorous, reusable contributions. Although open knowledge and FAIR (findable, accessible, interoperable, and reusable) principles, along with coalitions and infrastructures, are accelerating reform, evaluation still often defaults to standardized metrics such as the h-index and journal impact factor. This misalignment still incentivizes quantity over quality, undermining integrity and reproducibility, and making it harder for communities to learn from and build on existing work. In this perspective, we bring together a global community of researchers, funding institutions, industrial partners, and publishers from 14 different countries across the 5 continents to advance ongoing debates on open science and research evaluation. Our contribution to the research practice is to offer an integrative conceptual framework, an open knowledge system, that links knowledge production, validation, assessment, and reuse into a single ecosystem view, and to translate into practical recommendations across key stakeholder roles (researchers, institutions/evaluators, funders, and publishers). By shifting attention from papers and bibliometrics toward reusable knowledge contributions and their validation, the framework highlights concrete levers for cultural change (what to share, when/how to validate, how to support reuse, and what to reward) and offers a practical lens that stakeholders can use to diagnose misaligned incentives and to design reforms that make high-quality, cumulative contributions visible and valued.

OPTICSAug 19, 2022
Nonlinear Optical Data Transformer for Machine Learning

Mustafa Yildirim, Ilker Oguz, Fabian Kaufmann et al.

Modern machine learning models use an ever-increasing number of parameters to train (175 billion parameters for GPT-3) with large datasets to obtain better performance. Bigger is better has been the norm. Optical computing has been reawakened as a potential solution to large-scale computing through optical accelerators that carry out linear operations while reducing electrical power. However, to achieve efficient computing with light, creating and controlling nonlinearity optically rather than electronically remains a challenge. This study explores a reservoir computing (RC) approach whereby a 14 mm long few-mode waveguide in LiNbO3 on insulator is used as a complex nonlinear optical processor. A dataset is encoded digitally on the spectrum of a femtosecond pulse which is then launched in the waveguide. The output spectrum depends nonlinearly on the input. We experimentally show that a simple digital linear classifier with 784 parameters using the output spectrum from the waveguide as input increased the classification accuracy of several databases compared to non-transformed data, approximately 10$\%$. In comparison, a deep digital neural network (NN) with 40000 parameters was necessary to achieve the same accuracy. Reducing the number of parameters by a factor of $\sim$50 illustrates that a compact optical RC approach can perform on par with a deep digital NN.

40.1LGApr 10
Integrated electro-optic attention nonlinearities for transformers

Luis Mickeler, Kai Lion, Alfonso Nardi et al.

Transformers have emerged as the dominant neural-network architecture, achieving state-of-the-art performance in language processing and computer vision. At the core of these models lies the attention mechanism, which requires a nonlinear, non-negative mapping using the Softmax function. However, although Softmax operations account for less than 1% of the total operation count, they can disproportionately bottleneck overall inference latency. Here, we use thin-film lithium niobate (TFLN) Mach-Zehnder modulators (MZMs) as analog nonlinear computational elements to drastically reduce the latency of nonlinear computations. We implement electro-optic alternatives to digital Softmax and Sigmoid, and evaluate their performance in Vision Transformers and Large Language Models. Our system maintains highly competitive accuracy, even under aggressive 4-bit input-output quantization of the analog units. We further characterize system noise at encoding speeds up to 10 GBaud and assess model robustness under various noise conditions. Our findings suggest that TFLN modulators can serve as nonlinear function units within hybrid co-packaged hardware, enabling high-speed and energy-efficient nonlinear computation.