CLFeb 26, 2024
From RAGs to riches: Utilizing large language models to write documents for clinical trialsNigel Markey, Ilyass El-Mansouri, Gaetan Rensonnet et al.
This manuscript has now been published: - Link to article on journal website: https://journals.sagepub.com/doi/10.1177/17407745251320806 - Pubmed link: https://pubmed.ncbi.nlm.nih.gov/40013826/
LGMar 5, 2025
TEDDY: A Family Of Foundation Models For Understanding Single Cell BiologyAlexis Chevalier, Soumya Ghosh, Urvi Awasthi et al.
Understanding the biological mechanism of disease is critical for medicine, and in particular drug discovery. AI-powered analysis of genome-scale biological data hold great potential in this regard. The increasing availability of single-cell RNA sequencing data has enabled the development of large foundation models for disease biology. However, existing foundation models either do not improve or only modestly improve over task-specific models in downstream applications. Here, we explored two avenues for improving the state-of-the-art. First, we scaled the pre-training dataset to 116 million cells, which is larger than those used by previous models. Second, we leveraged the availability of large-scale biological annotations as a form of supervision during pre-training. We trained the TEDDY family of models comprising six transformer-based state-of-the-art single-cell foundation models with 70 million, 160 million, and 400 million parameters. We vetted our models on two downstream evaluation tasks -- identifying the underlying disease state of held-out donors not seen during training and distinguishing healthy cells from diseased ones for disease conditions and donors not seen during training. Scaling experiments showed that performance improved predictably with both data volume and parameter count. Our models showed substantial improvement over existing work on the first task and more muted improvements on the second.
41.8CEApr 2
A variationally consistent beam-to-beam point coupling formulation for geometrically exact beam theoriesIvo Steinbrecher, Nora Hagmeyer, Christoph Meier et al.
Slender beam-like structures frequently occur in engineering applications and often interact at discrete locations through joints or connectors. Accurate modeling of such interactions is particularly challenging when different numerical formulations are involved in terms of underlying beam theory, interpolation schemes, and rotation parametrization. In this work, a versatile formulation-independent beam-to-beam point coupling approach is proposed within the framework of the geometrically exact beam theory discretized by the finite element method. The coupling constraints are expressed solely in terms of cross-section kinematics, namely centroid positions and orientations. Suitable generalized deformation measures for positional and rotational coupling are introduced, allowing for general coupling configurations, including relative rotations and non-coincident cross-section centroids in the reference configuration. The contribution of the coupling conditions to the weak form of the balance equations is derived in a variationally consistent manner and can be incorporated directly into the weak form of existing beam finite element models. Constraint enforcement is formulated using a Lagrange multiplier method and a penalty regularization. The proposed approach satisfies key properties such as objectivity, symmetry, and consistency with an stress-free reference configuration. Numerical examples demonstrate the robustness and flexibility of the method for coupling beams with different formulations and discretizations, even when the interaction points are located at arbitrary positions within beam elements.