CLMar 14, 2022
WCL-BBCD: A Contrastive Learning and Knowledge Graph Approach to Named Entity RecognitionRenjie Zhou, Qiang Hu, Jian Wan et al.
Named Entity Recognition task is one of the core tasks of information extraction. Word ambiguity and word abbreviation are important reasons for the low recognition rate of named entities. In this paper, we propose a novel named entity recognition model WCL-BBCD (Word Contrastive Learning with BERT-BiLSTM-CRF-DBpedia), which incorporates the idea of contrastive learning. The model first trains the sentence pairs in the text, calculate similarity between sentence pairs, and fine-tunes BERT used for the named entity recognition task according to the similarity, so as to alleviate word ambiguity. Then, the fine-tuned BERT is combined with BiLSTM-CRF to perform the named entity recognition task. Finally, the recognition results are corrected in combination with prior knowledge such as knowledge graphs, so as to alleviate the low-recognition-rate problem caused by word abbreviations. The results of experimentals conducted on the CoNLL-2003 English dataset and OntoNotes V5 English dataset show that our model outperforms other similar models on.
9.5DSMar 10
The Geometry of Quasi-Cycles: How Stoichiometric Covariance Alters Pre-Bifurcation SignaturesLouis Shuo Wang, Jiguang Yu, Ye Liang et al.
Environmental enrichment can destabilize predator--prey coexistence through a Hopf bifurcation, yet real ecosystems are finite and intrinsically stochastic. We investigate how mechanistically derived demographic noise shapes near-Hopf dynamics in the Rosenzweig--MacArthur model by systematically comparing two diffusion closures that share identical deterministic drift but differ solely in predation-induced covariance structure. Starting from a continuous-time Markov chain description, we derive a full-covariance stochastic differential equation whose diffusion tensor inherits stoichiometric coupling, generating a negative prey--predator cross-covariance. This model is contrasted with a drift-matched diagonal-noise comparator. Using linear noise approximation, Lyapunov analysis, and matrix-valued power spectral density formulations, we propagate local covariance structure through the entire diagnostic chain, including stochastic sensitivity ellipses and a dimensionless noisy-precursor indicator. The results highlight that drift equivalence does not imply covariance equivalence and show how event-level noise geometry influences macroscopic behavior in nonlinear ecological systems. This work integrates bifurcation theory and stochastic analysis to advance multi-scale modeling of complex interacting systems.
NEMar 1, 2024
Event-Driven Learning for Spiking Neural NetworksWenjie Wei, Malu Zhang, Jilin Zhang et al.
Brain-inspired spiking neural networks (SNNs) have gained prominence in the field of neuromorphic computing owing to their low energy consumption during feedforward inference on neuromorphic hardware. However, it remains an open challenge how to effectively benefit from the sparse event-driven property of SNNs to minimize backpropagation learning costs. In this paper, we conduct a comprehensive examination of the existing event-driven learning algorithms, reveal their limitations, and propose novel solutions to overcome them. Specifically, we introduce two novel event-driven learning methods: the spike-timing-dependent event-driven (STD-ED) and membrane-potential-dependent event-driven (MPD-ED) algorithms. These proposed algorithms leverage precise neuronal spike timing and membrane potential, respectively, for effective learning. The two methods are extensively evaluated on static and neuromorphic datasets to confirm their superior performance. They outperform existing event-driven counterparts by up to 2.51% for STD-ED and 6.79% for MPD-ED on the CIFAR-100 dataset. In addition, we theoretically and experimentally validate the energy efficiency of our methods on neuromorphic hardware. On-chip learning experiments achieved a remarkable 30-fold reduction in energy consumption over time-step-based surrogate gradient methods. The demonstrated efficiency and efficacy of the proposed event-driven learning methods emphasize their potential to significantly advance the fields of neuromorphic computing, offering promising avenues for energy-efficiency applications.