A Geometric Method to Obtain the Generation Probability of a Sentence
This addresses a fundamental challenge in natural language processing, but it appears incremental as it builds on existing network-based ideas without major breakthroughs.
The paper tackles the problem of sentence generation by proposing a mathematical approach based on word networks, showing that sentence probability can be derived from single-word and word-pair co-occurrence probabilities, indicating humans use synthesis methods.
"How to generate a sentence" is the most critical and difficult problem in all the natural language processing technologies. In this paper, we present a new approach to explain the generation process of a sentence from the perspective of mathematics. Our method is based on the premise that in our brain a sentence is a part of a word network which is formed by many word nodes. Experiments show that the probability of the entire sentence can be obtained by the probabilities of single words and the probabilities of the co-occurrence of word pairs, which indicate that human use the synthesis method to generate a sentence.