Normalizador Neural de Datas e Endereços
This addresses the challenge of handling non-preconfigured formats in NLP tasks, offering a more flexible alternative to rigid tools like ReGex or DateParser, though it appears incremental as it applies an existing method to a specific domain.
The paper tackled the problem of normalizing diverse and noisy date and address formats in documents, achieving accuracy above 90% in some cases using a T5-based deep neural network model.
Documents of any kind present a wide variety of date and address formats, in some cases dates can be written entirely in full or even have different types of separators. The pattern disorder in addresses is even greater due to the greater possibility of interchanging between streets, neighborhoods, cities and states. In the context of natural language processing, problems of this nature are handled by rigid tools such as ReGex or DateParser, which are efficient as long as the expected input is pre-configured. When these algorithms are given an unexpected format, errors and unwanted outputs happen. To circumvent this challenge, we present a solution with deep neural networks state of art T5 that treats non-preconfigured formats of dates and addresses with accuracy above 90% in some cases. With this model, our proposal brings generalization to the task of normalizing dates and addresses. We also deal with this problem with noisy data that simulates possible errors in the text.