Knowledge-enhanced document embeddings for text classification

01 Pubblicazione su rivista
Akemi Sinoara Roberta, José Camacho-Collados, Geraldeli Rossi Rafael, Navigli Roberto, Rezende Solange O.
ISSN: 0950-7051

Accurate semantic representation models are essential in text mining applications. For a successful application of the text mining process, the text representation adopted must keep the interesting patterns to be discovered. Although competitive results for automatic text classification may be achieved with traditional bag of words, such representation model cannot provide satisfactory classification performances on hard settings where richer text representations are required. In this paper, we present an approach to represent document collections based on embedded representations of words and word senses. We bring together the power of word sense disambiguation and the semantic richness of word- and word-sense embedded vectors to construct embedded representations of document collections. Our approach results in semantically enhanced and low-dimensional representations. We overcome the lack of interpretability of embedded vectors, which is a drawback of this kind of representation, with the use of word sense embedded vectors. Moreover, the experimental evaluation indicates that the use of the proposed representations provides stable classifiers with strong quantitative results, especially in semantically-complex classification scenarios

© Università degli Studi di Roma "La Sapienza" - Piazzale Aldo Moro 5, 00185 Roma