See a map of all the places I've been!
Published:
I had the privilege of assisting in the organization of this workshop, which addresses a truly important topic. This event provided an opportunity to explore the issue from various perspectives, including social, psychological, and legal viewpoints, as well as from a modeling standpoint, with the aim of studying the over/under-representation of the phenomenon within official statistics.
Published:
It is well-known in the literature that the main limitations of document clustering techniques are that they operate in a high-dimensional space and it is difficult to interpret the different clusters once a partition has obtained. The proposed methods for computing document clustering employs a two-stage process. Initially, it can be observed that the information contained within the Document-Term matrix exhibits significant sparsity, so a direct application of a clustering technique would be highly inefficient. Consequently, dimensionality reduction is applied. The proposed strategy involves employing Latent Dirichlet Allocation (LDA) to identify the main topics in the corpus under analysis. To determine the similarity between two documents, the p-value of a hypothesis test of the homogeneity of topic distributions between two documents is computed. This p-value is used as a similarity measure, upon which three different clustering procedures are built. The first two directly employs the new dissimilarity using an hierarchical approach and a fuzzy relational clustering approach while the other is a test-based approach to clustering. The performance of the clustering methods is then assessed using some benchmark datasets in order to understand advantages and disadvantages of the proposals.