Direct and joint assessment of Automatic Indexing Systems by Assignment
DOI:
https://doi.org/10.22478/ufpb.1809-4783.2020v30n4.57259Abstract
This work proposes a methodological pathway for the direct and joint evaluation of automatic indexing systems by
assignment, as well as applying the proposed methodological pathway in the evaluation of the quality of indexing of the
SISA (Sistema de Indización Semi-Automático) and MAUI (Multi-purpose Automatic Topic Indexing) for automatic indexing
by assignment of scientific articles written in Portuguese in the area of Information Science. The research is exploratory
and empirical, involving a case study and data collection through an indexing experiment. The experiment consists of
the automatic indexing of scientific articles from a reference corpus composed of 60 articles from scientific journals
indexed intellectually using the Brazilian Thesaurus for Information Science as an indexing language. It concludes that the
methodological pathway proved to be adequate and that both systems presented good results, however MAUI stood out for
presenting better performance indexes.
Keywords: Automatic indexing systems. Automatic indexing by assignment. Information Science. Evaluation of automatic
indexing. SISA.
Downloads
Published
Issue
Section
License
Authors who publish with this journal agree to the following terms:
a) Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution 4.0 International License (CC BY 4.0), which allows sharing of the work with mandatory acknowledgment of the work's authorship and initial publication in this journal.
b) Authors are authorized to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), provided there is acknowledgment of its authorship and initial publication in this journal.
c) Authors are permitted and encouraged to post and distribute their work online (e.g., in institutional repositories or on their personal website) only after the official publication of the article by the journal, thereby preserving the confidentiality of the double-blind peer review. This subsequent sharing has the potential to increase the impact and citation of the published work.


