Expert evaluation-based generation of synonymic sets for sentiment analysis

This study presents the expert evaluation of machine translation by the Reverso Context online service as applied to the generation of synonymic sets. These sets are used for a "best-worst" survey and estimation of emotionality levels to make a sentiment dictionary. The expert scores were converted into ranks. We also estimated the consistency index for the experts. The expert evaluations indicated that the machine translation offered by the online service is adequate.