On the use of expert methods in evaluating effectiveness and quality of information systems

The article is devoted to the application of expert methods in assessing effectiveness and quality of information systems. The general issues of the application of expert assessments, including the conduct of the expert survey procedure and the establishment of consistency of expert opinions, are considered. Various approaches to determining the number of experts, including formulas for calculations, are presented and comparative calculations based on these formulas are carried out. A formalized approach to assessing the competence of experts is presented, including their scientific qualifications, reasonableness of assessments, and the degree of familiarity with the problem being evaluated.