Assessments of Errors in a Text from the Results of Several Independent Examinations

  • Алексей [Aleksey] Николаевич [N.] Архангельский [Arkhangelsky]
  • Генрих [Genrikh] Михайлович [M.] Пиголкин [Pigolkin]
Keywords: independent tests, Bernoulli tests, Chebyshev inequality, constituents, maximum likelihood functions and estimates, subset- based estimates, interval estimates

Abstract

A system for estimating the quality of a working result (a text, a product, etc.) of any complexity and for any purpose is constructed. The approach to solving a problem of such kind consists in the following. The same information source, which completely describes the estimated object is replicated in some or other way in the number of times equal to the number of available subjects (experts), each of which is capable to perform the necessary examination independently of other experts. The examination results are processed, and deficiencies (errors) revealed by each expert are established. In this case, the actual signs of the revealed errors must be defined so that it would be possible to indicate both the number of errors revealed by each expert and the number of errors found within each subset from the given set of experts. Thus, all errors for all experts are regarded as the result of a multiple examination.

In this study, certain basic estimates of the qualities of the accomplished examinations and text (product) are made (brought to final formulas) based on applying the mathematical model and using the maximum likelihood principle, and assessments connected with Chebyshev inequality. In addition, the range of possible investigations based on multiple examination data is briefly outlined.

Information about authors

Алексей [Aleksey] Николаевич [N.] Архангельский [Arkhangelsky]

Ph.D. (Phys.-Math.), Assistant Professor of Higher Mathematics Dept., NRU MPEI, e-mail: ArkhangelskyAN@mpei.ru

Генрих [Genrikh] Михайлович [M.] Пиголкин [Pigolkin]

Ph.D. (Phys.-Math.), Assistant Professor of Higher Mathematics Dept., NRU MPEI

References

1. Семенов С.С., Воронов Е.М., Полтавский А.В., Крянев А.В. Методы принятия решений в задачах оценки качества и технического уровня сложных технических систем. М.: Ленанд, 2016.
2. Benini A. е. а. The Use of Expert Judgment in Humanitarian Analysis — Theory, Methods, Applications. Geneva, Assessment Capacities Project, 2017.
3. Крянев А.В., Тихомирова А.Н., Сидоренко Е.В. Групповая экспертиза инновационных проектов с использованием байесовского подхода // Экономика и математические методы. 2013. Т. 49. № 2. С. 124—139.
4. Крянев А.В., Семенов С.С. К вопросу о качестве и надежности экспертных оценок при определении технического уровня сложных систем // Надежность. 2013. Вып. 4. С. 90—99.
5. Смирнов Н.В., Дунин-Барковский И.В. Краткий курс математической статистики для технических приложений. М.: Физматлит, 1959.
6. Прохоров Ю.В., Пономаренко Л.С. Лекции по теории вероятностей и математической статистике. М.: Изд-во МГУ им. М.В. Ломоносова, 2004.
7. Барра Ж.-Р. Основные понятия математической статистики. М.: Мир, 1974.
8. Де Гроот М. Оптимальные статистические решения. М.: Мир, 1974.
---
Для цитирования: Архангельский А.Н., Пиголкин Г.М. Оценки ошибок в тексте по результатам нескольких независимых экспертиз // Вестник МЭИ. 2019. № 3. С. 130—133. DOI: 10.24160/1993-6982-2019-3-130-133.
#
1. Semenov S.S., Voronov E.M., Poltavskiy A.V., Kryanev A.V. Metody Prinyatiya Resheniy v Zadachakh Otsenki Kachestva i Tekhnicheskogo Urovnya Slozhnykh Tekhnicheskikh Sistem. M.: Lenand, 2016. (in Russian).
2. Benini A. e. a. The Use of Expert Judgment in Humanitarian Analysis — Theory, Methods, Applications. Geneva, Assessment Capacities Project, 2017.
3. Kryanev A.V., Tikhomirova A.N., Sidorenko E.V. Gruppovaya Ekspertiza Innovatsionnykh Proektov s Ispol'zovaniem Bayesovskogo Podkhoda. Ekonomika i Matemticheskie Metody. 2013;49;2:124—139. (in Russian).
4. Kryanev A.V., Semenov S.S. K Voprosu o Kachestve i Nadezhnosti Ekspertnykh Otsenok pri Opredelenii Tekhnicheskogo Urovnya Slozhnykh Sistem. Nadezhnost'. 2013;4:90—99. (in Russian).
5. Smirnov N.V., Dunin-Barkovskiy I.V. Kratkiy Kurs Matematicheskoy Statistiki dlya Tekhnicheskikh Prilozheniy. M.: Fizmatlit, 1959. (in Russian).
6. Prokhorov Yu.V., Ponomarenko L.S. Lektsii po Teorii Veroyatnostey i Matematicheskoy Statistike. M.: Izd-vo MGU im. M.V. Lomonosova, 2004. (in Russian).
7. Barra Zр.-R. Osnovnye Ponyatiya Matematicheskoy Statistiki. M.: Mir, 1974. (in Russian).
8. De Groot M. Optimal'nye Statisticheskie Resheniya. M.: Mir, 1974. (in Russian).
---
For citation: Arkhangelsky A.N., Pigolkin G.M. Assessments of Errors in a Text from the Results of Several Independent Examinations. Bulletin of MPEI. 2019;3:130—133. (in Russian). DOI: 10.24160/1993-6982-2019-3-130-133.
Published
2018-01-26
Section
Probability Theory and Mathematical Statistics (01.01.05)