Popis:
Ranking of scientific outcomes is a common and repeatedly addressed problem. It is especially difficult when it requires negotiation of experts. The seminar provides, a probably novel, problem formulation by viewing ranking of alternatives as an estimation of an unknown objective ranking vector. The idea is exposed on a specific task of ranking quality of project proposals by a large group of experts. The obtained results analyzing real-life data are appealing. At the same time, they indicate the way how the current practice can be improved and, at the same time, how
to decrease expenses related to the review process. Some math will be used but the idea and results can be understand even without it.