Research Paper

Integrating managerial preferences into the qualitative multi-criteria evaluation of team members

A. Barcomb, N. Jullien, P. Meyer and A.L. Olteanu




Managers can find it challenging to assess team members consistently and fairly. The ideal composition of qualities possessed by good team members depends on the organization, the team, and the manager. To enable managers to elucidate the qualities they require, we make use of an innovative methodology. This methodology is based on a multi-criteria decision aiding process, starting with the identification and definition of the dimensions that will be used to evaluate team members, then the inference of the manager's preferences through a multi-step protocol combining multiple types of preference models, and finally extracting a set of rules that can support the manager in his/her tasks. We illustrate this methodology in the case of free/libre/open-source software development teams, where we were able to elicit the characteristics of a good, acceptable, or bad contributor based on multiple managers' perspectives. We additionally provide an example on how to reproduce this experiment using the MCDA package for the R statistical environment.


  author = {Barcomb, Ann and Jullien, Nicolas and Meyer, Patrick and Olteanu, Alexandru-Liviu},
  year = {2019},
  pages = {95--143},
  isbn = {9783319993034},
  title = {Integrating managerial preferences into the qualitative multi-criteria evaluation of team members},
  editor = {Huber, Sandra and Geiger, Martin Josef and Teixeira de Almeida, Adiel},
  booktitle = {Multiple Criteria Decision Making and Aiding - Cases on Decision Making Methods and Models with Computer Implementations, International Series in Operations Research \& Management Science 274},
  publisher = {Springer Nature Switzerland AG},
  doi = {10.1007/978-3-319-99304-1_4},