A cautionary tale about AI-generated goal suggestions

2022

Conference Paper

re

Setting the right goals and prioritizing them might be the most crucial and the most challenging type of decisions people make for themselves, their teams, and their organizations. In this article, we explore whether it might be possible to leverage artificial intelligence (AI) to help people set better goals and which potential problems might arise from such applications. We devised the first prototype of an AI-powered digital goal-setting assistant and a rigorous empirical paradigm for assessing the quality of AI-generated goal suggestions. Our empirical paradigm compares the AI-generated goal suggestions against randomly-generated goal suggestions and unassisted goal-setting on a battery of self-report measures of important goal characteristics, motivation, and usability in a large-scale repeated-measures online experiment. The results of an online experiment with 259 participants revealed that our intuitively compelling goal suggestion algorithm was actively harmful to the quality of the people's goals and their motivation to pursue them. These surprising findings highlight three crucial problems to be tackled by future work on leveraging AI to help people set better goals: i) aligning the objective function of the AI algorithms with the design goals, ii) helping people quantify how valuable different goals are to them, and iii) preserving the user's sense of autonomy.

@inproceedings{Lieder2022muc-cautionary,
  title = {A cautionary tale about AI-generated goal suggestions},
  author = {Lieder, F. and Chen, P.-Z. and Stojcheski, J. and Consul, S. and Pammer-Schindler, V.},
  booktitle = {MuC '22: Proceedings of Mensch und Computer 2022 },
  pages = {354--359},
  month = sep,
  year = {2022},
  doi = {10.1145/3543758.3547539},
  url = {https://dl.acm.org/doi/10.1145/3543758.3547539},
  month_numeric = {9}
}