Leveraging machine learning to automatically derive robust decision strategies from imperfect models of the real world

2022

Article

re

Teaching people clever heuristics is a promising approach to improve decision-making under uncertainty. The theory of resource-rationality makes it possible to leverage machine learning to discover optimal heuristics automatically. One bottleneck of this approach is that the resulting decision strategies are only as good as the model of the decision-problem that the machine learning methods were applied to. This is problematic because even domain experts cannot give complete and fully accurate descriptions of the decisions they face. To address this problem, we develop strategy discovery methods that are robust to potential inaccuracies in the description of the scenarios in which people will use the discovered decision strategies. The basic idea is to derive the strategy that will perform best in expectation across all possible real-world problems that could have given rise to the likely erroneous description that a domain expert provided. To achieve this, our method uses a probabilistic model of how the description of a decision problem might be corrupted by biases in human judgment and memory. Our method uses this model to perform Bayesian inference on which real-world scenarios might have given rise to the provided descriptions. We applied our Bayesian approach to robust strategy discovery in two domains: planning and risky choice. In both applications, we find that our approach is more robust to errors in the description of the decision problem and that teaching the strategies it discovers significantly improves human decision-making in scenarios where approaches ignoring the risk that the description might be incorrect are ineffective or even harmful. The methods developed in this article are an important step towards leveraging machine learning to improve human decision-making in the real world because they tackle the problem that the real world is fundamentally uncertain.

@article{Mehta2022Leveraging,
  title = {Leveraging machine learning to automatically derive robust decision strategies from imperfect models of the real world },
  author = {Mehta, Aashay and Jain, Yash Raj and Kemtur, Anirudha and Stojcheski, Jugoslav and Consul, Saksham and Tosic, Mateo and Lieder, Falk},
  journal = {Computational Brain & Behavior},
  volume = {5},
  pages = {343--377},
  publisher = {Springer Nature},
  month = jun,
  year = {2022},
  doi = {10.1007/s42113-022-00141-6},
  url = {https://link.springer.com/content/pdf/10.1007/s42113-022-00141-6.pdf},
  month_numeric = {6}
}