Projekt per år
Sammanfattning
We present a Bayesian approach to evaluate AI decision systems using data from past decisions. Our approach addresses two challenges that are typically encountered in such settings and prevent a direct evaluation. First, the data may not have included all factors that affected past decisions. And second, past decisions may have led to unobserved outcomes. This is the case, for example, when a bank decides whether a customer should be granted a loan, and the outcome of interest is whether the customer will repay the loan. In this case, the data includes the outcome (if loan was repaid or not) only for customers who were granted the loan, but not for those who were not. To address these challenges, we formalize the decision making process with a causal model, considering also unobserved features. Based on this model, we compute counterfactuals to impute missing outcomes, which in turn allows us to produce accurate evaluations. As we demonstrate over real and synthetic data, our approach estimates the quality of decisions more accurately and robustly compared to previous methods.
Originalspråk | engelska |
---|---|
Titel på värdpublikation | Discovery Science : DS 2020 |
Antal sidor | 16 |
Utgivningsort | Cham |
Förlag | Springer |
Utgivningsdatum | 2020 |
Sidor | 3-18 |
ISBN (tryckt) | 978-3-030-61526-0 |
ISBN (elektroniskt) | 978-3-030-61527-7 |
DOI | |
Status | Publicerad - 2020 |
MoE-publikationstyp | A4 Artikel i en konferenspublikation |
Evenemang | International Conference in Discovery Science - Thessaloniki, Grekland Varaktighet: 19 okt. 2020 → 21 okt. 2020 Konferensnummer: 23 https://ds2020.csd.auth.gr/ |
Publikationsserier
Namn | Lecture Notes in Computer Science |
---|---|
Förlag | Springer |
Volym | 12323 |
ISSN (tryckt) | 0302-9743 |
ISSN (elektroniskt) | 1611-3349 |
Vetenskapsgrenar
- 113 Data- och informationsvetenskap
Projekt
- 1 Slutfört
-
Machine Learning Management Systems
Mahadevan, A. (Deltagare) & Mathioudakis, M. (Projektledare)
01/01/2020 → 31/12/2023
Projekt: Universitetens basfinansiering