摘要 Abstract
算法决策系统的公平性研究通常将复杂的决策过程(如保释或贷款批准)简化为二分类任务。然而,这些方法忽略了此类决策本质上并非二元(例如,批准或不批准保释或贷款),还涉及影响下游结果(如贷款偿还或再犯罪)的非二元处理决策(如保释条件或贷款条款)。本文认为,非二元处理决策是决策过程的重要组成部分,并由决策者控制,因此应成为算法决策公平性分析的核心内容。我们提出了一种因果框架,该框架扩展了公平性分析,并明确区分了决策对象的协变量和处理决策。这一设定允许决策者利用我们的框架(i)在历史数据中测量处理差异及其下游影响,并通过反事实推理(ii)减轻过去不公平处理决策的影响,从而实现自动化决策。我们使用该框架对四个广泛使用的贷款审批数据集进行实证分析,揭示了非二元处理决策中的潜在差异及其对结果的歧视性影响,强调了在公平性评估中纳入处理决策的必要性。此外,通过干预处理决策,我们证明了该框架能够有效减轻历史数据中的处理歧视,确保公平的风险评分估计和(非二元)决策过程,使所有利益相关者受益。
Fairness studies of algorithmic decision-making systems often simplify complex decision processes, such as bail or loan approvals, into binary classification tasks. However, these approaches overlook that such decisions are not inherently binary (e.g., approve or not approve bail or loan); they also involve non-binary treatment decisions (e.g., bail conditions or loan terms) that can influence the downstream outcomes (e.g., loan repayment or reoffending). In this paper, we argue that non-binary treatment decisions are integral to the decision process and controlled by decision-makers and, therefore, should be central to fairness analyses in algorithmic decision-making. We propose a causal framework that extends fairness analyses and explicitly distinguishes between decision-subjects' covariates and the treatment decisions. This specification allows decision-makers to use our framework to (i) measure treatment disparity and its downstream effects in historical data and, using counterfactual reasoning, (ii) mitigate the impact of past unfair treatment decisions when automating decision-making. We use our framework to empirically analyze four widely used loan approval datasets to reveal potential disparity in non-binary treatment decisions and their discriminatory impact on outcomes, highlighting the need to incorporate treatment decisions in fairness assessments. Moreover, by intervening in treatment decisions, we show that our framework effectively mitigates treatment discrimination from historical data to ensure fair risk score estimation and (non-binary) decision-making processes that benefit all stakeholders.