风控模型开发验证报告

实验 ID: 20260909-114504-eadd · 生成时间: 2026-09-09 03:45 UTC · 报告结构:标准14节模型开发验证模板

00 模型概要信息

项目内容
模型名称exp_20260909-114504-eadd
开发完成日期2026-09-09
模型开发人员(人工填写)
模型开发人员邮件地址(人工填写)
模型验证人员(人工填写)
模型验证人员邮件地址(人工填写)
模型应用环节preloan_approval
模型应用频率(人工填写)
模型开发背景及业务用途描述Local MVP full pipeline run.
模型适用产品/客户描述(人工填写)
模型重开发原因(如有)
模型拟监控频率(人工填写)
模型路线LightGBM
目标变量fpd30
实验 ID20260909-114504-eadd
待补充:模型开发/验证人员、应用频率、产品描述等字段需人工补填。

01 模型设计

建模数据样本窗口

项目内容
切分方式时间切分
开发样本(Train)窗口2024-01-01 ~ 2024-01-25
预留验证样本(Val)窗口2024-01-26 ~ 2024-02-03
跨时间验证样本(OOT)窗口2024-02-04 ~ 2024-02-11

模型好坏定义

项目内容
目标变量fpd30
坏样本(BAD=1)占比11.10%
好样本(BAD=0)占比
不确定样本本流程要求目标变量已预计算为 0/1 二值,不确定样本请在上游合并口径

样本排除规则

序号排除规则说明
1customer_id主键/时间/口径字段,不入模
2apply_time主键/时间/口径字段,不入模
3fpd30 为空排除 0 行

滚动率分析

待补充:滚动率分析(M0→M6+ 状态迁移矩阵)需要逾期状态口径数据,当前流程目标变量为上游已计算的二值标签,暂未生成。
待补充:表现窗口及坏账率分析、模型细分定义需结合业务口径人工补充。

02 数据流

开发时点 — 样本排除

类别样本数
全部样本1000
排除:目标变量为空0
排除后样本1000

注:按照01模型设计的排除规则统计;当前流程的排除项为目标变量缺失。

开发时点 — 开发/预留验证拆分

类别样本数好样本坏样本坏样本率
开发样本6005307011.67%
预留验证样本216197198.80%

注:当前流程未做样本加权(权重均为1),如需坏样本加权需在上游扩展。

OOT 时点 / PSI 时点

类别样本数好样本坏样本坏样本率
跨时间验证样本(OOT)1841622211.96%

03 单变量分析(细分箱)

credit_score — IV 0.1854,10 箱
分组号分栏TotalGoodBadBad RateWOE
1(-inf, 380.5]2819932.14%-0.1681
2(380.5, 420.5]373525.41%0.0719
3(420.5, 444.5]3024620.00%-0.0756
4(444.5, 479.5]44281636.36%-0.2894
5(479.5, 515.5]4134717.07%-0.0651
6(515.5, 555.0]514835.88%0.0883
7(555.0, 587.0]46361021.74%-0.1304
8(587.0, 656.5]767511.32%0.2321
9(656.5, 746.0]10191109.90%0.0452
10(746.0, inf]11311121.77%0.3080
debt_ratio — IV 0.0851,10 箱
分组号分栏TotalGoodBadBad RateWOE
1(-inf, 0.05300000123679638]474612.13%0.1319
2(0.05300000123679638, 0.1394999995827675]1711442715.79%-0.1378
3(0.1394999995827675, 0.15850000083446503]434300.00%0.1504
4(0.15850000083446503, 0.1744999960064888]3024620.00%-0.0715
5(0.1744999960064888, 0.215999998152256]908644.44%0.1728
6(0.215999998152256, 0.2435000017285347]44331125.00%-0.1559
7(0.2435000017285347, 0.27549999952316284]383625.26%0.0718
8(0.27549999952316284, 0.32099999487400055]4035512.50%-0.0095
9(0.32099999487400055, 0.3739999979734421]4132921.95%-0.1148
10(0.3739999979734421, inf]565158.93%0.0425
time_on_page_sec — IV 0.0667,10 箱
分组号分栏TotalGoodBadBad RateWOE
1(-inf, 59.0]403825.00%0.0784
2(59.0, 204.5]1481291912.84%-0.0370
3(204.5, 247.0]464512.17%0.1287
4(247.0, 303.5]5851712.07%-0.0063
5(303.5, 349.5]4637919.57%-0.0981
6(349.5, 414.0]717011.41%0.2062
7(414.0, 446.0]3122929.03%-0.1491
8(446.0, 522.5]83701315.66%-0.0815
9(522.5, 568.5]474436.38%0.0714
10(568.5, inf]3024620.00%-0.0715
employment_years — IV 0.0620,10 箱
分组号分栏TotalGoodBadBad RateWOE
1(-inf, 2.5]66531319.70%-0.1414
2(2.5, 5.5]514747.84%0.0611
3(5.5, 7.5]3829923.68%-0.1338
4(7.5, 8.5]282713.57%0.0758
5(8.5, 12.5]80671316.25%-0.0947
6(12.5, 16.5]847778.33%0.0804
7(16.5, 18.5]616011.64%0.1924
8(18.5, 21.5]6657913.64%-0.0347
9(21.5, 22.5]282627.14%0.0422
10(22.5, inf]4237511.90%-0.0018
age — IV 0.0492,10 箱
分组号分栏TotalGoodBadBad RateWOE
1(-inf, 25.5]80651518.75%-0.1373
2(25.5, 28.5]474524.26%0.1013
3(28.5, 31.5]4136512.20%-0.0062
4(31.5, 38.5]979166.19%0.1370
5(38.5, 42.5]4336716.28%-0.0549
6(42.5, 45.5]323113.12%0.0825
7(45.5, 49.5]4640613.04%-0.0176
8(49.5, 52.5]4335818.60%-0.0818
9(52.5, 59.5]99841515.15%-0.0813
10(59.5, inf]726756.94%0.0919
months_since_last_loan — IV 0.0465,10 箱
分组号分栏TotalGoodBadBad RateWOE
1(-inf, 8.5]86731315.12%-0.0725
2(8.5, 16.5]80651518.75%-0.1373
3(16.5, 22.5]544959.26%0.0361
4(22.5, 28.5]5042816.00%-0.0587
5(28.5, 31.5]313013.23%0.0791
6(31.5, 35.5]3731616.22%-0.0476
7(35.5, 38.5]353500.00%0.1241
8(38.5, 50.5]130118129.23%0.0735
9(50.5, 54.5]4537817.78%-0.0752
10(54.5, inf]525023.85%0.1173
app_sessions_30d — IV 0.0319,10 箱
分组号分栏TotalGoodBadBad RateWOE
1(-inf, 3.5]3834410.53%0.0125
2(3.5, 4.5]3530514.29%-0.0263
3(4.5, 5.5]3935410.26%0.0158
4(5.5, 6.5]85681720.00%-0.1675
5(6.5, 7.5]807378.75%0.0610
6(7.5, 8.5]847867.14%0.0998
7(8.5, 9.5]77661114.29%-0.0509
8(9.5, 10.5]555059.09%0.0393
9(10.5, 12.5]746779.46%0.0431
10(12.5, inf]3329412.12%-0.0044
historical_overdue_count — IV 0.0260,3 箱
分组号分栏TotalGoodBadBad RateWOE
1(-inf, 0.5]286258289.79%0.0921
2(0.5, 1.5]2101872310.95%0.0289
3(1.5, inf]104851918.27%-0.1554
purpose — IV 0.0236,6 箱
分组号分栏TotalGoodBadBad RateWOE
1其他2723414.81%-0.0250
2医疗767156.58%0.1038
3周转1721502212.79%-0.0392
4家装989177.14%0.1129
5教育60491118.33%-0.1036
6日常消费1671462112.57%-0.0311
marital_status — IV 0.0188,4 箱
分组号分栏TotalGoodBadBad RateWOE
1丧偶108220.00%-0.0258
2已婚324293319.57%0.1103
3未婚2201912913.18%-0.0608
4离异4638817.39%-0.0718
clicks_before_apply — IV 0.0185,10 箱
分组号分栏TotalGoodBadBad RateWOE
1(-inf, 11.5]999099.09%0.0635
2(11.5, 12.5]54441018.52%-0.0977
3(12.5, 13.5]575258.77%0.0456
4(13.5, 14.5]5447712.96%-0.0190
5(14.5, 15.5]645957.81%0.0675
6(15.5, 16.5]6861710.29%0.0248
7(16.5, 17.5]5345815.09%-0.0490
8(17.5, 19.5]686268.82%0.0520
9(19.5, 21.5]4740714.89%-0.0417
10(21.5, inf]3630616.67%-0.0510
region — IV 0.0163,7 箱
分组号分栏TotalGoodBadBad RateWOE
1东北92801213.04%-0.0310
2华东736768.22%0.0672
3华中827489.76%0.0404
4华北928488.70%0.0695
5华南94841010.64%0.0240
6西南90761415.56%-0.0843
7西部77651215.58%-0.0754
loan_term — IV 0.0119,5 箱
分组号分栏TotalGoodBadBad RateWOE
1(-inf, 4.5]67571014.93%-0.0565
2(4.5, 9.0]11810997.63%0.1157
3(9.0, 18.0]2322042812.07%-0.0169
4(18.0, 30.0]108941412.96%-0.0329
5(30.0, inf]7566912.00%-0.0065
existing_loans — IV 0.0077,5 箱
分组号分栏TotalGoodBadBad RateWOE
1(-inf, 0.5]127116118.66%0.0898
2(0.5, 1.5]2151882712.56%-0.0356
3(1.5, 2.5]1591401911.95%-0.0095
4(2.5, 3.5]6455914.06%-0.0403
5(3.5, inf]3531411.43%0.0024
city_tier — IV 0.0037,5 箱
分组号分栏TotalGoodBadBad RateWOE
1(-inf, 1.5]5951813.56%-0.0298
2(1.5, 2.5]1291161310.08%0.0472
3(2.5, 3.5]1701502011.76%-0.0034
4(3.5, 4.5]1561362012.82%-0.0378
5(4.5, inf]8677910.47%0.0262
education — IV 0.0015,4 箱
分组号分栏TotalGoodBadBad RateWOE
1大专2171912611.98%-0.0128
2本科1891672211.64%0.0010
3硕士及以上4337613.95%-0.0275
4高中及以下1511351610.60%0.0353
channel — IV 0.0008,4 箱
分组号分栏TotalGoodBadBad RateWOE
1APP3142783611.46%0.0100
2WEB1421251711.97%-0.0095
3合作渠道86751112.79%-0.0241
4线下5852610.34%0.0209
gender — IV 0.0004,2 箱
分组号分栏TotalGoodBadBad RateWOE
1F2652353011.32%0.0158
2M3352954011.94%-0.0139
constant_flag — IV 0.0000,1 箱
分组号分栏TotalGoodBadBad RateWOE
1(-inf, inf]6005307011.67%0.0000

注:统计全部候选变量的自动分箱明细(初分组),按 IV 降序展示前 19 个变量,共 19 个;完整数据见 feature_report.json。

04 单变量分析(粗分箱)

age — 10 箱
分组号分栏TotalGoodBadBad RateWOE
1(-inf, 25.5]80651518.75%-0.1373
2(25.5, 28.5]474524.26%0.1013
3(28.5, 31.5]4136512.20%-0.0062
4(31.5, 38.5]979166.19%0.1370
5(38.5, 42.5]4336716.28%-0.0549
6(42.5, 45.5]323113.12%0.0825
7(45.5, 49.5]4640613.04%-0.0176
8(49.5, 52.5]4335818.60%-0.0818
9(52.5, 59.5]99841515.15%-0.0813
10(59.5, inf]726756.94%0.0919
marital_status — 4 箱
分组号分栏TotalGoodBadBad RateWOE
1丧偶108220.00%-0.0258
2已婚324293319.57%0.1103
3未婚2201912913.18%-0.0608
4离异4638817.39%-0.0718
employment_years — 10 箱
分组号分栏TotalGoodBadBad RateWOE
1(-inf, 2.5]66531319.70%-0.1414
2(2.5, 5.5]514747.84%0.0611
3(5.5, 7.5]3829923.68%-0.1338
4(7.5, 8.5]282713.57%0.0758
5(8.5, 12.5]80671316.25%-0.0947
6(12.5, 16.5]847778.33%0.0804
7(16.5, 18.5]616011.64%0.1924
8(18.5, 21.5]6657913.64%-0.0347
9(21.5, 22.5]282627.14%0.0422
10(22.5, inf]4237511.90%-0.0018
credit_score — 10 箱
分组号分栏TotalGoodBadBad RateWOE
1(-inf, 380.5]2819932.14%-0.1681
2(380.5, 420.5]373525.41%0.0719
3(420.5, 444.5]3024620.00%-0.0756
4(444.5, 479.5]44281636.36%-0.2894
5(479.5, 515.5]4134717.07%-0.0651
6(515.5, 555.0]514835.88%0.0883
7(555.0, 587.0]46361021.74%-0.1304
8(587.0, 656.5]767511.32%0.2321
9(656.5, 746.0]10191109.90%0.0452
10(746.0, inf]11311121.77%0.3080
debt_ratio — 10 箱
分组号分栏TotalGoodBadBad RateWOE
1(-inf, 0.05300000123679638]474612.13%0.1319
2(0.05300000123679638, 0.1394999995827675]1711442715.79%-0.1378
3(0.1394999995827675, 0.15850000083446503]434300.00%0.1504
4(0.15850000083446503, 0.1744999960064888]3024620.00%-0.0715
5(0.1744999960064888, 0.215999998152256]908644.44%0.1728
6(0.215999998152256, 0.2435000017285347]44331125.00%-0.1559
7(0.2435000017285347, 0.27549999952316284]383625.26%0.0718
8(0.27549999952316284, 0.32099999487400055]4035512.50%-0.0095
9(0.32099999487400055, 0.3739999979734421]4132921.95%-0.1148
10(0.3739999979734421, inf]565158.93%0.0425
months_since_last_loan — 10 箱
分组号分栏TotalGoodBadBad RateWOE
1(-inf, 8.5]86731315.12%-0.0725
2(8.5, 16.5]80651518.75%-0.1373
3(16.5, 22.5]544959.26%0.0361
4(22.5, 28.5]5042816.00%-0.0587
5(28.5, 31.5]313013.23%0.0791
6(31.5, 35.5]3731616.22%-0.0476
7(35.5, 38.5]353500.00%0.1241
8(38.5, 50.5]130118129.23%0.0735
9(50.5, 54.5]4537817.78%-0.0752
10(54.5, inf]525023.85%0.1173
historical_overdue_count — 3 箱
分组号分栏TotalGoodBadBad RateWOE
1(-inf, 0.5]286258289.79%0.0921
2(0.5, 1.5]2101872310.95%0.0289
3(1.5, inf]104851918.27%-0.1554
loan_term — 5 箱
分组号分栏TotalGoodBadBad RateWOE
1(-inf, 4.5]67571014.93%-0.0565
2(4.5, 9.0]11810997.63%0.1157
3(9.0, 18.0]2322042812.07%-0.0169
4(18.0, 30.0]108941412.96%-0.0329
5(30.0, inf]7566912.00%-0.0065
purpose — 6 箱
分组号分栏TotalGoodBadBad RateWOE
1其他2723414.81%-0.0250
2医疗767156.58%0.1038
3周转1721502212.79%-0.0392
4家装989177.14%0.1129
5教育60491118.33%-0.1036
6日常消费1671462112.57%-0.0311
region — 7 箱
分组号分栏TotalGoodBadBad RateWOE
1东北92801213.04%-0.0310
2华东736768.22%0.0672
3华中827489.76%0.0404
4华北928488.70%0.0695
5华南94841010.64%0.0240
6西南90761415.56%-0.0843
7西部77651215.58%-0.0754
app_sessions_30d — 10 箱
分组号分栏TotalGoodBadBad RateWOE
1(-inf, 3.5]3834410.53%0.0125
2(3.5, 4.5]3530514.29%-0.0263
3(4.5, 5.5]3935410.26%0.0158
4(5.5, 6.5]85681720.00%-0.1675
5(6.5, 7.5]807378.75%0.0610
6(7.5, 8.5]847867.14%0.0998
7(8.5, 9.5]77661114.29%-0.0509
8(9.5, 10.5]555059.09%0.0393
9(10.5, 12.5]746779.46%0.0431
10(12.5, inf]3329412.12%-0.0044
clicks_before_apply — 10 箱
分组号分栏TotalGoodBadBad RateWOE
1(-inf, 11.5]999099.09%0.0635
2(11.5, 12.5]54441018.52%-0.0977
3(12.5, 13.5]575258.77%0.0456
4(13.5, 14.5]5447712.96%-0.0190
5(14.5, 15.5]645957.81%0.0675
6(15.5, 16.5]6861710.29%0.0248
7(16.5, 17.5]5345815.09%-0.0490
8(17.5, 19.5]686268.82%0.0520
9(19.5, 21.5]4740714.89%-0.0417
10(21.5, inf]3630616.67%-0.0510
time_on_page_sec — 10 箱
分组号分栏TotalGoodBadBad RateWOE
1(-inf, 59.0]403825.00%0.0784
2(59.0, 204.5]1481291912.84%-0.0370
3(204.5, 247.0]464512.17%0.1287
4(247.0, 303.5]5851712.07%-0.0063
5(303.5, 349.5]4637919.57%-0.0981
6(349.5, 414.0]717011.41%0.2062
7(414.0, 446.0]3122929.03%-0.1491
8(446.0, 522.5]83701315.66%-0.0815
9(522.5, 568.5]474436.38%0.0714
10(568.5, inf]3024620.00%-0.0715

注:统计入模变量经合并调整后的最终分箱明细(开发样本口径)。当前流程细/粗分箱由同一自动分箱算法直接产出。

05 变量筛选

候选变量 21,通过分箱 19,入模 13(上限 30,IV 阈值 0.01)

变量名是否入模IV缺失率<90%IV≥阈值缺失率备注
credit_scoreY0.1854PASSPASS5.50%WOE不单调
debt_ratioY0.0851PASSPASS0.00%WOE不单调
time_on_page_secY0.0667PASSPASS0.00%WOE不单调
employment_yearsY0.0620PASSPASS9.33%WOE不单调
ageY0.0492PASSPASS0.00%WOE不单调
months_since_last_loanY0.0465PASSPASS0.00%WOE不单调
app_sessions_30dY0.0319PASSPASS0.00%WOE不单调
historical_overdue_countY0.0260PASSPASS0.00%
purposeY0.0236PASSPASS0.00%WOE不单调
marital_statusY0.0188PASSPASS0.00%WOE不单调
clicks_before_applyY0.0185PASSPASS0.00%WOE不单调
regionY0.0163PASSPASS0.00%WOE不单调
loan_termY0.0119PASSPASS0.00%WOE不单调
existing_loansN0.0077PASSFAIL0.00%WOE不单调
city_tierN0.0037PASSFAIL0.00%WOE不单调
educationN0.0015PASSFAIL0.00%WOE不单调
channelN0.0008PASSFAIL0.00%WOE不单调
genderN0.0004PASSFAIL0.00%
constant_flagN0.0000PASSFAIL0.00%

06 回归结果

待补充:本实验未运行 LR 路线(或未产生回归结果),无回归明细。

07 VIF

待补充:本实验未运行 LR 路线,未计算 VIF/相关系数。

08 最终评分卡

待补充:本实验未生成评分卡(未运行 LR 路线)。

09 模型表现

模型 KS & GINI(按样本)

模型样本KSGINI
LightGBM开发样本1.00001.0000
LightGBM预留验证样本0.32890.1958
LightGBM跨时间验证样本(OOT)0.27220.3048

LightGBM — 分数段表现

开发样本

组号分数区间(PD)样本数累计占比GoodBad累计Good占比累计Bad占比分组坏率累计坏率分组Odds累计Odds
10.0004 ~ 0.00396010.00%60011.32%0.00%0.00%0.00%
20.0039 ~ 0.00756020.00%60011.32%0.00%0.00%0.00%
30.0075 ~ 0.01246030.00%60011.32%0.00%0.00%0.00%
40.0125 ~ 0.01876040.00%60011.32%0.00%0.00%0.00%
50.0188 ~ 0.02696050.00%60011.32%0.00%0.00%0.00%
60.0270 ~ 0.04016060.00%60011.32%0.00%0.00%0.00%
70.0402 ~ 0.06256070.00%60011.32%0.00%0.00%0.00%
80.0633 ~ 0.10346080.00%60011.32%0.00%0.00%0.00%
90.1042 ~ 0.56316090.00%50109.43%14.29%16.67%1.85%5.0053.00
100.5768 ~ 0.866860100.00%0600.00%100.00%100.00%11.67%0.007.57
TOTALS6005307011.67%7.57

预留验证样本

组号分数区间(PD)样本数累计占比GoodBad累计Good占比累计Bad占比分组坏率累计坏率分组Odds累计Odds
10.0004 ~ 0.00452210.19%20210.15%10.53%9.09%9.09%10.0010.00
20.0046 ~ 0.01032119.91%20110.15%15.79%4.76%6.98%20.0013.33
30.0106 ~ 0.01502230.09%1939.64%31.58%13.64%9.23%6.339.83
40.0150 ~ 0.02612139.81%21010.66%31.58%0.00%6.98%13.33
50.0265 ~ 0.03582250.00%22011.17%31.58%0.00%5.56%17.00
60.0368 ~ 0.05852260.19%22011.17%31.58%0.00%4.62%20.67
70.0597 ~ 0.09712169.91%1658.12%57.89%23.81%7.28%3.2012.73
80.1039 ~ 0.16072179.63%1929.64%68.42%9.52%7.56%9.5012.23
90.1631 ~ 0.29272289.81%20210.15%78.95%9.09%7.73%10.0011.93
100.3172 ~ 0.741922100.00%1849.14%100.00%18.18%8.80%4.5010.37
TOTALS216197198.80%10.37

跨时间验证样本(OOT)

组号分数区间(PD)样本数累计占比GoodBad累计Good占比累计Bad占比分组坏率累计坏率分组Odds累计Odds
10.0006 ~ 0.00401910.33%19011.73%0.00%0.00%0.00%
20.0044 ~ 0.01061820.11%18011.11%0.00%0.00%0.00%
30.0109 ~ 0.01661829.89%1539.26%13.64%16.67%5.45%5.0017.33
40.0174 ~ 0.02741940.22%1549.26%31.82%21.05%9.46%3.759.57
50.0277 ~ 0.03691850.00%17110.49%36.36%5.56%8.70%17.0010.50
60.0375 ~ 0.05421859.78%18011.11%36.36%0.00%7.27%12.75
70.0548 ~ 0.08431970.11%1549.26%54.55%21.05%9.30%3.759.75
80.0882 ~ 0.13921879.89%1629.88%63.64%11.11%9.52%8.009.50
90.1413 ~ 0.24531889.67%1539.26%77.27%16.67%10.30%5.008.71
100.2564 ~ 0.824919100.00%1458.64%100.00%26.32%11.96%2.807.36
TOTALS1841622211.96%7.36

注:分数段基于模型输出 PD 等频分 10 档,按分数升序排列。

10 KS和GINI

LightGBM

样本KSGINI
开发样本1.00001.0000
预留验证样本0.32890.1958
跨时间验证样本(OOT)0.27220.3048

注:GINI = 2×AUC−1。逐分数明细曲线数据量较大,报告中仅呈现汇总指标,明细可在实验目录扩展生成。

11 PSI

分数 PSI(开发样本 vs OOT)

模型分数 PSI
LightGBM0.4234

变量 PSI(开发样本 vs OOT,按入模变量分箱)

特征项PSI状态
clicks_before_apply0.1294关注
time_on_page_sec0.0873稳定
region0.0643稳定
credit_score0.0554稳定
app_sessions_30d0.0474稳定
age0.0464稳定
loan_term0.0408稳定
employment_years0.0326稳定
purpose0.0269稳定
historical_overdue_count0.0249稳定
months_since_last_loan0.0222稳定
debt_ratio0.0180稳定
marital_status0.0102稳定
age — PSI 0.0464
分栏开发基准比例OOT 比例变更贡献
(-inf, 25.5]13.33%11.41%-1.92%0.0030
(25.5, 28.5]7.83%5.98%-1.86%0.0050
(28.5, 31.5]6.83%4.35%-2.49%0.0112
(31.5, 38.5]16.17%19.57%3.40%0.0065
(38.5, 42.5]7.17%10.87%3.70%0.0154
(42.5, 45.5]5.33%5.43%0.10%0.0000
(45.5, 49.5]7.67%8.15%0.49%0.0003
(49.5, 52.5]7.17%8.15%0.99%0.0013
(52.5, 59.5]16.50%14.13%-2.37%0.0037
(59.5, inf]12.00%11.96%-0.04%0.0000
marital_status — PSI 0.0102
分栏开发基准比例OOT 比例变更贡献
丧偶1.67%1.63%-0.04%0.0000
已婚54.00%53.26%-0.74%0.0001
未婚36.67%39.67%3.01%0.0024
离异7.67%5.43%-2.23%0.0077
employment_years — PSI 0.0326
分栏开发基准比例OOT 比例变更贡献
(-inf, 2.5]12.13%13.58%1.45%0.0016
(2.5, 5.5]9.38%13.58%4.21%0.0156
(5.5, 7.5]6.99%6.79%-0.20%0.0001
(7.5, 8.5]5.15%5.56%0.41%0.0003
(8.5, 12.5]14.71%14.81%0.11%0.0000
(12.5, 16.5]15.44%15.43%-0.01%0.0000
(16.5, 18.5]11.21%8.64%-2.57%0.0067
(18.5, 21.5]12.13%11.73%-0.40%0.0001
(21.5, 22.5]5.15%3.70%-1.44%0.0047
(22.5, inf]7.72%6.17%-1.55%0.0035
credit_score — PSI 0.0554
分栏开发基准比例OOT 比例变更贡献
(-inf, 380.5]4.94%4.52%-0.42%0.0004
(380.5, 420.5]6.53%10.17%3.64%0.0162
(420.5, 444.5]5.29%5.65%0.36%0.0002
(444.5, 479.5]7.76%6.78%-0.98%0.0013
(479.5, 515.5]7.23%7.91%0.68%0.0006
(515.5, 555.0]8.99%7.34%-1.65%0.0033
(555.0, 587.0]8.11%3.95%-4.16%0.0299
(587.0, 656.5]13.40%12.99%-0.41%0.0001
(656.5, 746.0]17.81%18.08%0.27%0.0000
(746.0, inf]19.93%22.60%2.67%0.0034
debt_ratio — PSI 0.0180
分栏开发基准比例OOT 比例变更贡献
(-inf, 0.05300000123679638]7.83%9.24%1.41%0.0023
(0.05300000123679638, 0.1394999995827675]28.50%25.00%-3.50%0.0046
(0.1394999995827675, 0.15850000083446503]7.17%6.52%-0.64%0.0006
(0.15850000083446503, 0.1744999960064888]5.00%3.80%-1.20%0.0033
(0.1744999960064888, 0.215999998152256]15.00%17.39%2.39%0.0035
(0.215999998152256, 0.2435000017285347]7.33%7.07%-0.27%0.0001
(0.2435000017285347, 0.27549999952316284]6.33%5.98%-0.36%0.0002
(0.27549999952316284, 0.32099999487400055]6.67%6.52%-0.14%0.0000
(0.32099999487400055, 0.3739999979734421]6.83%8.15%1.32%0.0023
(0.3739999979734421, inf]9.33%10.33%0.99%0.0010
months_since_last_loan — PSI 0.0222
分栏开发基准比例OOT 比例变更贡献
(-inf, 8.5]14.33%13.04%-1.29%0.0012
(8.5, 16.5]13.33%13.59%0.25%0.0000
(16.5, 22.5]9.00%9.24%0.24%0.0001
(22.5, 28.5]8.33%10.33%1.99%0.0043
(28.5, 31.5]5.17%7.07%1.90%0.0059
(31.5, 35.5]6.17%7.61%1.44%0.0030
(35.5, 38.5]5.83%5.43%-0.40%0.0003
(38.5, 50.5]21.67%17.93%-3.73%0.0071
(50.5, 54.5]7.50%7.61%0.11%0.0000
(54.5, inf]8.67%8.15%-0.51%0.0003
historical_overdue_count — PSI 0.0249
分栏开发基准比例OOT 比例变更贡献
(-inf, 0.5]47.67%48.91%1.25%0.0003
(0.5, 1.5]35.00%39.13%4.13%0.0046
(1.5, inf]17.33%11.96%-5.38%0.0200
loan_term — PSI 0.0408
分栏开发基准比例OOT 比例变更贡献
(-inf, 4.5]11.17%10.87%-0.30%0.0001
(4.5, 9.0]19.67%23.37%3.70%0.0064
(9.0, 18.0]38.67%41.85%3.18%0.0025
(18.0, 30.0]18.00%16.85%-1.15%0.0008
(30.0, inf]12.50%7.07%-5.43%0.0310
purpose — PSI 0.0269
分栏开发基准比例OOT 比例变更贡献
其他4.50%6.52%2.02%0.0075
医疗12.67%9.78%-2.88%0.0075
周转28.67%32.07%3.40%0.0038
家装16.33%13.04%-3.29%0.0074
教育10.00%10.87%0.87%0.0007
日常消费27.83%27.72%-0.12%0.0000
region — PSI 0.0643
分栏开发基准比例OOT 比例变更贡献
东北15.33%17.93%2.60%0.0041
华东12.17%14.13%1.96%0.0029
华中13.67%11.41%-2.25%0.0041
华北15.33%12.50%-2.83%0.0058
华南15.67%14.13%-1.54%0.0016
西南15.00%10.33%-4.67%0.0175
西部12.83%19.57%6.73%0.0284
app_sessions_30d — PSI 0.0474
分栏开发基准比例OOT 比例变更贡献
(-inf, 3.5]6.33%4.35%-1.99%0.0075
(3.5, 4.5]5.83%4.89%-0.94%0.0017
(4.5, 5.5]6.50%7.07%0.57%0.0005
(5.5, 6.5]14.17%14.13%-0.04%0.0000
(6.5, 7.5]13.33%13.04%-0.29%0.0001
(7.5, 8.5]14.00%21.20%7.20%0.0298
(8.5, 9.5]12.83%11.41%-1.42%0.0017
(9.5, 10.5]9.17%7.07%-2.10%0.0055
(10.5, 12.5]12.33%11.41%-0.92%0.0007
(12.5, inf]5.50%5.43%-0.07%0.0000
clicks_before_apply — PSI 0.1294
分栏开发基准比例OOT 比例变更贡献
(-inf, 11.5]16.50%11.96%-4.54%0.0146
(11.5, 12.5]9.00%5.43%-3.57%0.0180
(12.5, 13.5]9.50%7.07%-2.43%0.0072
(13.5, 14.5]9.00%16.85%7.85%0.0492
(14.5, 15.5]10.67%6.52%-4.14%0.0204
(15.5, 16.5]11.33%15.22%3.88%0.0114
(16.5, 17.5]8.83%8.15%-0.68%0.0005
(17.5, 19.5]11.33%13.59%2.25%0.0041
(19.5, 21.5]7.83%7.61%-0.22%0.0001
(21.5, inf]6.00%7.61%1.61%0.0038
time_on_page_sec — PSI 0.0873
分栏开发基准比例OOT 比例变更贡献
(-inf, 59.0]6.67%2.72%-3.95%0.0354
(59.0, 204.5]24.67%29.89%5.22%0.0100
(204.5, 247.0]7.67%3.80%-3.86%0.0271
(247.0, 303.5]9.67%10.33%0.66%0.0004
(303.5, 349.5]7.67%9.24%1.57%0.0029
(349.5, 414.0]11.83%14.13%2.30%0.0041
(414.0, 446.0]5.17%3.80%-1.36%0.0042
(446.0, 522.5]13.83%12.50%-1.33%0.0014
(522.5, 568.5]7.83%7.61%-0.22%0.0001
(568.5, inf]5.00%5.98%0.98%0.0017

注:PSI ≤ 0.1 视为稳定,0.1~0.25 需关注,> 0.25 不稳定。

12 单变量分析

注:统计所有入模变量的单变量分析(开发样本口径)。预留验证/总体/OOT 口径的分组明细待扩展。

age
组号ValueTot. Records累计占比#Goods#BadsBad RateG/B Odds
1(-inf, 25.5]8013.33%651518.75%4.33
2(25.5, 28.5]4721.17%4524.26%22.50
3(28.5, 31.5]4128.00%36512.20%7.20
4(31.5, 38.5]9744.17%9166.19%15.17
5(38.5, 42.5]4351.33%36716.28%5.14
6(42.5, 45.5]3256.67%3113.12%31.00
7(45.5, 49.5]4664.33%40613.04%6.67
8(49.5, 52.5]4371.50%35818.60%4.38
9(52.5, 59.5]9988.00%841515.15%5.60
10(59.5, inf]72100.00%6756.94%13.40
合计6005307011.67%7.57
marital_status
组号ValueTot. Records累计占比#Goods#BadsBad RateG/B Odds
1丧偶101.67%8220.00%4.00
2已婚32455.67%293319.57%9.45
3未婚22092.33%1912913.18%6.59
4离异46100.00%38817.39%4.75
合计6005307011.67%7.57
employment_years
组号ValueTot. Records累计占比#Goods#BadsBad RateG/B Odds
1(-inf, 2.5]6612.13%531319.70%4.08
2(2.5, 5.5]5121.51%4747.84%11.75
3(5.5, 7.5]3828.49%29923.68%3.22
4(7.5, 8.5]2833.64%2713.57%27.00
5(8.5, 12.5]8048.35%671316.25%5.15
6(12.5, 16.5]8463.79%7778.33%11.00
7(16.5, 18.5]6175.00%6011.64%60.00
8(18.5, 21.5]6687.13%57913.64%6.33
9(21.5, 22.5]2892.28%2627.14%13.00
10(22.5, inf]42100.00%37511.90%7.40
合计5444806411.76%7.50
credit_score
组号ValueTot. Records累计占比#Goods#BadsBad RateG/B Odds
1(-inf, 380.5]284.94%19932.14%2.11
2(380.5, 420.5]3711.46%3525.41%17.50
3(420.5, 444.5]3016.75%24620.00%4.00
4(444.5, 479.5]4424.51%281636.36%1.75
5(479.5, 515.5]4131.75%34717.07%4.86
6(515.5, 555.0]5140.74%4835.88%16.00
7(555.0, 587.0]4648.85%361021.74%3.60
8(587.0, 656.5]7662.26%7511.32%75.00
9(656.5, 746.0]10180.07%91109.90%9.10
10(746.0, inf]113100.00%11121.77%55.50
合计5675016611.64%7.59
debt_ratio
组号ValueTot. Records累计占比#Goods#BadsBad RateG/B Odds
1(-inf, 0.05300000123679638]477.83%4612.13%46.00
2(0.05300000123679638, 0.1394999995827675]17136.33%1442715.79%5.33
3(0.1394999995827675, 0.15850000083446503]4343.50%4300.00%
4(0.15850000083446503, 0.1744999960064888]3048.50%24620.00%4.00
5(0.1744999960064888, 0.215999998152256]9063.50%8644.44%21.50
6(0.215999998152256, 0.2435000017285347]4470.83%331125.00%3.00
7(0.2435000017285347, 0.27549999952316284]3877.17%3625.26%18.00
8(0.27549999952316284, 0.32099999487400055]4083.83%35512.50%7.00
9(0.32099999487400055, 0.3739999979734421]4190.67%32921.95%3.56
10(0.3739999979734421, inf]56100.00%5158.93%10.20
合计6005307011.67%7.57
months_since_last_loan
组号ValueTot. Records累计占比#Goods#BadsBad RateG/B Odds
1(-inf, 8.5]8614.33%731315.12%5.62
2(8.5, 16.5]8027.67%651518.75%4.33
3(16.5, 22.5]5436.67%4959.26%9.80
4(22.5, 28.5]5045.00%42816.00%5.25
5(28.5, 31.5]3150.17%3013.23%30.00
6(31.5, 35.5]3756.33%31616.22%5.17
7(35.5, 38.5]3562.17%3500.00%
8(38.5, 50.5]13083.83%118129.23%9.83
9(50.5, 54.5]4591.33%37817.78%4.62
10(54.5, inf]52100.00%5023.85%25.00
合计6005307011.67%7.57
historical_overdue_count
组号ValueTot. Records累计占比#Goods#BadsBad RateG/B Odds
1(-inf, 0.5]28647.67%258289.79%9.21
2(0.5, 1.5]21082.67%1872310.95%8.13
3(1.5, inf]104100.00%851918.27%4.47
合计6005307011.67%7.57
loan_term
组号ValueTot. Records累计占比#Goods#BadsBad RateG/B Odds
1(-inf, 4.5]6711.17%571014.93%5.70
2(4.5, 9.0]11830.83%10997.63%12.11
3(9.0, 18.0]23269.50%2042812.07%7.29
4(18.0, 30.0]10887.50%941412.96%6.71
5(30.0, inf]75100.00%66912.00%7.33
合计6005307011.67%7.57
purpose
组号ValueTot. Records累计占比#Goods#BadsBad RateG/B Odds
1其他274.50%23414.81%5.75
2医疗7617.17%7156.58%14.20
3周转17245.83%1502212.79%6.82
4家装9862.17%9177.14%13.00
5教育6072.17%491118.33%4.45
6日常消费167100.00%1462112.57%6.95
合计6005307011.67%7.57
region
组号ValueTot. Records累计占比#Goods#BadsBad RateG/B Odds
1东北9215.33%801213.04%6.67
2华东7327.50%6768.22%11.17
3华中8241.17%7489.76%9.25
4华北9256.50%8488.70%10.50
5华南9472.17%841010.64%8.40
6西南9087.17%761415.56%5.43
7西部77100.00%651215.58%5.42
合计6005307011.67%7.57
app_sessions_30d
组号ValueTot. Records累计占比#Goods#BadsBad RateG/B Odds
1(-inf, 3.5]386.33%34410.53%8.50
2(3.5, 4.5]3512.17%30514.29%6.00
3(4.5, 5.5]3918.67%35410.26%8.75
4(5.5, 6.5]8532.83%681720.00%4.00
5(6.5, 7.5]8046.17%7378.75%10.43
6(7.5, 8.5]8460.17%7867.14%13.00
7(8.5, 9.5]7773.00%661114.29%6.00
8(9.5, 10.5]5582.17%5059.09%10.00
9(10.5, 12.5]7494.50%6779.46%9.57
10(12.5, inf]33100.00%29412.12%7.25
合计6005307011.67%7.57
clicks_before_apply
组号ValueTot. Records累计占比#Goods#BadsBad RateG/B Odds
1(-inf, 11.5]9916.50%9099.09%10.00
2(11.5, 12.5]5425.50%441018.52%4.40
3(12.5, 13.5]5735.00%5258.77%10.40
4(13.5, 14.5]5444.00%47712.96%6.71
5(14.5, 15.5]6454.67%5957.81%11.80
6(15.5, 16.5]6866.00%61710.29%8.71
7(16.5, 17.5]5374.83%45815.09%5.62
8(17.5, 19.5]6886.17%6268.82%10.33
9(19.5, 21.5]4794.00%40714.89%5.71
10(21.5, inf]36100.00%30616.67%5.00
合计6005307011.67%7.57
time_on_page_sec
组号ValueTot. Records累计占比#Goods#BadsBad RateG/B Odds
1(-inf, 59.0]406.67%3825.00%19.00
2(59.0, 204.5]14831.33%1291912.84%6.79
3(204.5, 247.0]4639.00%4512.17%45.00
4(247.0, 303.5]5848.67%51712.07%7.29
5(303.5, 349.5]4656.33%37919.57%4.11
6(349.5, 414.0]7168.17%7011.41%70.00
7(414.0, 446.0]3173.33%22929.03%2.44
8(446.0, 522.5]8387.17%701315.66%5.38
9(522.5, 568.5]4795.00%4436.38%14.67
10(568.5, inf]30100.00%24620.00%4.00
合计6005307011.67%7.57

13 压力测试

注:验证压力情境下模型的有效性和区分能力稳定性:a.坏浓度更高样本 b.时间外样本 c.特定特征客群 d.极端时间样本。当前流程自动生成情景1(跨时间 OOT 样本),其余情景需人工构造样本后补充。

测试情景1:跨时间(OOT)样本

变量贡献度

变量贡献度
credit_score389.0000
employment_years310.0000
time_on_page_sec302.0000
age268.0000
debt_ratio264.0000
months_since_last_loan218.0000
clicks_before_apply165.0000
historical_overdue_count105.0000
app_sessions_30d79.0000
purpose55.0000

区分度验证 — LightGBM @ OOT

KS = 0.2722,GINI = 0.3048

组号分数区间(PD)样本数累计占比GoodBad累计Good占比累计Bad占比分组坏率累计坏率分组Odds累计Odds
10.0006 ~ 0.00401910.33%19011.73%0.00%0.00%0.00%
20.0044 ~ 0.01061820.11%18011.11%0.00%0.00%0.00%
30.0109 ~ 0.01661829.89%1539.26%13.64%16.67%5.45%5.0017.33
40.0174 ~ 0.02741940.22%1549.26%31.82%21.05%9.46%3.759.57
50.0277 ~ 0.03691850.00%17110.49%36.36%5.56%8.70%17.0010.50
60.0375 ~ 0.05421859.78%18011.11%36.36%0.00%7.27%12.75
70.0548 ~ 0.08431970.11%1549.26%54.55%21.05%9.30%3.759.75
80.0882 ~ 0.13921879.89%1629.88%63.64%11.11%9.52%8.009.50
90.1413 ~ 0.24531889.67%1539.26%77.27%16.67%10.30%5.008.71
100.2564 ~ 0.824919100.00%1458.64%100.00%26.32%11.96%2.807.36
TOTALS1841622211.96%7.36