风控模型开发验证报告

实验 ID: 20261009-134757-8b43 · 生成时间: 2026-10-10 14:00 (GMT+8) · 报告结构:标准14节模型开发验证模板

00 模型概要信息

项目内容
模型名称exp_20261009-134757-8b43
开发完成日期2026-10-10
模型开发人员(人工填写)
模型开发人员邮件地址(人工填写)
模型验证人员(人工填写)
模型验证人员邮件地址(人工填写)
模型应用环节preloan_approval
模型应用频率(人工填写)
模型开发背景及业务用途描述Local MVP full pipeline run.
模型适用产品/客户描述(人工填写)
模型重开发原因(如有)—
模型拟监控频率(人工填写)
模型路线LR + WOE 评分卡
目标变量flag_30
实验 ID20261009-134757-8b43
待补充:模型开发/验证人员、应用频率、产品描述等字段需人工补填。

01 模型设计

建模数据样本窗口

项目内容
切分方式外部 data_flag 划分(TRAIN 内 6/4 随机开发/测试,VALI 跨时间,PSI 时点)
开发样本(Train)窗口1970-01-01 ~ 1970-01-01
预留验证样本窗口1970-01-01 ~ 1970-01-01
跨时间验证样本窗口1970-01-01 ~ 1970-01-01
PSI时点样本窗口1970-01-01 ~ 1970-01-01

模型好坏定义

项目内容
目标变量flag_30
坏样本(BAD=1)占比22.06%
好样本(BAD=0)占比—
不确定样本本流程要求目标变量已预计算为 0/1 二值,不确定样本请在上游合并口径

样本排除规则

序号排除规则说明
1credit_no主键/时间/口径字段,不入模
2apply_dt主键/时间/口径字段,不入模
3flag_30 为空排除 0 行

滚动率分析

待补充:滚动率分析(M0→M6+ 状态迁移矩阵)需要逾期状态口径数据,当前流程目标变量为上游已计算的二值标签,暂未生成。
待补充:表现窗口及坏账率分析、模型细分定义需结合业务口径人工补充。

02 数据流

开发时点 — 样本排除

类别样本数
全部样本30000
排除:目标变量为空0
排除后样本30000

注:按照01模型设计的排除规则统计;当前流程的排除项为目标变量缺失。

总体样本概况

数据集样本量好样本坏样本坏样本率占比
全部样本3000023383661722.06%100.00%
开发样本108018453234821.74%36.00%
测试样本71995635156421.73%24.00%
训练+测试样本1800014088391221.73%60.00%
跨时间验证样本60004624137622.93%20.00%
PSI时点样本60004671132922.15%20.00%

开发/预留验证样本交叉统计

类别总样本数开发样本数开发占比预留验证样本数预留验证占比
好23383845336.15%563524.10%
坏6617234835.48%156423.64%
合计300001080136.00%719924.00%

细致变量分析(预分箱口径,开发样本)

变量IV缺失率取值集中度最大相关系数
risk_score0.14340.00%0.91%0.9986
risk_score_v20.13900.00%0.94%0.9986
bh_a0010.13820.00%0.15%0.9298
ScoreCust2_v20.13210.00%1.14%0.9952
ScoreCust20.12770.00%1.13%0.9952
bh_a0090.12710.00%1.73%0.8070
cust_seg20.08480.00%30.86%0.6662
avg_tnr0.08410.00%1.92%0.6947
query_cnt_3m0.07320.00%16.53%0.5822
income_grade0.06320.00%31.12%0.5458
repay_amt_6m_grade0.06070.00%27.69%0.5342
rare_field0.033096.32%0.76%0.0812
tenure_m0.02170.00%5.50%0.3328
card_usage_ratio0.02140.00%1.69%0.3613
bank_997_cnt_3m0.02050.00%34.62%0.2757
edu_level0.00040.00%42.13%—
region_code0.00040.00%20.63%—
flag_special0.00000.00%95.41%0.0380

注:共 18 个候选变量,按 IV 降序展示前 18 个;集中度 = 最大频次取值样本数 ÷ 非空样本数;相关性为皮尔逊(仅数值变量),完整数据见 variable_detail.json。

03 单变量分析(细分箱)

risk_score_v2 — IV 0.1290,10 箱
分组号分栏TotalGoodBadBad RateWOE
1(-inf, 495.5]14061353533.77%0.2336
2(495.5, 518.5]11051019867.78%0.1453
3(518.5, 527.5]5504816912.55%0.0507
4(527.5, 537.5]6395746510.17%0.0735
5(537.5, 563.5]1942165628614.73%0.1126
6(563.5, 584.5]1585124334221.58%0.0022
7(584.5, 602.5]118185332827.77%-0.0625
8(602.5, 615.5]66744222533.73%-0.0759
9(615.5, 643.5]98655143544.12%-0.1927
10(643.5, inf]74028145962.03%-0.2656
risk_score — IV 0.1272,10 箱
分组号分栏TotalGoodBadBad RateWOE
1(-inf, 492.5]12791232473.67%0.2165
2(492.5, 519.5]12761182947.37%0.1696
3(519.5, 535.5]103291411811.43%0.1000
4(535.5, 546.5]80169410713.36%0.0648
5(546.5, 564.5]1350114420615.26%0.0779
6(564.5, 587.5]1704132038422.54%-0.0112
7(587.5, 600.5]87062624428.05%-0.0507
8(600.5, 616.5]79753126633.38%-0.0859
9(616.5, 643.5]95552942644.61%-0.1917
10(643.5, inf]73728145661.87%-0.2638
ScoreCust2_v2 — IV 0.1262,10 箱
分组号分栏TotalGoodBadBad RateWOE
1(-inf, 507.5]16491574754.55%0.2546
2(507.5, 522.5]10839791049.60%0.1235
3(522.5, 536.5]1285113814711.44%0.1205
4(536.5, 544.5]79067711314.30%0.0567
5(544.5, 553.5]95977618319.08%0.0237
6(553.5, 565.5]123296526721.67%0.0007
7(565.5, 583.5]1611117144027.31%-0.0737
8(583.5, 593.5]65543222334.05%-0.0766
9(593.5, 606.5]64037027042.19%-0.1231
10(606.5, inf]89737152658.64%-0.2861
ScoreCust2 — IV 0.1191,10 箱
分组号分栏TotalGoodBadBad RateWOE
1(-inf, 494.5]957923343.55%0.1690
2(494.5, 508.5]749703466.14%0.1154
3(508.5, 528.5]153413871479.58%0.1658
4(528.5, 545.5]1664143822613.58%0.1168
5(545.5, 562.5]1785142136420.39%0.0198
6(562.5, 572.5]97273523724.38%-0.0235
7(572.5, 579.5]63645717928.14%-0.0392
8(579.5, 592.5]91260930333.22%-0.0950
9(592.5, 604.5]61536425140.81%-0.1111
10(604.5, inf]97741656157.42%-0.2967
bh_a001 — IV 0.1128,10 箱
分组号分栏TotalGoodBadBad RateWOE
1(-inf, 223.6500015258789]1032994383.68%0.1794
2(223.6500015258789, 254.3499984741211]13491266836.15%0.1937
3(254.3499984741211, 280.0500030517578]1560138117911.47%0.1408
4(280.0500030517578, 290.84999084472656]78667211414.50%0.0549
5(290.84999084472656, 317.0500030517578]1927156036719.05%0.0421
6(317.0500030517578, 332.75]108881827024.82%-0.0301
7(332.75, 354.0500030517578]119782537231.08%-0.0969
8(354.0500030517578, 367.75]54233420838.38%-0.0871
9(367.75, 394.25]75639236448.15%-0.1814
10(394.25, inf]56421135362.59%-0.2142
cust_seg2 — IV 0.1060,4 箱
分组号分栏TotalGoodBadBad RateWOE
1(-inf, 3.5]205618671899.19%0.2166
2(3.5, 4.5]3333282251115.33%0.1501
3(4.5, 5.5]3330250582524.77%-0.0668
4(5.5, inf]2082125982339.53%-0.2705
bh_a009 — IV 0.0991,10 箱
分组号分栏TotalGoodBadBad RateWOE
1(-inf, 6.3500001430511475]90243346952.00%-0.2386
2(6.3500001430511475, 7.3500001430511475]87554832737.37%-0.1238
3(7.3500001430511475, 8.050000190734863]77350926434.15%-0.0891
4(8.050000190734863, 8.849999904632568]106275330929.10%-0.0697
5(8.849999904632568, 9.25]57843014825.61%-0.0218
6(9.25, 10.050000190734863]123598225320.49%0.0138
7(10.050000190734863, 11.449999809265137]2187187331414.36%0.1298
8(11.449999809265137, 12.75]150113621399.26%0.1674
9(12.75, 13.550000190734863]6645917310.99%0.0706
10(13.550000190734863, inf]1024972525.08%0.1637
rare_field — IV 0.0827,10 箱
分组号分栏TotalGoodBadBad RateWOE
1(-inf, -1.437000036239624]232128.70%0.0847
2(-1.437000036239624, -0.8540000021457672]60431728.33%-0.0735
3(-0.8540000021457672, -0.443000003695488]5043714.00%0.1024
4(-0.443000003695488, -0.25699999928474426]25151040.00%-0.1074
5(-0.25699999928474426, -0.05299999937415123]3026413.33%0.0713
6(-0.05299999937415123, 0.10999999940395355]24141041.67%-0.1134
7(0.10999999940395355, 0.3699999898672104]34241029.41%-0.0554
8(0.3699999898672104, 1.0099999904632568]8980910.11%0.2372
9(1.0099999904632568, 1.324500024318695]2619726.92%-0.0279
10(1.324500024318695, inf]36221438.89%-0.1369
avg_tnr — IV 0.0751,10 箱
分组号分栏TotalGoodBadBad RateWOE
1(-inf, 2.149999976158142]92647445248.81%-0.2194
2(2.149999976158142, 3.350000023841858]96160935236.63%-0.1276
3(3.350000023841858, 4.450000047683716]125890335528.22%-0.0706
4(4.450000047683716, 4.8500001430511475]55042212823.27%-0.0083
5(4.8500001430511475, 5.450000047683716]83566716820.12%0.0128
6(5.450000047683716, 5.950000047683716]74858016822.46%-0.0051
7(5.950000047683716, 7.3500001430511475]2097172237517.88%0.0646
8(7.3500001430511475, 8.550000190734863]1478131316511.16%0.1390
9(8.550000190734863, 9.449999809265137]7546579712.86%0.0651
10(9.449999809265137, inf]11941106887.37%0.1602
income_grade — IV 0.0632,5 箱
分组号分栏TotalGoodBadBad RateWOE
1(-inf, 3.5]121174346838.65%-0.1736
2(3.5, 4.5]2510176674429.64%-0.1417
3(4.5, 5.5]3361268967219.99%0.0398
4(5.5, 6.5]2503215035314.10%0.1484
5(6.5, inf]121611051119.13%0.1419
repay_amt_6m_grade — IV 0.0607,5 箱
分组号分栏TotalGoodBadBad RateWOE
1(-inf, 3.5]1647104760036.43%-0.1915
2(3.5, 4.5]2268163463427.95%-0.1049
3(4.5, 5.5]2991238460720.29%0.0305
4(5.5, 6.5]2286194434214.96%0.1227
5(6.5, inf]1609144416510.25%0.1624
query_cnt_3m — IV 0.0483,9 箱
分组号分栏TotalGoodBadBad RateWOE
1(-inf, 0.5]55028826247.64%-0.1355
2(0.5, 1.5]112372439935.53%-0.1345
3(1.5, 2.5]1627115147629.26%-0.0995
4(2.5, 3.5]1785138440122.46%-0.0106
5(3.5, 4.5]1665136530018.02%0.0523
6(4.5, 5.5]1347112722016.33%0.0646
7(5.5, 6.5]102689712912.57%0.0882
8(6.5, 8.5]109897012811.66%0.1031
9(8.5, inf]580547335.69%0.0940
bank_997_cnt_3m — IV 0.0246,4 箱
分组号分栏TotalGoodBadBad RateWOE
1(-inf, 0.5]3447289954815.90%0.1392
2(0.5, 1.5]3739292881121.69%0.0012
3(1.5, 2.5]2224165556925.58%-0.0648
4(2.5, inf]139197142030.19%-0.0990
card_usage_ratio — IV 0.0183,10 箱
分组号分栏TotalGoodBadBad RateWOE
1(-inf, 0.107999999076128]922854687.38%0.1277
2(0.107999999076128, 0.1578500047326088]61651110517.05%0.0285
3(0.1578500047326088, 0.3025500029325485]2324184847620.48%0.0224
4(0.3025500029325485, 0.3381499946117401]64954510416.02%0.0364
5(0.3381499946117401, 0.4825499951839447]2550199655421.73%0.0003
6(0.4825499951839447, 0.5283499956130981]68749719027.66%-0.0388
7(0.5283499956130981, 0.6137499809265137]120394126221.78%-0.0004
8(0.6137499809265137, 0.6709499955177307]59440518931.82%-0.0578
9(0.6709499955177307, 0.7716499865055084]71552019527.27%-0.0376
10(0.7716499865055084, inf]54133620537.89%-0.0844
tenure_m — IV 0.0170,10 箱
分组号分栏TotalGoodBadBad RateWOE
1(-inf, 2.5]69641428240.52%-0.1218
2(2.5, 10.5]117989128824.43%-0.0281
3(10.5, 23.5]2292181347920.90%0.0148
4(23.5, 30.5]131099731323.89%-0.0245
5(30.5, 36.5]108084423621.85%-0.0011
6(36.5, 39.5]55444810619.13%0.0143
7(39.5, 46.5]126897429423.19%-0.0161
8(46.5, 53.5]121197024119.90%0.0199
9(53.5, 58.5]6475687912.21%0.0610
10(58.5, inf]564534305.32%0.0937
edu_level — IV 0.0004,4 箱
分组号分栏TotalGoodBadBad RateWOE
1大专3260257468621.04%0.0155
2本科4550355599521.87%-0.0035
3硕士及以上1405108132423.06%-0.0160
4高中及以下1586124334321.63%0.0015
region_code — IV 0.0004,5 箱
分组号分栏TotalGoodBadBad RateWOE
1其他2119165746221.80%-0.0011
2华东2156168547121.85%-0.0018
3华北2119168243720.62%0.0186
4华南2179170147821.94%-0.0033
5西南2228172850022.44%-0.0120
flag_special — IV 0.0000,1 箱
分组号分栏TotalGoodBadBad RateWOE
1(-inf, inf]108018453234821.74%0.0000

注:统计全部候选变量的自动分箱明细(初分组),按 IV 降序展示前 18 个变量,共 18 个;完整数据见 feature_report.json。

04 单变量分析(粗分箱)

risk_score_v2 — 10 箱
分组号分栏TotalGoodBadBad RateWOE
1(-inf, 495.5]14061353533.77%0.2336
2(495.5, 518.5]11051019867.78%0.1453
3(518.5, 527.5]5504816912.55%0.0507
4(527.5, 537.5]6395746510.17%0.0735
5(537.5, 563.5]1942165628614.73%0.1126
6(563.5, 584.5]1585124334221.58%0.0022
7(584.5, 602.5]118185332827.77%-0.0625
8(602.5, 615.5]66744222533.73%-0.0759
9(615.5, 643.5]98655143544.12%-0.1927
10(643.5, inf]74028145962.03%-0.2656
cust_seg2 — 4 箱
分组号分栏TotalGoodBadBad RateWOE
1(-inf, 3.5]205618671899.19%0.2166
2(3.5, 4.5]3333282251115.33%0.1501
3(4.5, 5.5]3330250582524.77%-0.0668
4(5.5, inf]2082125982339.53%-0.2705
avg_tnr — 10 箱
分组号分栏TotalGoodBadBad RateWOE
1(-inf, 2.149999976158142]92647445248.81%-0.2194
2(2.149999976158142, 3.350000023841858]96160935236.63%-0.1276
3(3.350000023841858, 4.450000047683716]125890335528.22%-0.0706
4(4.450000047683716, 4.8500001430511475]55042212823.27%-0.0083
5(4.8500001430511475, 5.450000047683716]83566716820.12%0.0128
6(5.450000047683716, 5.950000047683716]74858016822.46%-0.0051
7(5.950000047683716, 7.3500001430511475]2097172237517.88%0.0646
8(7.3500001430511475, 8.550000190734863]1478131316511.16%0.1390
9(8.550000190734863, 9.449999809265137]7546579712.86%0.0651
10(9.449999809265137, inf]11941106887.37%0.1602
income_grade — 5 箱
分组号分栏TotalGoodBadBad RateWOE
1(-inf, 3.5]121174346838.65%-0.1736
2(3.5, 4.5]2510176674429.64%-0.1417
3(4.5, 5.5]3361268967219.99%0.0398
4(5.5, 6.5]2503215035314.10%0.1484
5(6.5, inf]121611051119.13%0.1419
repay_amt_6m_grade — 5 箱
分组号分栏TotalGoodBadBad RateWOE
1(-inf, 3.5]1647104760036.43%-0.1915
2(3.5, 4.5]2268163463427.95%-0.1049
3(4.5, 5.5]2991238460720.29%0.0305
4(5.5, 6.5]2286194434214.96%0.1227
5(6.5, inf]1609144416510.25%0.1624
query_cnt_3m — 9 箱
分组号分栏TotalGoodBadBad RateWOE
1(-inf, 0.5]55028826247.64%-0.1355
2(0.5, 1.5]112372439935.53%-0.1345
3(1.5, 2.5]1627115147629.26%-0.0995
4(2.5, 3.5]1785138440122.46%-0.0106
5(3.5, 4.5]1665136530018.02%0.0523
6(4.5, 5.5]1347112722016.33%0.0646
7(5.5, 6.5]102689712912.57%0.0882
8(6.5, 8.5]109897012811.66%0.1031
9(8.5, inf]580547335.69%0.0940
bank_997_cnt_3m — 4 箱
分组号分栏TotalGoodBadBad RateWOE
1(-inf, 0.5]3447289954815.90%0.1392
2(0.5, 1.5]3739292881121.69%0.0012
3(1.5, 2.5]2224165556925.58%-0.0648
4(2.5, inf]139197142030.19%-0.0990

注:统计入模变量经合并调整后的最终分箱明细(开发样本口径)。当前流程细/粗分箱由同一自动分箱算法直接产出。

05 变量筛选

项目内容
筛选优先级黑名单 > 白名单 > 自动规则
IV 下限0.02
缺失率上限0.8
集中度上限0.9
相关性上限(皮尔逊)0.7
PSI 上限0.25
重要性 Top-K80
黑名单无
白名单无

候选变量 18,成功分箱 18,入模 7

变量白名单入模IV缺失率集中度IV门槛相关性PSI剔除原因
risk_score—N0.1272PASSPASSPASSFAIL0.0037与 risk_score_v2 相关>0.7
ScoreCust2—N0.1191PASSPASSPASSFAIL0.0026与 risk_score_v2 相关>0.7
cust_seg2—Y0.1060PASSPASSPASSPASS0.0005
income_grade—Y0.0632PASSPASSPASSPASS0.0009
bh_a001—N0.1128PASSPASSPASSFAIL0.0027与 risk_score_v2 相关>0.7
bh_a009—N0.0991PASSPASSPASSFAIL0.0012与 risk_score_v2 相关>0.7
bank_997_cnt_3m—Y0.0246PASSPASSPASSPASS0.0010
avg_tnr—Y0.0751PASSPASSPASSPASS0.0030
repay_amt_6m_grade—Y0.0607PASSPASSPASSPASS0.0007
tenure_m—N0.0170PASSPASSFAIL——IV<0.02
query_cnt_3m—Y0.0483PASSPASSPASSPASS0.0014
card_usage_ratio—N0.0183PASSPASSFAIL——IV<0.02
rare_field—N0.0827FAILPASS———缺失率>0.8
flag_special—N0.0000PASSFAIL———集中度>0.9
edu_level—N0.0004PASSPASSFAIL——IV<0.02
region_code—N0.0004PASSPASSFAIL——IV<0.02
risk_score_v2—Y0.1290PASSPASSPASSPASS0.0032
ScoreCust2_v2—N0.1262PASSPASSPASSFAIL0.0020与 risk_score_v2 相关>0.7

06 回归结果

硬门槛:P≥0.1 / VIF>4.0 迭代剔除,共 0 个变量被剔除(1 轮)。

ParameterLabelEstimate(无惩罚)Standard ErrorWald Chi-SquarePr > ChiSqStandardized Estimate
InterceptIntercept-1.34180.02672521.30<0.0001—
WOE_risk_score_v2risk_score_v2-4.84530.2906278.00<0.0001-0.6912
WOE_cust_seg2cust_seg2-0.37360.17424.600.0319-0.0659
WOE_avg_tnravg_tnr-1.26160.275221.02<0.0001-0.1411
WOE_income_gradeincome_grade-0.64720.22518.260.0040-0.0814
WOE_repay_amt_6m_graderepay_amt_6m_grade-0.49050.22974.560.0327-0.0605
WOE_query_cnt_3mquery_cnt_3m-0.72750.33824.630.0315-0.0632
WOE_bank_997_cnt_3mbank_997_cnt_3m-0.77230.29666.780.0092-0.0689

注:Estimate 列为无惩罚(精确推断)拟合;生产系数保持 L2 正则(model_results.json / score.py 口径),两套估计并列展示。标准误基于无惩罚似然观测信息矩阵。

07 VIF

VIF

ParameterVIF
risk_score_v22.87240
cust_seg21.61868
avg_tnr1.69886
income_grade1.31863
repay_amt_6m_grade1.33480
query_cnt_3m1.44759
bank_997_cnt_3m1.06846

相关系数(WOE 转换后,开发样本)

risk_score_v2cust_seg2avg_tnrincome_graderepay_amt_6m_gradequery_cnt_3mbank_997_cnt_3m
risk_score_v21.0000.6080.6340.4820.4920.5460.246
cust_seg20.6081.0000.4350.3330.3520.3850.176
avg_tnr0.6340.4351.0000.3430.3500.3920.178
income_grade0.4820.3330.3431.0000.2770.3100.152
repay_amt_6m_grade0.4920.3520.3500.2771.0000.3050.137
query_cnt_3m0.5460.3850.3920.3100.3051.0000.155
bank_997_cnt_3m0.2460.1760.1780.1520.1370.1551.000

08 最终评分卡

标准分600
标准ODD50
PDO20
变量分栏WOECoefficientScorecard Points
risk_score_v2(-inf, 495.5]0.2336-4.5742106
(495.5, 518.5]0.1453-4.574294
(518.5, 527.5]0.0507-4.574282
(527.5, 537.5]0.0735-4.574285
(537.5, 563.5]0.1126-4.574290
(563.5, 584.5]0.0022-4.574275
(584.5, 602.5]-0.0625-4.574267
(602.5, 615.5]-0.0759-4.574265
(615.5, 643.5]-0.1927-4.574250
(643.5, inf]-0.2656-4.574240
cust_seg2(-inf, 3.5]0.2166-0.437178
(3.5, 4.5]0.1501-0.437177
(4.5, 5.5]-0.0668-0.437174
(5.5, inf]-0.2705-0.437172
avg_tnr(-inf, 2.149999976158142]-0.2194-1.340767
(2.149999976158142, 3.350000023841858]-0.1276-1.340770
(3.350000023841858, 4.450000047683716]-0.0706-1.340772
(4.450000047683716, 4.8500001430511475]-0.0083-1.340775
(4.8500001430511475, 5.450000047683716]0.0128-1.340776
(5.450000047683716, 5.950000047683716]-0.0051-1.340775
(5.950000047683716, 7.3500001430511475]0.0646-1.340778
(7.3500001430511475, 8.550000190734863]0.1390-1.340780
(8.550000190734863, 9.449999809265137]0.0651-1.340778
(9.449999809265137, inf]0.1602-1.340781
income_grade(-inf, 3.5]-0.1736-0.685872
(3.5, 4.5]-0.1417-0.685872
(4.5, 5.5]0.0398-0.685876
(5.5, 6.5]0.1484-0.685878
(6.5, inf]0.1419-0.685878
repay_amt_6m_grade(-inf, 3.5]-0.1915-0.537072
(3.5, 4.5]-0.1049-0.537073
(4.5, 5.5]0.0305-0.537076
(5.5, 6.5]0.1227-0.537077
(6.5, inf]0.1624-0.537078
query_cnt_3m(-inf, 0.5]-0.1355-0.754372
(0.5, 1.5]-0.1345-0.754372
(1.5, 2.5]-0.0995-0.754373
(2.5, 3.5]-0.0106-0.754375
(3.5, 4.5]0.0523-0.754376
(4.5, 5.5]0.0646-0.754377
(5.5, 6.5]0.0882-0.754377
(6.5, 8.5]0.1031-0.754377
(8.5, inf]0.0940-0.754377
bank_997_cnt_3m(-inf, 0.5]0.1392-0.745878
(0.5, 1.5]0.0012-0.745875
(1.5, 2.5]-0.0648-0.745874
(2.5, inf]-0.0990-0.745873

09 模型表现

模型区分度评估(按样本)

模型样本KSAUCGINI
LR + WOE 评分卡开发样本0.37790.75200.5040
LR + WOE 评分卡测试样本0.36520.74440.4888
LR + WOE 评分卡训练+测试样本0.37090.74890.4978
LR + WOE 评分卡跨时间验证样本0.34260.72880.4576
LR + WOE 评分卡PSI时点样本0.37500.74550.4910

LR + WOE 评分卡 — 4 样本评估表(score_cut 粒度)

开发样本(KS 0.3779,AUC 0.7520)

cutscntbadgoodbad_ratepopulation_pctcum_bad_ratecum_good_rate
(0.0437, 0.0598]10824110413.79%10.02%1.75%12.32%
(0.0598, 0.0910]10797110086.58%9.99%4.77%24.24%
(0.0910, 0.1114]108111296910.36%10.01%9.54%35.70%
(0.1114, 0.1293]107914493513.35%9.99%15.67%46.76%
(0.1293, 0.1567]108015192913.98%10.00%22.10%57.75%
(0.1568, 0.2061]108020387718.80%10.00%30.75%68.13%
(0.2061, 0.2612]108026981124.91%10.00%42.21%77.72%
(0.2612, 0.3293]108029978127.69%10.00%54.94%86.96%
(0.3297, 0.4877]108043564540.28%10.00%73.47%94.59%
(0.4878, 0.6655]108062345757.69%10.00%100.00%100.00%

测试样本(KS 0.3652,AUC 0.7444)

cutscntbadgoodbad_ratepopulation_pctcum_bad_ratecum_good_rate
(0.0437, 0.0587]720306904.17%10.00%1.92%12.24%
(0.0587, 0.0910]720496716.81%10.00%5.05%24.15%
(0.0910, 0.1112]7208563511.81%10.00%10.49%35.42%
(0.1112, 0.1294]7208963112.36%10.00%16.18%46.62%
(0.1295, 0.1532]72010161914.03%10.00%22.63%57.60%
(0.1532, 0.2041]71913958019.33%9.99%31.52%67.90%
(0.2043, 0.2621]72018453625.56%10.00%43.29%77.41%
(0.2622, 0.3280]72021350729.58%10.00%56.91%86.41%
(0.3282, 0.4782]72026945137.36%10.00%74.10%94.41%
(0.4785, 0.6655]72040531556.25%10.00%100.00%100.00%

训练+测试样本(KS 0.3709,AUC 0.7489)

cutscntbadgoodbad_ratepopulation_pctcum_bad_ratecum_good_rate
(0.0437, 0.0591]18007117293.94%10.00%1.81%12.27%
(0.0591, 0.0910]180012016806.67%10.00%4.88%24.20%
(0.0910, 0.1113]1800198160211.00%10.00%9.94%35.57%
(0.1113, 0.1294]1800230157012.78%10.00%15.82%46.71%
(0.1294, 0.1554]1800255154514.17%10.00%22.34%57.68%
(0.1554, 0.2053]1800342145819.00%10.00%31.08%68.03%
(0.2053, 0.2614]1800452134825.11%10.00%42.64%77.60%
(0.2614, 0.3286]1800510129028.33%10.00%55.67%86.75%
(0.3287, 0.4844]1800710109039.44%10.00%73.82%94.49%
(0.4845, 0.6655]1800102477656.89%10.00%100.00%100.00%

跨时间验证样本(KS 0.3426,AUC 0.7288)

cutscntbadgoodbad_ratepopulation_pctcum_bad_ratecum_good_rate
(0.0437, 0.0598]600225783.67%10.00%1.60%12.50%
(0.0600, 0.0910]600565449.33%10.00%5.67%24.26%
(0.0910, 0.1119]6007352712.17%10.00%10.97%35.66%
(0.1120, 0.1300]6009950116.50%10.00%18.17%46.50%
(0.1301, 0.1575]6008451614.00%10.00%24.27%57.66%
(0.1575, 0.2072]60013346722.17%10.00%33.94%67.76%
(0.2076, 0.2579]60016543527.50%10.00%45.93%77.16%
(0.2580, 0.3281]60018241830.33%10.00%59.16%86.20%
(0.3282, 0.4824]60023936139.83%10.00%76.53%94.01%
(0.4824, 0.6655]60032327753.83%10.00%100.00%100.00%

注:score_cut 表基于模型输出 PD 等频分 10 档(分数升序),每表附 KS/AUC;训练+测试 = TRAIN 全体。

10 KS和GINI

LR + WOE 评分卡

样本KSGINIAUC
开发样本0.37790.50400.7520
测试样本0.36520.48880.7444
训练+测试样本0.37090.49780.7489
跨时间验证样本0.34260.45760.7288
PSI时点样本0.37500.49100.7455

开发样本

2026-10-10T14:00:07.136772 image/svg+xml Matplotlib v3.10.9, https://matplotlib.org/ 2026-10-10T14:00:07.205079 image/svg+xml Matplotlib v3.10.9, https://matplotlib.org/

测试样本

2026-10-10T14:00:07.272418 image/svg+xml Matplotlib v3.10.9, https://matplotlib.org/ 2026-10-10T14:00:07.339609 image/svg+xml Matplotlib v3.10.9, https://matplotlib.org/

训练+测试样本

2026-10-10T14:00:07.406935 image/svg+xml Matplotlib v3.10.9, https://matplotlib.org/ 2026-10-10T14:00:07.474398 image/svg+xml Matplotlib v3.10.9, https://matplotlib.org/

跨时间验证样本

2026-10-10T14:00:07.542122 image/svg+xml Matplotlib v3.10.9, https://matplotlib.org/ 2026-10-10T14:00:07.610886 image/svg+xml Matplotlib v3.10.9, https://matplotlib.org/

注:GINI = 2×AUC−1。KS 图 X 轴为分数(升序),红虚线为最大间隔位置;ROC 图例标注 AUC。

11 PSI

模型稳定性评估

模型训练集与测试集训练集与跨时间验证训练集与oot验证集训练集与psi验证集
LR + WOE 评分卡0.00270.0016—0.0023

分数段 PSI 明细(开发样本 vs 跨时间验证样本)

分数段开发样本占比跨时间验证样本占比PSI 贡献累计 PSI
(-inf,0.0598]10.00%9.95%0.00000.0000
(0.0598,0.091]10.00%10.03%0.00000.0000
(0.091,0.1114]10.00%9.68%0.00010.0001
(0.1114,0.1293]10.00%10.02%0.00000.0001
(0.1293,0.1567]10.00%10.10%0.00000.0001
(0.1567,0.2061]10.01%9.75%0.00010.0002
(0.2061,0.2612]10.00%11.02%0.00100.0012
(0.2612,0.3293]9.98%9.57%0.00020.0013
(0.3293,0.4877]10.00%10.28%0.00010.0014
(0.4877,inf]10.02%9.60%0.00020.0016
2026-10-10T14:00:07.689247 image/svg+xml Matplotlib v3.10.9, https://matplotlib.org/

分数段 PSI 明细(开发样本 vs PSI时点样本)

分数段开发样本占比PSI时点占比PSI 贡献累计 PSI
(-inf,0.0598]10.00%9.65%0.00010.0001
(0.0598,0.091]10.00%9.75%0.00010.0002
(0.091,0.1114]10.00%10.25%0.00010.0002
(0.1114,0.1293]10.00%10.67%0.00040.0007
(0.1293,0.1567]10.00%10.43%0.00020.0009
(0.1567,0.2061]10.01%10.27%0.00010.0009
(0.2061,0.2612]10.00%9.50%0.00030.0012
(0.2612,0.3293]9.98%9.00%0.00100.0022
(0.3293,0.4877]10.00%10.23%0.00010.0023
(0.4877,inf]10.02%10.25%0.00010.0023
2026-10-10T14:00:07.825146 image/svg+xml Matplotlib v3.10.9, https://matplotlib.org/

模型样本量分布评估

评分段开发样本样本量开发样本占比测试样本样本量测试样本占比训练+测试样本样本量训练+测试样本占比跨时间验证样本样本量跨时间验证样本占比PSI时点样本样本量PSI时点样本占比
(-inf, inf]108010.00%75110.43%183110.17%5979.95%5799.65%
(0.0598, 0.091]108010.00%6859.52%17659.81%60210.03%5859.75%
(0.091, 0.1114]108010.00%73510.21%181510.08%5819.68%61510.25%
(0.1114, 0.1293]108010.00%7039.77%17839.91%60110.02%64010.67%
(0.1293, 0.1567]108010.00%79211.00%187210.40%60610.10%62610.43%
(0.1567, 0.2061]108110.01%6809.45%17619.78%5859.75%61610.27%
(0.2061, 0.2612]108010.00%6899.57%17699.83%66111.02%5709.50%
(0.2612, 0.3293]10789.98%73710.24%181510.08%5749.57%5409.00%
(0.3293, 0.4877]108010.00%75310.46%183310.18%61710.28%61410.23%
(0.4877, inf]108210.02%6749.36%17569.76%5769.60%61510.25%
sum10801100.00%7199100.00%18000100.00%6000100.00%6000100.00%

变量 PSI(开发样本 vs PSI时点样本,按入模变量分箱)

特征项PSI状态
risk_score_v20.0032稳定
avg_tnr0.0030稳定
query_cnt_3m0.0014稳定
bank_997_cnt_3m0.0010稳定
income_grade0.0009稳定
repay_amt_6m_grade0.0007稳定
cust_seg20.0005稳定
risk_score_v2 — PSI 0.0032
分栏开发基准比例PSI时点样本 比例变更贡献
(-inf, 495.5]13.02%12.23%-0.78%0.0005
(495.5, 518.5]10.23%11.20%0.97%0.0009
(518.5, 527.5]5.09%5.32%0.22%0.0001
(527.5, 537.5]5.92%6.25%0.33%0.0002
(537.5, 563.5]17.98%18.28%0.30%0.0001
(563.5, 584.5]14.67%14.03%-0.64%0.0003
(584.5, 602.5]10.93%10.13%-0.80%0.0006
(602.5, 615.5]6.18%5.78%-0.39%0.0003
(615.5, 643.5]9.13%9.52%0.39%0.0002
(643.5, inf]6.85%7.25%0.40%0.0002
cust_seg2 — PSI 0.0005
分栏开发基准比例PSI时点样本 比例变更贡献
(-inf, 3.5]19.04%19.07%0.03%0.0000
(3.5, 4.5]30.86%30.50%-0.36%0.0000
(4.5, 5.5]30.83%31.77%0.94%0.0003
(5.5, inf]19.28%18.67%-0.61%0.0002
avg_tnr — PSI 0.0030
分栏开发基准比例PSI时点样本 比例变更贡献
(-inf, 2.149999976158142]8.57%8.88%0.31%0.0001
(2.149999976158142, 3.350000023841858]8.90%8.87%-0.03%0.0000
(3.350000023841858, 4.450000047683716]11.65%11.57%-0.08%0.0000
(4.450000047683716, 4.8500001430511475]5.09%5.18%0.09%0.0000
(4.8500001430511475, 5.450000047683716]7.73%7.87%0.14%0.0000
(5.450000047683716, 5.950000047683716]6.93%6.62%-0.31%0.0001
(5.950000047683716, 7.3500001430511475]19.41%18.15%-1.26%0.0009
(7.3500001430511475, 8.550000190734863]13.68%13.52%-0.17%0.0000
(8.550000190734863, 9.449999809265137]6.98%8.15%1.17%0.0018
(9.449999809265137, inf]11.05%11.20%0.15%0.0000
income_grade — PSI 0.0009
分栏开发基准比例PSI时点样本 比例变更贡献
(-inf, 3.5]11.21%10.70%-0.51%0.0002
(3.5, 4.5]23.24%23.15%-0.09%0.0000
(4.5, 5.5]31.12%31.07%-0.05%0.0000
(5.5, 6.5]23.17%24.25%1.08%0.0005
(6.5, inf]11.26%10.83%-0.42%0.0002
repay_amt_6m_grade — PSI 0.0007
分栏开发基准比例PSI时点样本 比例变更贡献
(-inf, 3.5]15.25%14.83%-0.42%0.0001
(3.5, 4.5]21.00%21.75%0.75%0.0003
(4.5, 5.5]27.69%26.92%-0.78%0.0002
(5.5, 6.5]21.16%21.43%0.27%0.0000
(6.5, inf]14.90%15.07%0.17%0.0000
query_cnt_3m — PSI 0.0014
分栏开发基准比例PSI时点样本 比例变更贡献
(-inf, 0.5]5.09%5.28%0.19%0.0001
(0.5, 1.5]10.40%10.45%0.05%0.0000
(1.5, 2.5]15.06%14.95%-0.11%0.0000
(2.5, 3.5]16.53%16.27%-0.26%0.0000
(3.5, 4.5]15.42%15.28%-0.13%0.0000
(4.5, 5.5]12.47%13.08%0.61%0.0003
(5.5, 6.5]9.50%9.20%-0.30%0.0001
(6.5, 8.5]10.17%10.67%0.50%0.0002
(8.5, inf]5.37%4.82%-0.55%0.0006
bank_997_cnt_3m — PSI 0.0010
分栏开发基准比例PSI时点样本 比例变更贡献
(-inf, 0.5]31.91%32.48%0.57%0.0001
(0.5, 1.5]34.62%35.27%0.65%0.0001
(1.5, 2.5]20.59%20.35%-0.24%0.0000
(2.5, inf]12.88%11.90%-0.98%0.0008

注:PSI ≤ 0.1 视为稳定,0.1~0.25 需关注,> 0.25 不稳定。

12 单变量分析

注:统计所有入模变量的单变量分析(开发样本口径)。预留验证/总体/OOT 口径的分组明细待扩展。

risk_score_v2
组号ValueTot. Records累计占比#Goods#BadsBad RateG/B Odds
1(-inf, 495.5]140613.02%1353533.77%25.53
2(495.5, 518.5]110523.25%1019867.78%11.85
3(518.5, 527.5]55028.34%4816912.55%6.97
4(527.5, 537.5]63934.26%5746510.17%8.83
5(537.5, 563.5]194252.24%165628614.73%5.79
6(563.5, 584.5]158566.91%124334221.58%3.63
7(584.5, 602.5]118177.84%85332827.77%2.60
8(602.5, 615.5]66784.02%44222533.73%1.96
9(615.5, 643.5]98693.15%55143544.12%1.27
10(643.5, inf]740100.00%28145962.03%0.61
合计108018453234821.74%3.60
cust_seg2
组号ValueTot. Records累计占比#Goods#BadsBad RateG/B Odds
1(-inf, 3.5]205619.04%18671899.19%9.88
2(3.5, 4.5]333349.89%282251115.33%5.52
3(4.5, 5.5]333080.72%250582524.77%3.04
4(5.5, inf]2082100.00%125982339.53%1.53
合计108018453234821.74%3.60
avg_tnr
组号ValueTot. Records累计占比#Goods#BadsBad RateG/B Odds
1(-inf, 2.149999976158142]9268.57%47445248.81%1.05
2(2.149999976158142, 3.350000023841858]96117.47%60935236.63%1.73
3(3.350000023841858, 4.450000047683716]125829.12%90335528.22%2.54
4(4.450000047683716, 4.8500001430511475]55034.21%42212823.27%3.30
5(4.8500001430511475, 5.450000047683716]83541.94%66716820.12%3.97
6(5.450000047683716, 5.950000047683716]74848.87%58016822.46%3.45
7(5.950000047683716, 7.3500001430511475]209768.28%172237517.88%4.59
8(7.3500001430511475, 8.550000190734863]147881.96%131316511.16%7.96
9(8.550000190734863, 9.449999809265137]75488.95%6579712.86%6.77
10(9.449999809265137, inf]1194100.00%1106887.37%12.57
合计108018453234821.74%3.60
income_grade
组号ValueTot. Records累计占比#Goods#BadsBad RateG/B Odds
1(-inf, 3.5]121111.21%74346838.65%1.59
2(3.5, 4.5]251034.45%176674429.64%2.37
3(4.5, 5.5]336165.57%268967219.99%4.00
4(5.5, 6.5]250388.74%215035314.10%6.09
5(6.5, inf]1216100.00%11051119.13%9.95
合计108018453234821.74%3.60
repay_amt_6m_grade
组号ValueTot. Records累计占比#Goods#BadsBad RateG/B Odds
1(-inf, 3.5]164715.25%104760036.43%1.75
2(3.5, 4.5]226836.25%163463427.95%2.58
3(4.5, 5.5]299163.94%238460720.29%3.93
4(5.5, 6.5]228685.10%194434214.96%5.68
5(6.5, inf]1609100.00%144416510.25%8.75
合计108018453234821.74%3.60
query_cnt_3m
组号ValueTot. Records累计占比#Goods#BadsBad RateG/B Odds
1(-inf, 0.5]5505.09%28826247.64%1.10
2(0.5, 1.5]112315.49%72439935.53%1.81
3(1.5, 2.5]162730.55%115147629.26%2.42
4(2.5, 3.5]178547.08%138440122.46%3.45
5(3.5, 4.5]166562.49%136530018.02%4.55
6(4.5, 5.5]134774.97%112722016.33%5.12
7(5.5, 6.5]102684.46%89712912.57%6.95
8(6.5, 8.5]109894.63%97012811.66%7.58
9(8.5, inf]580100.00%547335.69%16.58
合计108018453234821.74%3.60
bank_997_cnt_3m
组号ValueTot. Records累计占比#Goods#BadsBad RateG/B Odds
1(-inf, 0.5]344731.91%289954815.90%5.29
2(0.5, 1.5]373966.53%292881121.69%3.61
3(1.5, 2.5]222487.12%165556925.58%2.91
4(2.5, inf]1391100.00%97142030.19%2.31
合计108018453234821.74%3.60

13 压力测试

注:验证压力情境下模型的有效性和区分能力稳定性:a.坏浓度更高样本 b.时间外样本 c.特定特征客群 d.极端时间样本。当前流程自动生成情景1(跨时间样本)与情景2(跨时间样本剔除一半好样本,批注16)。

测试情景1:跨时间验证样本

变量贡献度

变量贡献度
risk_score_v20.6912
avg_tnr0.1411
income_grade0.0814
bank_997_cnt_3m0.0689
cust_seg20.0659
query_cnt_3m0.0632
repay_amt_6m_grade0.0605

区分度验证 — LR + WOE 评分卡 @ 跨时间样本

KS = 0.3426,GINI = 0.4576

组号分数区间(PD)样本数累计占比GoodBad累计Good占比累计Bad占比分组坏率累计坏率分组Odds累计Odds
10.0437 ~ 0.059860010.00%5782212.50%1.60%3.67%3.67%26.2726.27
20.0600 ~ 0.091060020.00%5445611.76%5.67%9.33%6.50%9.7114.38
30.0910 ~ 0.111960030.00%5277311.40%10.97%12.17%8.39%7.2210.92
40.1120 ~ 0.130060040.00%5019910.83%18.17%16.50%10.42%5.068.60
50.1301 ~ 0.157560050.00%5168411.16%24.27%14.00%11.13%6.147.98
60.1575 ~ 0.207260060.00%46713310.10%33.94%22.17%12.97%3.516.71
70.2076 ~ 0.257960070.00%4351659.41%45.93%27.50%15.05%2.645.65
80.2580 ~ 0.328160080.00%4181829.04%59.16%30.33%16.96%2.304.90
90.3282 ~ 0.482460090.00%3612397.81%76.53%39.83%19.50%1.514.13
100.4824 ~ 0.6655600100.00%2773235.99%100.00%53.83%22.93%0.863.36
TOTALS60004624137622.93%—3.36

测试情景2:跨时间样本剔除一半好样本

指标数值
样本量6000 → 3688(剔除好样本 2312)
KS0.3372
AUC0.7250
GINI0.4500

注:情景2 模拟好样本分布右移的压力情形(固定 seed=42,可复现);剔除后 KS/AUC 下降幅度反映模型对好样本结构的敏感度。