shap_df added

README.md

@@ -26,15 +26,15 @@ We use a pretrained model to predict credit scores and deploy that model as an A
 **PyTest** - Testing of Web APP functionality through
 **EvidentlyAI** - Data Drift detection
 
-# Outline of Readme
+## Scope of Readme
 
 We will cover in the readme the below concepts:
 
 
-1) How to create dockerfile for ML API deployment using FastAPI?
+1) How to create dockerfile for ML API deployment using FastAPI
 2) How to run different docker commands to build, run and debug and 
 3) How to push docker image to Github using Github Actions
-4) How to test ML API endpoint which is exposed by the running ML API docker container?
+4) How to test ML API endpoint which is exposed by the running ML API docker container
 
 ## The data
 The data is provided by [Home Credit](http://www.homecredit.net/about-us.aspx).

data/shap_df.csv

@@ -0,0 +1,240 @@
+Feature,SHAP Value
+NAME_CONTRACT_TYPE,0.038782335883006454
+FLAG_OWN_CAR,0.038819700938183814
+FLAG_OWN_REALTY,0.020668477218132465
+CNT_CHILDREN,0.016433383654803038
+AMT_INCOME_TOTAL,-0.0032505052344640717
+AMT_CREDIT,0.13108556543011218
+AMT_ANNUITY,-0.012226856951019726
+AMT_GOODS_PRICE,0.20034846354974434
+REGION_POPULATION_RELATIVE,0.025299963558791206
+DAYS_BIRTH,-0.33356589164905015
+DAYS_EMPLOYED,0.07460305840242654
+DAYS_REGISTRATION,0.031002802691655233
+DAYS_ID_PUBLISH,-0.013208147722762078
+OWN_CAR_AGE,0.0864520887110848
+FLAG_MOBIL,0.0
+FLAG_EMP_PHONE,0.005734374662861228
+FLAG_WORK_PHONE,-0.01712712038191967
+FLAG_CONT_MOBILE,0.0
+FLAG_PHONE,-0.025143663560738785
+FLAG_EMAIL,-0.0026300751068629325
+CNT_FAM_MEMBERS,0.015664435387006962
+REGION_RATING_CLIENT,-0.0017309780046343803
+REGION_RATING_CLIENT_W_CITY,0.0026079114351887254
+HOUR_APPR_PROCESS_START,-0.007653891134395963
+REG_REGION_NOT_LIVE_REGION,0.0
+REG_REGION_NOT_WORK_REGION,1.9793063402175903e-05
+LIVE_REGION_NOT_WORK_REGION,0.0029225912527181207
+REG_CITY_NOT_LIVE_CITY,-0.009220947958528996
+REG_CITY_NOT_WORK_CITY,0.0041747185564599935
+LIVE_CITY_NOT_WORK_CITY,0.004516934691928327
+EXT_SOURCE_1,0.43346140247886067
+EXT_SOURCE_2,0.3955993171042064
+EXT_SOURCE_3,1.1193561547761783
+APARTMENTS_AVG,0.014762127898866311
+BASEMENTAREA_AVG,0.0435473195835948
+YEARS_BEGINEXPLUATATION_AVG,0.0050534259146661495
+YEARS_BUILD_AVG,-0.009523070339346304
+COMMONAREA_AVG,0.0031380191911011936
+ELEVATORS_AVG,-0.019286696212366224
+ENTRANCES_AVG,0.005670833298936486
+FLOORSMAX_AVG,0.027631868533790113
+FLOORSMIN_AVG,-0.001393359850626439
+LANDAREA_AVG,0.007700403305934742
+LIVINGAPARTMENTS_AVG,-0.012374927320051939
+LIVINGAREA_AVG,0.005971829844638705
+NONLIVINGAPARTMENTS_AVG,-0.002775888906326145
+NONLIVINGAREA_AVG,-0.00898863242007792
+APARTMENTS_MODE,0.007571494011208415
+BASEMENTAREA_MODE,-0.04107287171762437
+YEARS_BEGINEXPLUATATION_MODE,0.012613261928781866
+YEARS_BUILD_MODE,-0.004278455022722482
+COMMONAREA_MODE,0.01135683997767046
+ELEVATORS_MODE,0.003202034513815306
+ENTRANCES_MODE,0.0011176386661827563
+FLOORSMAX_MODE,-0.0009531754348427057
+FLOORSMIN_MODE,0.001553534474223852
+LANDAREA_MODE,0.0021341438352828843
+LIVINGAPARTMENTS_MODE,0.012131838833447546
+LIVINGAREA_MODE,-0.016471828913199715
+NONLIVINGAPARTMENTS_MODE,-0.0004877180559560657
+NONLIVINGAREA_MODE,-0.0002945397119037807
+APARTMENTS_MEDI,0.007718515143496915
+BASEMENTAREA_MEDI,0.007878590303007513
+YEARS_BEGINEXPLUATATION_MEDI,0.015960935285547748
+YEARS_BUILD_MEDI,-0.0016109526163199917
+COMMONAREA_MEDI,0.0022566130640916528
+ELEVATORS_MEDI,0.0004058966180309653
+ENTRANCES_MEDI,0.012133734894450753
+FLOORSMAX_MEDI,0.004420906063169241
+FLOORSMIN_MEDI,0.004926513369427994
+LANDAREA_MEDI,0.010860861313994974
+LIVINGAPARTMENTS_MEDI,-0.015467518836958334
+LIVINGAREA_MEDI,0.006882466569077223
+NONLIVINGAPARTMENTS_MEDI,-0.0005818323977291584
+NONLIVINGAREA_MEDI,0.006068542484426871
+TOTALAREA_MODE,0.046423975613870426
+OBS_30_CNT_SOCIAL_CIRCLE,-0.0014551110682077706
+DEF_30_CNT_SOCIAL_CIRCLE,0.2170253226731438
+OBS_60_CNT_SOCIAL_CIRCLE,-0.006925748749636113
+DEF_60_CNT_SOCIAL_CIRCLE,0.14280466331751085
+DAYS_LAST_PHONE_CHANGE,-0.013490180565277114
+FLAG_DOCUMENT_2,0.0
+FLAG_DOCUMENT_3,0.02598085247213021
+FLAG_DOCUMENT_4,0.0
+FLAG_DOCUMENT_5,0.0
+FLAG_DOCUMENT_6,-0.0018930379580706358
+FLAG_DOCUMENT_7,0.0
+FLAG_DOCUMENT_8,0.0006329385004937649
+FLAG_DOCUMENT_9,-0.002360733151435852
+FLAG_DOCUMENT_10,0.0
+FLAG_DOCUMENT_11,0.0007400897145271302
+FLAG_DOCUMENT_12,0.0
+FLAG_DOCUMENT_13,0.0
+FLAG_DOCUMENT_14,0.00047871612012386324
+FLAG_DOCUMENT_15,0.0
+FLAG_DOCUMENT_16,0.0
+FLAG_DOCUMENT_17,0.0
+FLAG_DOCUMENT_18,0.0
+FLAG_DOCUMENT_19,0.0
+FLAG_DOCUMENT_20,0.0
+FLAG_DOCUMENT_21,0.0
+AMT_REQ_CREDIT_BUREAU_HOUR,0.0
+AMT_REQ_CREDIT_BUREAU_DAY,0.0
+AMT_REQ_CREDIT_BUREAU_WEEK,0.0007513779914006591
+AMT_REQ_CREDIT_BUREAU_MON,0.01287175488541834
+AMT_REQ_CREDIT_BUREAU_QRT,0.015236670533195138
+AMT_REQ_CREDIT_BUREAU_YEAR,-0.0171734587312676
+CODE_GENDER_F,0.09022477714286652
+CODE_GENDER_M,0.10453710997506277
+NAME_TYPE_SUITE_Children,0.0
+NAME_TYPE_SUITE_Family,-0.00031825471669435503
+NAME_TYPE_SUITE_Group of people,0.0
+NAME_TYPE_SUITE_Other_A,0.0
+NAME_TYPE_SUITE_Other_B,0.0
+"NAME_TYPE_SUITE_Spouse, partner",9.132366394624113e-06
+NAME_TYPE_SUITE_Unaccompanied,0.006624596670735628
+NAME_INCOME_TYPE_Businessman,0.0
+NAME_INCOME_TYPE_Commercial associate,0.0018028749641962349
+NAME_INCOME_TYPE_Pensioner,0.031810121678281573
+NAME_INCOME_TYPE_State servant,0.0026911034155637026
+NAME_INCOME_TYPE_Student,0.0
+NAME_INCOME_TYPE_Unemployed,0.0
+NAME_INCOME_TYPE_Working,0.02081537792691961
+NAME_EDUCATION_TYPE_Academic degree,0.0
+NAME_EDUCATION_TYPE_Higher education,0.0253620105877053
+NAME_EDUCATION_TYPE_Incomplete higher,0.0005573251564055681
+NAME_EDUCATION_TYPE_Lower secondary,-0.0018126114923506975
+NAME_EDUCATION_TYPE_Secondary / secondary special,0.045926076197065416
+NAME_FAMILY_STATUS_Civil marriage,-0.004966496971901506
+NAME_FAMILY_STATUS_Married,0.02213730079238303
+NAME_FAMILY_STATUS_Separated,0.0016189922741614282
+NAME_FAMILY_STATUS_Single / not married,0.03865088981576264
+NAME_FAMILY_STATUS_Widow,-0.0008589461119845509
+NAME_HOUSING_TYPE_Co-op apartment,0.0
+NAME_HOUSING_TYPE_House / apartment,0.0009152330132201314
+NAME_HOUSING_TYPE_Municipal apartment,-0.0029521397408097984
+NAME_HOUSING_TYPE_Office apartment,0.00045485261827707293
+NAME_HOUSING_TYPE_Rented apartment,-0.0004083488089963794
+NAME_HOUSING_TYPE_With parents,0.0004647874925285578
+OCCUPATION_TYPE_Accountants,0.0
+OCCUPATION_TYPE_Cleaning staff,-0.00041546668857336046
+OCCUPATION_TYPE_Cooking staff,0.0
+OCCUPATION_TYPE_Core staff,0.012199191476684064
+OCCUPATION_TYPE_Drivers,-0.0007564437156543136
+OCCUPATION_TYPE_HR staff,0.0
+OCCUPATION_TYPE_High skill tech staff,0.004946327265352011
+OCCUPATION_TYPE_IT staff,0.0
+OCCUPATION_TYPE_Laborers,0.008165495175053366
+OCCUPATION_TYPE_Low-skill Laborers,0.0
+OCCUPATION_TYPE_Managers,0.0007608735421672463
+OCCUPATION_TYPE_Medicine staff,4.157194867730141e-05
+OCCUPATION_TYPE_Private service staff,-3.6902674473822117e-05
+OCCUPATION_TYPE_Realty agents,0.0
+OCCUPATION_TYPE_Sales staff,-0.00040875707287341356
+OCCUPATION_TYPE_Secretaries,0.0
+OCCUPATION_TYPE_Security staff,-0.0010708563588559628
+OCCUPATION_TYPE_Waiters/barmen staff,-0.0005666507594287395
+WEEKDAY_APPR_PROCESS_START_FRIDAY,0.0006577345100231469
+WEEKDAY_APPR_PROCESS_START_MONDAY,0.001801406778395176
+WEEKDAY_APPR_PROCESS_START_SATURDAY,0.0009151955228298902
+WEEKDAY_APPR_PROCESS_START_SUNDAY,0.001826580362394452
+WEEKDAY_APPR_PROCESS_START_THURSDAY,-0.0004260040400549769
+WEEKDAY_APPR_PROCESS_START_TUESDAY,-0.005670543540036306
+WEEKDAY_APPR_PROCESS_START_WEDNESDAY,0.038488537073135376
+ORGANIZATION_TYPE_Advertising,0.0
+ORGANIZATION_TYPE_Agriculture,-0.00025986572727561
+ORGANIZATION_TYPE_Bank,0.0009059800207614899
+ORGANIZATION_TYPE_Business Entity Type 1,0.0
+ORGANIZATION_TYPE_Business Entity Type 2,-0.0002114129438996315
+ORGANIZATION_TYPE_Business Entity Type 3,0.03097452105022967
+ORGANIZATION_TYPE_Cleaning,0.0
+ORGANIZATION_TYPE_Construction,-0.001648504938930273
+ORGANIZATION_TYPE_Culture,0.0
+ORGANIZATION_TYPE_Electricity,0.0
+ORGANIZATION_TYPE_Emergency,0.0
+ORGANIZATION_TYPE_Government,0.0
+ORGANIZATION_TYPE_Hotel,0.0
+ORGANIZATION_TYPE_Housing,0.0
+ORGANIZATION_TYPE_Industry: type 1,0.0
+ORGANIZATION_TYPE_Industry: type 10,0.0
+ORGANIZATION_TYPE_Industry: type 11,-0.001432010279968381
+ORGANIZATION_TYPE_Industry: type 12,0.0009353628754615784
+ORGANIZATION_TYPE_Industry: type 13,0.0
+ORGANIZATION_TYPE_Industry: type 2,0.0
+ORGANIZATION_TYPE_Industry: type 3,-0.0003750150557607412
+ORGANIZATION_TYPE_Industry: type 4,0.0
+ORGANIZATION_TYPE_Industry: type 5,0.0
+ORGANIZATION_TYPE_Industry: type 6,0.0
+ORGANIZATION_TYPE_Industry: type 7,0.0
+ORGANIZATION_TYPE_Industry: type 8,0.0
+ORGANIZATION_TYPE_Industry: type 9,-0.0003825622051954269
+ORGANIZATION_TYPE_Insurance,0.0
+ORGANIZATION_TYPE_Kindergarten,-0.0010459277965128421
+ORGANIZATION_TYPE_Legal Services,0.0
+ORGANIZATION_TYPE_Medicine,0.0010874632163904608
+ORGANIZATION_TYPE_Military,0.003905915874056518
+ORGANIZATION_TYPE_Mobile,0.0
+ORGANIZATION_TYPE_Other,-0.0003257371624931693
+ORGANIZATION_TYPE_Police,0.0
+ORGANIZATION_TYPE_Postal,-0.0009512394666671753
+ORGANIZATION_TYPE_Realtor,0.0
+ORGANIZATION_TYPE_Religion,0.0
+ORGANIZATION_TYPE_Restaurant,0.0
+ORGANIZATION_TYPE_School,-0.0004575955681502819
+ORGANIZATION_TYPE_Security,-0.0009844427555799485
+ORGANIZATION_TYPE_Security Ministries,0.0
+ORGANIZATION_TYPE_Self-employed,-0.006334636372048408
+ORGANIZATION_TYPE_Services,0.0
+ORGANIZATION_TYPE_Telecom,0.0
+ORGANIZATION_TYPE_Trade: type 1,0.0
+ORGANIZATION_TYPE_Trade: type 2,0.0
+ORGANIZATION_TYPE_Trade: type 3,-0.001562304999679327
+ORGANIZATION_TYPE_Trade: type 4,0.0
+ORGANIZATION_TYPE_Trade: type 5,0.0
+ORGANIZATION_TYPE_Trade: type 6,0.0
+ORGANIZATION_TYPE_Trade: type 7,-0.001144047942943871
+ORGANIZATION_TYPE_Transport: type 1,0.0
+ORGANIZATION_TYPE_Transport: type 2,-0.00036535035818815233
+ORGANIZATION_TYPE_Transport: type 3,0.0
+ORGANIZATION_TYPE_Transport: type 4,-1.6193001065403224e-05
+ORGANIZATION_TYPE_University,0.0007486658170819283
+ORGANIZATION_TYPE_XNA,0.0068984436732716856
+FONDKAPREMONT_MODE_not specified,0.0
+FONDKAPREMONT_MODE_org spec account,0.000459500290453434
+FONDKAPREMONT_MODE_reg oper account,0.012277663764543832
+FONDKAPREMONT_MODE_reg oper spec account,0.00011624349281191826
+HOUSETYPE_MODE_block of flats,0.0009653417905792594
+HOUSETYPE_MODE_specific housing,0.0
+HOUSETYPE_MODE_terraced house,0.0
+WALLSMATERIAL_MODE_Block,-0.0001992799248546362
+WALLSMATERIAL_MODE_Mixed,-0.0009830797463655473
+WALLSMATERIAL_MODE_Monolithic,0.0
+WALLSMATERIAL_MODE_Others,0.0
+WALLSMATERIAL_MODE_Panel,0.00043899812269955875
+"WALLSMATERIAL_MODE_Stone, brick",0.008277237648144364
+WALLSMATERIAL_MODE_Wooden,-0.0003537251055240631
+EMERGENCYSTATE_MODE_No,-0.003561630262993276
+EMERGENCYSTATE_MODE_Yes,0.0
+DAYS_EMPLOYED_ANOM,-0.0056321171624585985