External validation of the international prediction tool in Korean patients with immunoglobulin A nephropathy

Article information

Kidney Res Clin Pract. 2022;41(5):556-566
Publication date (electronic) : 2022 May 4
doi : https://doi.org/10.23876/j.krcp.22.006
1Department of Internal Medicine and Institute of Kidney Disease Research, Yonsei University College of Medicine, Seoul, Republic of Korea
2Division of Nephrology, Department of Internal Medicine, Yongin Severance Hospital, Yonsei University College of Medicine, Yongin, Republic of Korea
3Department of Internal Medicine, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Republic of Korea
4Department of Internal Medicine, Seoul National University College of Medicine, Seoul, Republic of Korea
5Department of Pathology, Yonsei University College of Medicine, Seoul, Republic of Korea
6Department of Pathology, Seoul National University College of Medicine, Seoul, Republic of Korea
7Department of Internal Medicine, Seoul National University Bundang Hospital, Seongnam, Republic of Korea
Correspondence: Seung Hyeok Han Department of Internal Medicine and Institute of Kidney Disease Research, Yonsei University College of Medicine, Seoul, 50-1 Yonsei-ro, Seodaemun-gu, Seoul 03722, Republic of Korea. E-mail: hansh@yuhs.ac
Received 2022 January 11; Revised 2022 March 2; Accepted 2022 March 2.

Abstract

Background

The International IgA Nephropathy Prediction Tool (International IgA Nephropathy Prediction Tool) has been recently developed to estimate the progression risk of immunoglobulin A nephropathy (IgAN). This study aimed to evaluate the clinical performance of this prediction tool in a large IgAN cohort in Korea.

Methods

The study cohort was comprised of 2,064 patients with biopsy-proven IgAN from four medical centers between March 2012 and September 2021. We calculated the predicted risk for each patient. The primary outcome was occurrence of a 50% decline in estimated glomerular filtration rate (eGFR) from the time of biopsy or end-stage kidney disease. The model performance was evaluated for discrimination, calibration, and reclassification. We also constructed and tested an additional model with a new coefficient for the Korean race.

Results

During a median follow-up period of 3.8 years (interquartile range, 1.8–6.6 years), 363 patients developed the primary outcome. The two prediction models exhibited good discrimination power, with a C-statistic of 0.81. The two models generally underestimated the risk of the primary outcome, with lesser underestimation for the model with race. The model with race showed better performance in reclassification compared to the model without race (net reclassification index, 0.13). The updated model with the Korean coefficient showed good agreement between predicted risk and observed outcome.

Conclusion

In Korean IgAN patients, International IgA Nephropathy Prediction Tool had good discrimination power but underestimated the risk of progression. The updated model with the Korean coefficient showed acceptable calibration and warrants external validation.

Introduction

Immunoglobulin A nephropathy (IgAN) is the most common primary glomerulonephritis worldwide [14]. Patients with IgAN have a wide range of clinical features, from benign conditions with persistent microscopic hematuria only to kidney failure [5]. Generally, 20% to 30% of patients eventually require kidney replacement therapy (KRT) within 20 years after diagnosis [1]. The current therapeutic strategies for IgAN mainly focus on reducing proteinuria. All patients are conservatively treated with lifestyle modifications, such as a low-salt and low-protein diet, smoking cessation, and blood pressure (BP) control. Renin-angiotensinogen system blockades (RASB) are recommended if urinary protein excretion exceeds 0.5 g per day [6]. Immunosuppression therapy is reserved for patients with persistent heavy proteinuria and high progression risk after maximal supportive care. Importantly, there is a time gap between disease onset and initiation of disease course-modifying treatment. In this regard, a reliable tool for risk assessment and stratification of IgAN could enable early identification of high-risk patients. This would help physicians prioritize treatment and avoid unnecessary delays.

Numerous studies have identified clinical risk predictors of progression to end-stage kidney disease (ESKD), including estimated glomerular filtration rate (eGFR) at the time of diagnosis, BP, and proteinuria in IgAN [711]. In addition, the Oxford histologic scoring system can provide useful information for predicting IgAN progression. This system was derived from a multiethnic cohort and has been validated with high reproducibility [12,13]. Thus, establishing a scoring system that incorporates histologic findings with clinical risk factors would be ideal for improving discrimination of high-risk patients. Interestingly, the prevalence and incidence of IgAN are higher in East Asia than in Western countries [1416], and IgAN patients of Pacific Asian origin are more likely to progress to ESKD than are those of other ethnicities [17]. Therefore, the IgAN risk scoring system should consider racial and ethnic variability.

Recently, the International IgA Nephropathy Network developed and externally validated two prediction models, with and without race/ethnicity. These models relied on retrospective, large, international, multiethnic IgAN cohorts with long-term follow-up [18]. Both models included mesangial and endocapillary hypercellularity, segmental glomerulosclerosis, and tubular atrophy/interstitial fibrosis (MEST) scoring of the Oxford classification and clinical parameters of age, mean arterial pressure, eGFR, and proteinuria. The two models showed excellent discrimination and calibration in the original study. Notably, although Chinese and Japanese patients were included in the study, the clinical course of IgAN varied between the two populations, and the model with race/ethnicity used different coefficients for each race. These findings led us to test the clinical performance of the prediction tool in Korean patients. Therefore, the purpose of this study was to externally validate the International IgA Nephropathy Prediction Tool using a large, multicenter, independent cohort from Korea. We also sought to determine a Korean race/ethnicity coefficient for a more accurate prediction.

Methods

Ethics statement

This study was conducted in accordance with the Declaration of Helsinki and approved by the Institutional Review Board of each participating center (Asan Medical Center, No. 2021-0031; Severance Hospital, No. 4-2021-0376; Seoul National University Hospital, H-2103-091-1205; and Seoul National University Bundang Hospital, B-1707-408-106). The requirement for informed consent was waived as the study is a retrospective, observational study with de-identified data.

Study population and clinical data set

This is a retrospective, observational study from four tertiary medical centers in Korea. We identified 2,484 patients with biopsy-proven IgAN from March 2012 to September 2021. Using the electronic health record system (EHRS), we collected all the clinical and pathologic data required to use the International IgA Nephropathy Prediction Tool. Patients were excluded who met the following criteria: 1) missing information for the Oxford classification or eGFR at biopsy or during follow-up, 2) aged <18 years, 3) diagnosed with chronic kidney disease (CKD) G5 requiring KRT at the time of biopsy, and 4) missing information for the International IgA Nephropathy Prediction Tool. Like the original study, we only included patients with one year or more of follow-up care and who developed CKD G5 or eGFR halving from baseline value within 1 year [18]. A total of 2,064 patients was included in the analytic cohort (Supplementary Fig. 1, available online).

Predictors and outcome

Clinical information collected retrospectively from the EHRS comprised demographics, BP, serum creatinine, proteinuria, and use of RASB and immunosuppressants prior to biopsy and during follow-up. Serum creatinine was determined using an isotope dilution mass spectroscopy-traceable method, and eGFR was calculated using the CKD Epidemiology Collaboration equation [19]. Proteinuria was estimated using the spot urine protein-creatinine ratio when 24-hour urinary protein excretion information was missing [20]. Renal biopsies were analyzed by the local pathologists of each participating hospital and scored using the Oxford Classification of IgAN (MEST score) [13]. The pathologists were blinded to the clinical data. The linear predictors for each patient were calculated using predictors at biopsy according to the models with and without race, as previously published (Supplementary Table 1, available online) [18].

The primary outcome was a composite of a persistent decline in eGFR ≥ 50% from the baseline value or onset of ESKD during the follow-up period. ESKD was defined as initiation of KRT including dialysis, renal transplantation, or eGFR of <15 mL/min/1.73 m2.

Statistical analysis

The performances of the two prediction models were evaluated using measures of model fit, discrimination, reclassification, and calibration. The Royston-Sauerbrei D statistic (R2D) and Akaike information criterion were used to assess model fit [21]. Discrimination was evaluated using C-statistics [22]. We calculated the coefficient of the linear predictor in our cohort data by constructing a linear predictor-only Cox proportional hazard model for the primary outcome to measure discrimination. This estimated coefficient of the linear predictor is known as the “calibration slope,” and the discrimination in the validation dataset is almost the same when the linear predictor slope is approximately 1. If the calibration slope is >1, discrimination is better in the validation data set than in the original data set [23]. Continuous net reclassification improvement (NRI) and integrated discrimination improvement (IDI) for censoring were calculated to measure reclassification [24]. The 95% confidence intervals (95% CIs) for C-statistics, NRI, and IDI were obtained from 100 bootstrap samples. The differences between survival curves were examined using the log-rank test. The annual eGFR decline rate for each risk group was calculated using a linear mixed-effects model. To assess the accuracy of risk estimates from the models, we assessed both the entire follow-up period and time-specific calibration. The mean predicted survival curves within risk groups (categorized as <15th, 15th–50th, 51st–85th, and ≥86th percentile according to the linear predictor) were compared with the observed survival curves estimated by the Kaplan-Meier method for calibration over the follow-up period. In addition, subjects were grouped into deciles according to the predicted 5-year risk and compared with the observed 5-year risks in the time-specific calibration. The difference in calibration between the predicted and observed risks was visually compared. Additional analyses were performed in sequential steps to derive a Korean coefficient by recalibrating the prediction tool for Korean patients as follows. First, the International IgA Nephropathy Prediction Tool was applied directly to the Korean analytic cohort using the linear predictor with the ‘other’ race/ethnicity coefficient and baseline survival as previously published [18]. Then, by adjusting the linear predictor’s race coefficient (the ‘other’ race/ethnicity coefficient), the model with the Korean coefficient was evaluated and tested using the calibration plot and the Kaplan-Meier plot [23]. The model with a new coefficient that precisely predicted the observed kidney outcomes during the follow-up period was visually examined, and the coefficient value of overlap between the predicted curve and the observed risk was determined as the final Korean coefficient. Two-tailed p-values of <0.05 were considered statistically significant. Data were analyzed using STATA version. 16.1 (Stata Corp., College Station, TX, USA), R version. 4.1.0 (R Core Team, Vienna, Austria), and SAS version. 9.4 (SAS Institute, Cary, NC, USA).

The study adhered to the TRIPOD (Transparent Reporting of a Multivariable Prediction Model for Individual Prognosis or Diagnosis) guidelines (Supplementary material, available online) [25].

Results

Study population characteristics

The baseline characteristics of the external validation cohort are shown in Table 1. Among the 2,064 subjects, 353 (17.1%) experienced the primary outcome (Supplementary Fig. 2, available online). The median follow-up duration was 3.8 years (interquartile range, 1.8–6.6 years), with 843 subjects (40.8%) undergoing follow-up for 5 years or more. From baseline to year 5, 246 subjects developed the primary outcome, with a corresponding probability of 16.2% (95% CI, 14.3%–18.1%).

Baseline characteristics of the Korean cohort and the original cohort

The Korean cohort was established more recently than the derivation and validation cohorts of the original study (the median years that biopsies were performed were 2014 vs. 2006 and 1998, respectively), with a smaller follow-up period (3.8 years vs. 4.8 and 5.8 years, respectively) [18]. In addition, the mean age at biopsy was higher in the Korean cohort than in the derivation and validation cohorts of the original study (41.3 years vs. 35.6 and 34.8 years, respectively), and the proportion of men was lower (44.8% vs. 57.8% and 49.3%, respectively) [18]. Our cohort had a median proteinuria of 1.0 g/day compared with 1.2 and 1.3 g/day in the two original cohorts and a median eGFR of 87.8 mL/min/1.73 m2 compared with 83.0 and 89.7 mL/min/1.73 m2 [18].

Performance of the International IgA Nephropathy Prediction Tool

The C-statistics of the model without race and the model with race in the Korean cohort were 0.81 (95% CI, 0.77–0.84) and 0.81 (95% CI, 0.78–0.85), respectively. The calibration slopes of the linear predictors were 1.08 (95% CI, 0.96–1.20) and 1.03 (95% CI, 0.92–1.14), respectively, suggesting that discrimination was comparable to that of the original derivation cohort. The risk reclassification for predicting the 5-year primary outcome development risk was slightly improved in the model with race compared to the model without race (NRI, 0.13 [95% CI, 0.08–0.29]; IDI, 0.002 [95% CI, 0–0.007]) (Table 2). The Kaplan-Meier curves between risk subgroups according to model are shown in Fig. 1. The curves were separated distinctively between the lower-risk groups (low- and intermediate-risk) and the high- and highest-risk groups, suggesting that the model without race had a good discriminatory capability. However, the distinction between the low and intermediate-risk groups was less prominent using this model. When the eGFR decline rates were compared according to risk group using the model, there was a graded decrease in eGFR across the four risk groups, with the steepest decline occurring in the highest risk group (Table 3).

Performance of the International IgA Nephropathy Prediction Tool

Figure 1.

Calibration plots.

Kaplan-Meier curves of the primary outcome between the risk groups on the basis of the linear predictors (A, C, E) and calibration curves depicting the predicted vs. observed 5-year risks of the primary outcome using the prediction models (B, D, F). Risk groups were based on percentile of the linear predictor according to model. (A, B) Original model without race. (C, D) Original model with race. (E, F) Updated model with the Korean race coefficient. (A, C, E) The dashed line of each color is the associated mean predicted primary outcome risk; the solid line of each color is the observed primary outcome risk. (B, D, F) Circle means the observed risk and vertical line means the observed 95% confidence interval. A dashed line represents perfect calibration, in which the predicted and observed risks are identical.

Rate of kidney function decline and mean predicted 5-year risk of the primary outcome in subgroups based on the linear predictor

Both baseline survival probabilities from the original study underestimated the risk compared with the survival curve observed in our cohort (Fig. 2). When the predicted risk was visually compared with the observed risk, differences were observed in most of the risk groups, suggesting that both models underestimated risk (Fig. 1A, C). Notably, the model with race underestimated risk irrespective of risk group, although the risk was more highly underestimated in the high and highest risk groups (Fig. 1C). Fig. 1B and D show the observed vs. predicted 5-year risks of the primary outcome according to decile of predicted risk. In the model without race, the observed risk in the lower risk deciles approximated a perfect calibration threshold, suggesting that the model estimated risk relatively well. In the higher deciles, the observed risk was above the perfect calibration threshold, suggesting that the model without race underestimated risk for those in the higher deciles of predicted risk (Fig. 1B). In contrast, the model with race underestimated the 5-year risk of the primary outcome for those in all risk deciles (Fig. 1D).

Figure 2.

Estimates of the baseline survival function in the reported and current data set.

Updating the prediction tool for Korean patients

Using the updating strategy as described in the statistical analysis section, we found that the Korean race/ethnicity coefficient was 0.5 (Supplementary Table 1, available online). Since we recalibrated the race/ethnicity coefficient only and our cohort included only Korean people, the C-statistics, NRI, and IDI results for predicting the 5-year primary outcome risk were identical in the two models. The predicted and observed primary outcome risks over the follow-up period and the calibration between the predicted and observed risks using the model updated with the Korean race/ethnicity coefficient are shown in Fig. 1E and F, respectively. Of note, the predicted and observed risks were consistent in the updated model, which was better than the results of the two original models using the International IgA Nephropathy Prediction Tool

Discussion

In this study, we assessed the performance of the International IgA Nephropathy Prediction Tool in a multicenter cohort with 2,064 patients from four Korean hospitals. We found that both models of the original study had good discrimination power and comparable risk stratification abilities. However, the models apparently underestimated the risk for progression in Korean patients. Notably, our updated model with the newly-derived Korean race/ethnicity coefficient accurately predicted the risk with good calibration in our cohort.

Before introduction of the International IgA Nephropathy Prediction Tool, several prognostic scoring systems for predicting progression to ESKD or mortality in IgAN patients were available [7,8,26,27]. Nonetheless, these scoring systems included only a single geographic region or race/ethnicity or used clinical and pathological findings without considering race/ethnicity [8,26,27]. In addition, previous scoring systems used a sample size of <1,000 subjects, which is insufficient for model development [7,8]. Moreover, the suggested models have not been well validated in other cohorts. The International IgA Nephropathy Prediction Tool was developed in a multinational cohort including Europe, Asia, and North and South America and externally validated in a distinct dataset with 1,146 IgAN patients. The established models included well-known clinical predictors for progression of IgAN and pathologic findings based on the Oxford classification. In the same study, the validation cohort included more patients with other races/ethnicities, with only 15.5% of the cohort being Caucasian compared with 42% in the derivation cohort, indicating that the models performed well in different ethnic, geographic, and clinical settings [18]. Several external validation studies have also reported that the International IgA Nephropathy Prediction Tool performed well in different cohorts [2830]. Considering this evidence, the recently published Kidney Disease: Improving Global Outcomes (KDIGO) guidelines for glomerular diseases advocate the use of the International IgA Nephropathy Prediction Tool for risk quantification and shared decision-making with patients [6]. Nevertheless, the original prediction models use different race coefficients for Chinese and Japanese patients, although they belong to the same East Asian group. Thus, this tool needs to be further validated in other Asian regions.

In this study, we externally validated two prediction models, with and without race, in a large Korean cohort. Generally, both models performed well for discriminating risk groups among Korean patients. The survival curves were noticeably separated among subgroups categorized according to predicted risk, and a graded decline rate in eGFR was observed as predicted risk increased. The NRI and IDI for the model with race/ethnicity were slightly improved compared to the model without race/ethnicity. Compared to the model with race/ethnicity, the model without race/ethnicity additionally included a predictor “interaction term between RASB use and proteinuria”, which might result in poorer discrimination ability and model fit. These findings indicate that applying the prediction model to newly diagnosed IgAN patients can help guide treatment for high-risk patients and avoid unnecessary treatment for patients at a low risk of disease progression.

Although both prediction models discriminated well between groups, the calibration results clearly showed that the International IgA Nephropathy Prediction Tool underestimated the risk of adverse kidney outcomes in our cohort. Unlike the original cohort comprising 42% Caucasian subjects, our study included a single ethnic population. Interestingly, a study using a racially diverse Canadian cohort from the Toronto Glomerulonephritis Registry showed that IgAN patients of Pacific Asian origin (China, Japan, Philippines, and Vietnam) had a higher risk of ESKD development and a 50% reduction in eGFR compared to those of other origins [17]. The results of this study suggest that race/ethnicity factors should be considered when constructing prediction models. In another validation study exclusively including the Chinese race, the model without race apparently underestimated the primary outcome risk, while the model with race precisely predicted the risk after 3 years [29]. Nevertheless, in our study, even the model considering race substantially underestimated the risk in Korean patients. Better calibration in the Chinese validation study is presumably because this model used the Chinese race/ethnicity coefficient. These findings underscore the need to update prediction models for diverse racial populations.

In our study, we found a Korean race coefficient of 0.50. In agreement with the findings from the original study, the model with race/ethnicity had a slightly better discrimination power than the model without race/ethnicity in our validation study. Therefore, we updated the race coefficient rather than re-estimating the coefficients for the other predictors to improve risk underestimation in the model with race/ethnicity. After the update, the estimated mean survival probability curves were parallel with the observed survival curves according to the risk group. Moreover, underestimation of risk by the original model with race was notably improved in our updated model using the Korean race coefficient. The race coefficients for Chinese and Japanese patients were 0.818 and 0.408, respectively, while that for Korean patients was 0.50, suggesting better-estimated kidney outcomes in Korean IgAN patients than in Chinese patients but worse than in Japanese patients. Not only race but also the national difference in treatment of IgAN might have resulted in the original prediction tool’s risk underestimation compared to observed risk. In fact, patients in our cohort were less commonly treated with immunosuppressants at biopsy than were those in the original cohort. In addition, tonsillectomy is more commonly performed in Japan than in other countries [6]. Therefore, using the Chinese coefficient might overestimate the risk, and the Japanese coefficient might underestimate adverse kidney outcomes in Korean IgAN patients. However, since this new model was only internally validated, external validation in other Korean cohorts is warranted.

Some limitations of this study should be noted. First, the retrospective nature of this study might have caused unpredicted confounding factors. We retrospectively collected patient data from the EHRS, and exclusion of patients without clinical or pathologic information might have led to a selection bias. In addition, we could not capture the outcome results for patients lost to follow-up, and some patients might have reached the primary outcome as a result of acute kidney injury. Moreover, the dataset did not have information on detailed treatment after biopsy, and our developed prediction model did not consider immunosuppression treatment after biopsy or the effects of specific immunosuppression agents. This might have resulted in residual confounding factors. Second, interobserver variability in MEST-C scoring can exist among pathologists [31]. In addition, management of IgAN might have differed among the four centers. Although they followed the KDIGO guidelines, immunosuppression was generally used at the physician’s discretion [32]. Nevertheless, the four centers in our study are the largest leading research-oriented hospitals in Korea, with many experienced medical faculty members. Thus, we believe our cohort can best represent the current IgAN patients in terms of diagnostic approach and management across the nation. Third, the burden of disease for the patients in our cohort might have been more severe than that of other IgAN patients in Korea. Presumably, high-risk patients are more likely to be referred to a specialized tertiary care center. Fourth, even though the International IgA Nephropathy Prediction Tool performed well in our cohort, the distinction between low- and intermediate-risk groups was poor. This was also observed in the original multiethnic cohort and in the Chinese validation cohort [18,29]. Thus, further studies are required to develop prediction tools that can stratify risk in the early stages of IgAN.

In conclusion, this study externally validated the International IgA Nephropathy Prediction Tool in a large Korean cohort. Both models had good discrimination, and the model with race had a slightly better risk stratification power. However, the models underestimated the predicted 5-year risk for adverse kidney outcomes. Given the good risk stratifying ability and calibration of our proposed model with a new ethnicity/race coefficient for Korean IgAN patients, we expect that more studies will be conducted to validate the clinical utility of our model.

Notes

Conflicts of interest

Tae-Hyun Yoo is the Editor-in-Chief of Kidney Research and Clinical Practice and was not involved in the review process of this article. All authors have no other conflicts of interest to declare.

Funding

This study was supported by a cooperative research fund from the Korean Nephrology Research Foundation (2021). The sponsor had no role in the study design, data collection, or analysis.

Authors’ contributions

Conceptualization: YSJ, HWK, HL, KCM, SHH

Data curation: YSJ, HWK, KCM, HJC, SHH

Formal analysis: YSJ, HWK, CHB, SHH

Funding acquisition: HL

Investigation: YSJ, JTP, SHH

Methodology: YSJ, CHB, JTP, HL, SHH

Project administration: HL, HJC

Visualization: YSJ, HWK, HL, SHH

Validation: YSJ, HL, SHH

Resources: HL, SHH

Supervision: BJL, THY, SWK, SHH

Writing–original draft: YSJ, HWK, JTP, HL, BJL, THY, KCM, HJC, SWK, SHH

Writing–review & editing: All authors

All authors read and approved the final manuscript.

References

1. Magistroni R, D’Agati VD, Appel GB, Kiryluk K. New developments in the genetics, pathogenesis, and therapy of IgA nephropathy. Kidney Int 2015;88:974–989.
2. D’Amico G. The commonest glomerulonephritis in the world: IgA nephropathy. Q J Med 1987;64:709–727.
3. Yim T, Kim SU, Park S, et al. Patterns in renal diseases diagnosed by kidney biopsy: a single-center experience. Kidney Res Clin Pract 2020;39:60–69.
4. Chang JH, Kim DK, Kim HW, et al. Changing prevalence of glomerular diseases in Korean adults: a review of 20 years of experience. Nephrol Dial Transplant 2009;24:2406–2410.
5. Berthoux FC, Mohey H, Afiani A. Natural history of primary IgA nephropathy. Semin Nephrol 2008;28:4–9.
6. Kidney Disease: Improving Global Outcomes (KDIGO) Glomerular Diseases Work Group. KDIGO 2021 clinical practice guideline for the management of glomerular diseases. Kidney Int 2021;100:S1–S276.
7. Bartosik LP, Lajoie G, Sugar L, Cattran DC. Predicting progression in IgA nephropathy. Am J Kidney Dis 2001;38:728–735.
8. Berthoux F, Mohey H, Laurent B, Mariat C, Afiani A, Thibaudin L. Predicting the risk for dialysis or death in IgA nephropathy. J Am Soc Nephrol 2011;22:752–761.
9. Nam KH, Kie JH, Lee MJ, et al. Optimal proteinuria target for renoprotection in patients with IgA nephropathy. PLoS One 2014;9e101935.
10. Coppo R, Lofaro D, Camilla RR, et al. Risk factors for progression in children and young adults with IgA nephropathy: an analysis of 261 cases from the VALIGA European cohort. Pediatr Nephrol 2017;32:139–150.
11. Barbour SJ, Espino-Hernandez G, Reich HN, et al. The MEST score provides earlier risk prediction in lgA nephropathy. Kidney Int 2016;89:167–175.
12. Herzenberg AM, Fogo AB, Reich HN, et al. Validation of the Oxford classification of IgA nephropathy. Kidney Int 2011;80:310–317.
13. Working Group of the International IgA Nephropathy Network and the Renal Pathology Society, Cattran DC, Coppo R, et al. The Oxford classification of IgA nephropathy: rationale, clinicopathological correlations, and classification. Kidney Int 2009;76:534–545.
14. Fischer EG, Harris AA, Carmichael B, Lathrop SL, Cerilli LA. IgA nephropathy in the triethnic population of New Mexico. Clin Nephrol 2009;72:163–169.
15. Sim JJ, Batech M, Hever A, et al. Distribution of biopsy-proven presumed primary glomerulonephropathies in 2000-2011 among a racially and ethnically diverse US population. Am J Kidney Dis 2016;68:533–544.
16. O’Shaughnessy MM, Hogan SL, Thompson BD, Coppo R, Fogo AB, Jennette JC. Glomerular disease frequencies by race, sex and region: results from the International Kidney Biopsy Survey. Nephrol Dial Transplant 2018;33:661–669.
17. Barbour SJ, Cattran DC, Kim SJ, et al. Individuals of Pacific Asian origin with IgA nephropathy have an increased risk of progression to end-stage renal disease. Kidney Int 2013;84:1017–1024.
18. Barbour SJ, Coppo R, Zhang H, et al. Evaluating a new international risk-prediction tool in IgA nephropathy. JAMA Intern Med 2019;179:942–952.
19. Levey AS, Stevens LA, Schmid CH, et al. A new equation to estimate glomerular filtration rate. Ann Intern Med 2009;150:604–612.
20. Hogan MC, Reich HN, Nelson PJ, et al. The relatively poor correlation between random and 24-hour urine protein excretion in patients with biopsy-proven glomerular diseases. Kidney Int 2016;90:1080–1089.
21. Royston P, Sauerbrei W. A new measure of prognostic separation in survival data. Stat Med 2004;23:723–748.
22. Harrell FE Jr, Lee KL, Mark DB. Multivariable prognostic models: issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors. Stat Med 1996;15:361–387.
23. Royston P, Altman DG. External validation of a Cox prognostic model: principles and methods. BMC Med Res Methodol 2013;13:33.
24. Chambless LE, Cummiskey CP, Cui G. Several methods to assess improvement in risk prediction models: extension to survival analysis. Stat Med 2011;30:22–38.
25. Collins GS, Reitsma JB, Altman DG, Moons KG. Transparent Reporting of a multivariable prediction model for Individual Prognosis or Diagnosis (TRIPOD): the TRIPOD statement. Ann Intern Med 2015;162:55–63.
26. Goto M, Wakai K, Kawamura T, Ando M, Endoh M, Tomino Y. A scoring system to predict renal outcome in IgA nephropathy: a nationwide 10-year prospective cohort study. Nephrol Dial Transplant 2009;24:3068–3074.
27. Pesce F, Diciolla M, Binetti G, et al. Clinical decision support system for end-stage kidney disease risk estimation in IgA nephropathy patients. Nephrol Dial Transplant 2016;31:80–86.
28. Zhang Y, Guo L, Wang Z, et al. External validation of international risk-prediction models of IgA nephropathy in an Asian-Caucasian cohort. Kidney Int Rep 2020;5:1753–1763.
29. Zhang J, Huang B, Liu Z, et al. External validation of the international IgA nephropathy prediction tool. Clin J Am Soc Nephrol 2020;15:1112–1120.
30. Ouyang Y, Zhao Z, Li G, et al. A validation study comparing risk prediction models of IgA nephropathy. Front Immunol 2021;12:753901.
31. Bellur SS, Roberts I, Troyanov S, et al. Reproducibility of the Oxford classification of immunoglobulin A nephropathy, impact of biopsy scoring on treatment allocation and clinical relevance of disagreements: evidence from the VALidation of IGA study cohort. Nephrol Dial Transplant 2019;34:1681–1690.
32. Cattran DC, Feehally J, Cook HT, et al. Kidney disease: improving global outcomes (KDIGO) glomerulonephritis work group. KDIGO clinical practice guideline for glomerulonephritis. Kidney Int Suppl (2011) 2012;2:139–274.

Article information Continued

Figure 1.

Calibration plots.

Kaplan-Meier curves of the primary outcome between the risk groups on the basis of the linear predictors (A, C, E) and calibration curves depicting the predicted vs. observed 5-year risks of the primary outcome using the prediction models (B, D, F). Risk groups were based on percentile of the linear predictor according to model. (A, B) Original model without race. (C, D) Original model with race. (E, F) Updated model with the Korean race coefficient. (A, C, E) The dashed line of each color is the associated mean predicted primary outcome risk; the solid line of each color is the observed primary outcome risk. (B, D, F) Circle means the observed risk and vertical line means the observed 95% confidence interval. A dashed line represents perfect calibration, in which the predicted and observed risks are identical.

Figure 2.

Estimates of the baseline survival function in the reported and current data set.

Table 1.

Baseline characteristics of the Korean cohort and the original cohort

Characteristic Korean cohort Original cohorta)
Derivation cohort Validation cohort
No. of patients 2,064 2,781 1,146
 Asan Hospital 298 (14.4)
 Severance Hospital 678 (32.8)
 Seoul National University Hospital 623 (30.2)
 Seoul National University Bundang Hospital 465 (22.5)
Year of biopsy 2014 (2011–2016) 2006 (2004–2008) 1998 (1993–2003)
Follow-up (yr) 3.8 (1.8–6.6) 4.8 (3.0–7.6) 5.8 (3.4–8.5)
Age (yr) 41.3 ± 14.2
Male sex 925 (44.8) 1,608 (57.8) 565 (49.3)
Creatinine level at biopsy (mg/dL) 0.93 (0.73–1.24) 1.04 (0.80–1.40) 0.95 (0.75–1.26)
eGFR at biopsy (mL/min/1.73 m2) 87.8 (61.6–111.5) 83.0 (56.7–108.0) 89.7 (65.3–112.7)
 <30 94 (4.6) 142 (5.1) 37 (3.2)
 30–60 401 (19.4) 657 (23.6) 191 (16.7)
 60–90 584 (28.3) 800 (28) 350 (30.5)
 >90 985 (47.7) 1,182 (42.5) 568 (49.6)
Mean arterial blood pressure (mmHg) 92 (83–100) 97 (89–106) 93 (85–103)
Proteinuria at biopsy (g/day) 1.0 (0.5–1.9) 1.2 (0.7–2.2) 1.3 (0.6–2.4)
 <0.5 530 (25.7) 383 (13.9) 221 (19.3)
 0.5–1 488 (23.6) 772 (28.1) 209 (18.2)
 1–2 570 (27.6) 817 (29.7) 352 (30.7)
 2–3 215 (10.4) 360 (13.1) 145 (12.7)
 >3 261 (12.6) 415 (15.1) 215 (18.8)
Body mass index (m2/kg) 23.2 (21.0–25.8) 23.8 (21.3–26.6) 22.8 (20.2–25.3)
Pathology (MEST-C score)
 M 755 (36.6) 1,054 (37.9) 481 (42.0)
 E 471 (22.8) 478 (17.2) 476 (41.5)
 S 1,350 (65.4) 2,137 (77.0) 912 (79.6)
 T1 452 (21.9) 686 (24.7) 207 (18.1)
 T2 91 (4.4) 128 (4.6) 122 (10.6)
 C 320 (19.8) 953 (34.3) 642 (56.1)
RASB use at biopsy 644 (31.2) 862 (32.4) 320 (30.0)
Immunosuppression use
 At biopsy 196 (9.5) 252 (9.1) 81 (7.1)
 After biopsy 366 (17.7) 1,209 (43.5) 359 (31.3)
 Time from biopsy to onset of immunosuppression (mo) 1.7 (0.0–19.6) 1.6 (0.0–5.1) 1.2 (0.0–11.5)
Primary outcome
 50% decline in eGFR 331 (16.0) 420 (15.1) 210 (18.3)
 End-stage kidney disease 200 (9.7) 372 (13.4) 155 (13.5)
 Primary outcome development 353 (17.1) 492 (17.7) 213 (18.6)

Data are expressed as number only, number (%), median (interquartile range), or mean ± standard deviation.

The primary outcome was the first occurrence of either a permanent 50% decline in eGFR from the baseline level at biopsy or ESKD. ESKD was defined as the initiation of renal replacement therapy, including dialysis, renal transplantation, or eGFR of <15 mL/min/1.73 m2.

eGFR, estimated glomerular filtration rate; MEST-C, mesangial (M) and endocapillary (E) hypercellularity, segmental sclerosis (S), interstitial fibrosis/tubular atrophy (T), and crescents (C); RASB, renin-angiotensin system blocker.

a

Barbour et al. [18] (JAMA Intern Med 2019;179:942-952).

Table 2.

Performance of the International IgA Nephropathy Prediction Tool

Variable Model without race Model with race
AIC 4,459 4,456
R2D (%) 44.8 (39.2–49.8) 45.2 (39.7–50.3)
C-statistic 0.81 (0.77–0.84) 0.81 (0.78–0.85)
Calibration slope 1.08 (0.96–1.20) 1.03 (0.92–1.14)
Model performance compared with the model without race
 NRI 0.13 (0.08–0.29)
 NRI (events) 0.04 (0.02–0.18)
 NRI (nonevents) 0.08 (0.07–0.11)
 IDI 0.002 (0–0.007)

Data are expressed as value (95% confidence interval).

AIC, Akaike information criterion; IDI, integrated discrimination improvement; IgA, immunoglobulin; NRI, continuous net reclassification index; R2D, Royston-Sauerbrei D statistic.

Table 3.

Rate of kidney function decline and mean predicted 5-year risk of the primary outcome in subgroups based on the linear predictor

Risk subgroup Predicted 5-year riska (%) Observed events in 5 yearsb Rate of eGFR declinec (mL/min/1.73 m2/yr) p-value
Model without race <0.001
 Low risk 2.1 (0.6–2.7) 3 (1.0) –1.04 (–1.56 to –0.52)
 Intermediate risk 3.9 (2.7–5.4) 37 (5.1) –1.61 (–1.94 to –1.28)
 High risk 9.6 (5.4–18.8) 85 (11.8) –1.91 (–2.24 to –1.58)
 Highest risk 37.1 (18.8–90.6) 121 (39.2) –3.24 (–3.77 to –2.70)
Model with race <0.001
 Low risk 0.8 (0.2–1.2) 5 (1.6) –1.13 (–1.64 to –0.62)
 Intermediate risk 1.9 (1.2–2.7) 35 (4.8) –1.65 (–1.98 to –1.31)
 High risk 5.1 (2.7–10.3) 82 (11.3) –1.81 (–2.14 to –1.48)
 Highest risk 23.3 (10.3–76.5) 124 (40.1) –3.38 (–3.92 to –2.84)

Data are expressed as

a

mean (range),

b

number (%), or

c

mean (95% confidence interval).

eGFR, estimated glomerular filtration rate.