Performance evaluation of Chronic Kidney Disease Epidemiology Collaboration equations for estimated glomerular filtration rate compared to inulin clearance in Koreans

Article information

Korean J Nephrol. 2024;.j.krcp.23.124
Publication date (electronic) : 2024 February 7
doi : https://doi.org/10.23876/j.krcp.23.124
1Department of Internal Medicine, Seoul National University Hospital, Seoul, Republic of Korea
2Department of Internal Medicine, National Medical Center, Seoul, Republic of Korea
3Department of Internal Medicine, Seoul National University College of Medicine, Seoul, Republic of Korea
4Department of Internal Medicine, Seoul National University Bundang Hospital, Seongnam, Republic of Korea
Correspondence: Ho Jun Chin Department of Internal Medicine, Seoul National University Bundang Hospital, 82 Gumi-ro 173beon-gil, Bundang-gu, Seongnam 13620, Republic of Korea. E-mail: mednep@snubh.org, mednep@hanmail.net
*Jeong Min Cho and Ran-hui Cha contributed equally to this study as co-first authors.
Received 2023 May 17; Revised 2023 August 7; Accepted 2023 September 12.

Abstract

Background

A race-free glomerular filtration rate (GFR) estimation equation has recently been developed. However, the performance of the new Chronic Kidney Disease Epidemiology Collaboration (CKD-EPI) equations needs to be evaluated in Asian populations.

Methods

We performed a cross-sectional study at a single center in South Korea. The measured GFR (mGFR) was determined based on systemic inulin clearance. The GFR was estimated using the five CKD-EPI equations: 2009 CKD-EPIcr, 2012 CKD-EPIcr-cys, 2012 CKD-EPIcys, 2021 CKD-EPIcr, and 2021 CKD-EPIcr-cys. The performances of five estimated GFR (eGFR) equations were assessed by bias, precision, and accuracy (percentage of estimates within 30% of mGFR).

Results

The median mGFR and interquartile range (IQR) was 53.5 (32.4–80.0) mL/min/1.73m2. The mGFR better correlated with 2009 CKD-EPIcr (ρ = 0.628) and 2021 CKD-EPIcr-cys (ρ = 0.806) than with 2021 CKD-EPIcr (ρ = 0.623) and 2012 CKD-EPIcr-cys (ρ = 0.801). The median bias of 2009 CKD-EPIcr and 2012 CKD-EPIcr-cys were lower than those of 2021 CKD-EPI equations (2009 CKD-EPIcr, 2.24 [IQR, –8.83 to 17.39] vs. 2021 CKD-EPIcr, 5.40 [IQR, –6.04 to 20.40]; 2012 CKD-EPIcr-cys, 6.74 [IQR, –2.81 to 20.80] vs. 2021 CKD-EPIcr-cys, 10.54 [IQR, 0.30–24.37]; all in mL/min/1.73 m2). The percentage of eGFR values within 30% of mGFR was higher in 2009 CKD-EPIcr and 2012 CKD-EPIcr-cys equations than 2021 CKD-EPI equations. The CKD prevalence in 2009 CKD-EPIcr, 2021 CKD-EPIcr, 2012 CKD-EPIcr-cys, and 2021 CKD-EPIcr-cys was 54.8%, 51.0%, 47.7%, and 44.8%, respectively.

Conclusion

Our study demonstrated better performance of the original CKD-EPIcr and CKD-EPIcr-cys equations than the 2021 new CKD-EPI equations. We do not recommend the adoption of the new CKD-EPI equations in Korea.

Introduction

Glomerular filtration rate (GFR) is considered the best overall indicator of kidney function [1], and its estimation is vital for the early detection and management of chronic kidney disease (CKD). Accurate and reproducible GFR estimation also helps understand the prevalence of CKD.

Modification of Diet in Renal Disease (MDRD) equations using creatinine, age, sex, and race were released in 1999 [1]; however, they inherently have several problems, including limited precision and underestimation of relatively higher kidney function. A new equation, the Chronic Kidney Disease Epidemiology Collaboration (CKD-EPI) creatinine (CKD-EPIcr), was reported to have higher accuracy in 2009 [2] and has been used globally to estimate GFR. Other CKD-EPI equations using cystatin C alone (CKD-EPIcys) or cystatin C and creatinine (CKD-EPIcr-cys) have been subsequently published [3]. The CKD-EPIcr-cys equation showed the best performance and is used as a confirmatory test for CKD.

Cystatin C and creatinine levels are affected by demographics; therefore, age, sex, and race were included in the estimation of GFR. However, there have been many criticisms about race inclusion in estimating GFR; race is a social and not a biological concept, and it may contribute to systemic racism in medicine [4]. Therefore, new creatinine- and cystatin C-based equations to estimate GFR without race were reported in 2021 [4].

GFR estimation using the 2021 CKD-EPI equation resulted in a substantial reclassification of CKD grade staging, especially for stages 2 and 3a. Estimated GFR (eGFR) <60 60 mL/min/1.73m2 increased by 2.9% in Blacks and decreased by 1.6% in other races. However, CKD-related complication prevalence was not substantially altered [5]. The 2021 CKD-EPI equation did not significantly differ from the original CKD-EPI equation in kidney transplant recipients [6]. However, eGFR recalculation using the 2021 CKD-EPI equation showed potentially important effects on event rates and efficacy estimates in a clinical trial [7].

Here, we compared the performance of the CKD-EPI equations with the measured GFR (mGFR) to identify whether adopting the 2021 CKD-EPI equations in South Korea is appropriate. We aimed to demonstrate the differences in performance between 2009, 2012, and 2021 CKD-EPI equations in the population included in the study of the Korean coefficient of MDRD equations [8,9] and the reclassification of CKD stages according to each eGFR equation.

Methods

Study setting and population

We conducted retrospective cross-sectional analyses using the previously constructed dataset from the study for the Korean coefficient of MDRD equations conducted at the Seoul National University Hospital in 2008 and 2013 [9]. The study population consisted of individuals of Korean ethnicity. The inclusion criteria for the previous study were: 1) participants aged ≥18 years, regardless of previous kidney disease, and 2) those who agreed to participate in the study and voluntarily signed on informed consent. The study included both CKD and healthy volunteers. All healthy volunteers exhibited normal urinalysis and systemic inulin clearances >60 mL/min/1.73 m2. The exclusion criteria were: 1) rapid decline of kidney function within 3 months, 2) proteinuria >10 g/day or serum albumin <2.5 g/dL, 3) presence of edema or ascites, 4) active infection, 5) history of coronary artery intervention including coronary artery bypass graft or percutaneous coronary intervention within 1 year, 6) abnormal liver function tests, 7) history of severe allergy, 8) pregnant or lactating female, 9) gross hematuria, 10) oliguria (<500 mL/day), and 11) history of kidney replacement therapy including dialysis or kidney transplantation.

Ethical statement

This study was approved by the Institutional Review Board of the Seoul National University Hospital (No. H-2302-107-1407), and the informed consent was waived because we utilized previously collected clinical data and laboratory results. This study was conducted in accordance with the principles of the Declaration of Helsinki.

Measurement of glomerular filtration rate

We used sinistrin (Inutest 25%; Fresenius Kabi Austria GmbH), an inulin analog, to measure GFR in previous studies because of its water solubility and ease of handling [10]. We used systemic inulin clearance as mGFR due to its more simple and fairly accurate measurement of true GFR, although urinary inulin clearance is the gold standard for measuring GFR [1113]. A single-shot method was performed, and six consecutive blood samples (5, 10, 15, 30, 75, and 150 minutes after the injection) were collected as in the previous studies [8,14,15]. The inulin concentration (g/mL) was determined using the high-performance liquid chromatography method [16]. The mGFR was determined by systemic inulin clearance, calculated by dividing the infusion dose by the area under the curve obtained by curve fitting.

Measurement of serum creatinine and cystatin C

Serum creatinine (SCr) was measured using the alkaline picrate Jaffé kinetic method with a Hitachi 7600 analyzer (200FR; Toshiba). The assay was calibrated to standardized creatinine measured using the isotope-dilution mass spectrometry standard with the following corrected equations: calibrated SCr = 1.07 × measured SCr – 0.2 (mg/dL) until December 2010; and calibrated SCr = 1.00 × measured SCr – 0.3 (mg/dL) since January 2011. Serum cystatin C levels were measured using a particle-enhanced immunoturbidimetric assay on a COBAS 6000 analyzer (Roche Diagnostics).

Estimation of glomerular filtration rate

The eGFR was calculated using the following five CKD-EPI equations: (1) 2009 CKD-EPIcr [2], (2) 2012 CKD-EPIcr-cys, (3) 2012 CKD-EPIcys [3], (4) 2021 CKD-EPIcr, and (5) 2021 CKD-EPIcr-cys [4]. Equations (1) to (3) incorporated standardized creatinine levels, age, sex, and race, whereas new eGFR equations (4) and (5) redact racial coefficients.

Statistical analyses

Categorical variables were described as numbers (percentages) and continuous variables as means ± standard deviations (SDs) if normally distributed or medians (interquartile ranges, IQR) if nonnormally distributed.

The performance of the eGFR equations was determined by measuring the bias, precision, and accuracy. Linear regressions were performed by comparing the five eGFRs to the mGFR (systemic inulin clearance). The degree of linear correlation was estimated using the Pearson correlation coefficient (ρ). The bias of the five eGFR equations was calculated by subtracting mGFR from eGFR and expressed as median bias (IQR), absolute bias, and percentage bias with 95% confidence intervals (CIs) were assessed. The precision was defined as the SD of the difference between mGFR and eGFR values. The accuracy of the five eGFR equations was measured as the percentage of study participants with eGFR values within 15% (P15), 30% (P30), and 50% (P50) of the mGFR. The P30 value indicates clinical accuracy and is used to achieve good medical decision-making based on eGFR. Subgroup analysis according to eGFR categories was conducted to evaluate generalizability among eGFR categories. The differences of mGFR and eGFR estimates were assessed using the Wilcoxon signed-rank test and paired t test. Two-sided p-value of <0.05 was considered significant. Scatter plots with linear regression were used to visualize the distribution of mGFR and eGFR values calculated from five eGFR equations. Bland-Altman plots were used to assess the agreement between each eGFR equation and mGFR [17].

The participants were classified into the 2012 Kidney Disease Improving Global Outcomes (KDIGO) GFR categories according to the mGFR and five eGFR equations: G1, ≥90; G2, ≥60 and <90; G3a, ≥45 and <60; G3b, ≥30 and <45; G4, ≥15 and <30; and G5, <15 mL/min/1.73 m2. The concordance rates between the mGFR and each of the five eGFRs were assessed using Lin’s concordance correlation coefficient (CCC). The proportion of CKD was evaluated according to each eGFR equation, and CKD was defined as a GFR <60 mL/min/1.73 m2. All statistical analyses were performed using R version 4.2.3 (R Foundation for Statistical Computing).

Results

Baseline characteristics

This study included 239 participants (patients with CKD, n = 201; healthy volunteers, n = 38). Participants’ baseline characteristics are described in Table 1. The mean age was 49.4 ± 15.9 years, and 40.5% were female. Among patients with CKD, the most common etiologies of CKD were glomerulonephritis (31.8%), hypertension (17.9%), and diabetes mellitus (14.4%). The median mGFR (mL/min/1.73 m2) was 53.5 (IQR, 32.4–80.0; ≥60 [42.3%], ≤30 and <60 [36.3%], and <30 [21.3%], respectively). The median eGFR (mL/min/1.73 m2) calculated by the 2009 CKD-EPIcr equation was the lowest (56.4; IQR, 36.2–87.7), while the median eGFR (mL/min/1.73 m2) calculated by the 2012 CKD-EPIcys equation was the highest (74.3; IQR, 36.8–116.1).

Baseline characteristics of the study participants

Bias, precision, and accuracy of 2009, 2012, and 2021 CKD-EPI estimated glomerular filtration rate equations

The intercepts and slopes of each linear regression with the performances expressed as bias, precision, and accuracy are presented in Table 2. The slope of the 2009 CKD-EPIcr equation (0.61; 95% CI, 0.51–0.71) was closer to the identity line than that of the 2021 CKD-EPIcr equation (0.59; 95% CI, 0.5–0.69). The slope of the 2012 CKD-EPIcr-cys equation (0.71; 95% CI, 0.64–0.78) was also closer to the identity line than that of the 2021 CKD-EPIcr-cys equation (0.70; 95% CI, 0.64–0.77). The slope was largest in the 2012 CKD-EPIcys equation (0.57; 95% CI, 0.52–0.63). Fig. 1 shows scatter plots with regression lines for each eGFR equation against mGFR values. mGFR better correlated with 2009 CKD-EPIcr (ρ = 0.628) than with 2021 CKD-EPIcr (ρ = 0.623), while 2021 CKD-EPIcr-cys (ρ = 0.806) correlated better than 2012 CKD-EPIcr-cys (ρ = 0.801) with mGFR.

Performance characteristics of GFR estimates calculated by five eGFR equations against mGFR

Figure 1.

Scatter plots and linear regression lines of mGFR with each of the estimating equations.

(A) 2009 CKD-EPIcr, (B) 2012 CKD-EPIcr-cys, (C) 2012 CKD-EPIcys, (D) 2021 CKD-EPIcr, and (E) 2021 CKD-EPIcr-cys.The mGFR values are plotted on the y-axis and the eGFR values of the five CKD-EPI equations are plotted on the x-axis.

CKD-EPI, Chronic Kidney Disease Epidemiology Collaboration; cr, creatinine; cys, cystatin C; mGFR, measured glomerular filtration rate; eGFR, estimated glomerular filtration rate; ρ, Pearson correlation coefficient.

All five equations showed an overestimation of mGFR, and the eGFR calculated by the 2012 CKD-EPIcys was overestimated the most among the five equations. The median bias was lower when eGFR (mL/min/1.73 m2) was calculated with the 2009 CKD-EPIcr equation (2.24; IQR, –8.83 to 17.39) than with the 2021 CKD-EPIcr equation (5.40; IQR, –6.04 to 20.40). The median bias was larger in 2021 CKD-EPIcr-cys (10.54; IQR, 0.30 to 24.37) than 2012 CKD-EPIcr-cys (6.74; IQR, –2.81 to 20.80). The absolute and percentage bias showed a concordant result to that of the median bias. The mean biases and 95% CIs for each eGFR equation are displayed in the Bland-Altman plots (Fig. 2). The precision was better in 2009 CKD-EPIcr equation than in the 2021 CKD-EPIcr equation (SD, 31.50 vs. 32.21). The 2012 CKD-EPIcr-cys equation presented better precision compared to 2021 CKD-EPIcr-cys equation (SD, 34.39 vs. 35.14). Accuracy was higher in the 2009 CKD-EPIcr equation than in the 2021 CKD-EPIcr equation, as demonstrated by P15, P30, and P50 (83.7%/91.2%/95.0% and 82.0%/89.1%/94.6%, respectively). The accuracy of the 2012 CKD-EPIcr-cys equation was also higher than that of the 2021 CKD-EPIcr-cys equation (82.4%/91.6%/97.5% and 77.8%/87.4%/97.1%, respectively). The 2012 CKD-EPIcys equation showed the highest median bias and the lowest precision and accuracy (bias, 16.07 [IQR, 2.23–38.91]; SD, 42.51; accuracy, 61.5%/73.6%/87.9%).

Figure 2.

Bland-Altman plots for the concordance rate between mGFR and eGFR.

(A) 2009 CKD-EPIcr, (B) 2012 CKD-EPIcr-cys, (C) 2012 CKD-EPIcys, (D) 2021 CKD-EPIcr, and (E) 2021 CKD-EPIcr-cys. The x-axis of the plot presents the average measurement of the mGFR and eGFR, and the y-axis presents the difference between mGFR and eGFR. The black line indicates the average difference in measurement between mGFR and eGFR, and the two red dotted lines represent the 95% confidence interval limits for the average difference.

CKD-EPI, Chronic Kidney Disease Epidemiology Collaboration; cr, creatinine; cys, cystatin C; eGFR, estimated glomerular filtration rate; mGFR, measured glomerular filtration rate.

The subgroup analysis presented concordant results with the main findings, showing the bias and precision of 2021 CKD-EPI equation lower than those of the 2009 CKD-EPIcr and 2012 CKD-EPIcr-cys equation across eGFR categories (Supplementary Table 1, available online). Patients with lower eGFR exhibited an increased degree of bias while showing decreased precision and accuracy.

Glomerular filtration rate category concordance and chronic kidney disease proportion

The concordance and Lin’s CCC between the eGFRs and mGFR are shown in Table 3. Compared with the 2009 CKD-EPIcr equation, a larger degree of overestimation in the eGFR category was found in the 2021 CKD-EPIcr equation. Specifically, the 2021 CKD-EPIcr equation classified 96 participants in the higher eGFR category than the mGFR category, whereas the 2009 CKD-EPIcr equation classified 84 participants in the higher category. The 2012 CKD-EPIcr-cys equation misclassified 29 participants in the higher eGFR category, whereas the 2021 CKD-EPIcr-cys equation misclassified 23 participants.

Distribution of study population and concordance rate according to mGFR and eGFR categories

The overall concordance rate and Lin’s CCC of the GFR category between mGFR and eGFR were 0.393 and 0.623 (95% CI, 0.540–0.695) for 2009 CKD-EPIcr, and 0.372 and 0.609 (95% CI, 0.524–0.681) for 2021 CKD-EPIcr, respectively. The corresponding values for the 2012 CKD-EPIcr-cys (0.473 and 0.766; 95% CI, 0.711–0.812) were superior to those for the 2021 CKD-EPIcr-cys (0.456 and 0.746; 95% CI, 0.689–0.793). The 2012 CKD-EPIcr-cys showed the highest overall concordance rate and Lin’s CCC among the five equations.

Using the five eGFR equations, the prevalence of CKD was examined to assess the clinical implications of using different eGFR equations (Fig. 3A). The CKD prevalence of 2009 CKD-EPIcr, 2021 CKD-EPIcr, 2012 CKD-EPIcr-cys, 2021 CKD-EPIcr-cys, and 2012 CKD-EPIcys was 54.8%, 51.0%, 47.7%, 44.8%, and 41.0%, respectively. We evaluated the distribution of the study population across the KDIGO GFR categories using five CKD-EPI equations (Fig. 3B). The proportion of G2 was higher in 2021 CKD-EPIcr (25.9%) compared to 2009 CKD-EPIcr (21.8%). In contrast, the proportion of G3a was lower in 2021 CKD-EPIcr (18.4%) than in 2009 CKD-EPIcr (19.2%). The proportion of eGFR categories G3a and G3b was higher in 2009 CKD-EPIcr (34.3%) compared to 2021 CKD-EPIcr (33.5%). In addition, the proportions of G4 and G5 were higher in 2009 CKD-EPIcr (20.5%) than in 2021 CKD-EPIcr (17.5%). The 2012 and 2021 CKD-EPIcr-cys datasets showed similar patterns.

Figure 3.

CKD prevalence and eGFR categories.

(A) CKD prevalence and (B) the distribution of eGFR categories according to CKD-EPI equations. CKD was defined as patients with eGFR <60 mL/min/1.73 m2. The eGFR categories are classified as follows: G1, ≥90; G2, ≥60 and <90; G3a, ≥45 and <60; G3b, ≥30 and <45; G4, ≥15 and <30; and G5, <15 mL/min/1.73 m2.

CKD, chronic kidney disease; CKD-EPI, Chronic Kidney Disease Epidemiology Collaboration; cr, creatinine; cys, cystatin C; eGFR, estimated glomerular filtration rate.

Discussion

In this study, we evaluated the performance of five CKD-EPI equations developed in 2009, 2012, and 2021 and compared them with mGFR values in a Korean cohort. The 2009 and 2012 CKD-EPIcr-cys equations exhibited lower median bias and higher accuracy than the 2021 CKD-EPIcr and CKD-EPIcr-cys equations. Regarding the concordance rates of mGFR and eGFR categories, the 2012 CKD-EPIcr-cys equation exhibited the highest concordance rate. The concordance rates of the 2009 CKD-EPIcr and 2012 CKD-EPIcr-cys equations were higher than those of the 2021 CKD-EPIcr and CKD-EPIcr-cys equations. Misclassifications of CKD stages into higher classes were more prevalent in the 2021 equations than in the 2009 equations.

Accurate estimation of GFR is crucial in clinical contexts as GFR thresholds are widely used as a criterion for diagnosis and guidance of medical therapy [1820]. Previously developed eGFR equations, including the MDRD and 2009 and 2012 CKD-EPI equations, incorporate race coefficients for Black individuals [13]. However, race coefficients were criticized because “race” is not a biological proxy but a sociocultural construct, and incorrect use of race may negatively affect health equity [21]. Therefore, along with attempts to examine the traditional medical practice that comprises race modifiers [22], a new GFR estimating equation without racial coefficient was developed by the National Kidney Foundation and American Society of Nephrology [4]. Although 2021 CKD-EPIcr-cys equations minimized inaccuracy for non-Black and Black groups, 2021 CKD-EPIcr equations exhibited larger biases in both race groups. Specifically, the differential bias between racial groups observed in the 2021 CKD-EPIcr equation resulted in significant differences in the prevalence of CKD and GFR stages, which could potentially lead to systemic differences in medical services for these populations [4]. Therefore, further validation studies are needed across a diverse range of racial groups, and the clinical implications of these findings should be addressed.

The 2021 CKD-EPIcr equation assigned a higher eGFR to non-Black persons compared to the 2009 CKD-EPIcr equation, decreasing the prevalence of CKD [4]. In a European study for external validation [23], higher bias and lower accuracy were also observed in the 2021 CKD-EPIcr equation compared to the 2009 CKD-EPIcr or European Kidney Function Consortium (EKFC) equation [24]. However, it is essential to note that the developmental cohort of the EKFC equation differs from that of the 2021 CKD-EPI equation, resulting in decreased performance.

Transitioning from 2009 to 2021 CKD-EPIcr equation in calculating eGFR resulted in approximately 3 to 5 mL/min/1.73 m2 increase in non-Black individuals [5,2528]. The overestimation of eGFR reclassified up to 30% of individuals into the higher GFR category. This may potentially lead to the underdiagnosis of kidney diseases, unnecessary discontinuation or initiation of medications, and delays in planning for dialysis [1820,28]. In addition, the Asian population was not evaluated as a distinct racial group, as the 2021 CKD-EPIcr developmental study categorized participants into two ethnic groups: Black and White. Therefore, the performance of the new equations in Asian populations must be validated to understand their clinical implications. Currently, the 2009 CKD-EPI and 2012 CKD-EPI equations are universally applied in estimating GFR in all clinical laboratories in Korea [29]. Given the substantial socioeconomic and medical changes that may result from the change in eGFR equations [28], it is crucial to comprehensively evaluate the current standard and novel GFR estimating equations before adopting the 2021 CKD-EPI equations in Korea.

In this study, the 2009 CKD-EPIcr equation demonstrated better performance than the 2021 CKD-EPIcr equation for estimating GFR, supported by lower bias, higher accuracy, and higher agreement with mGFR in the 2009 CKD-EPIcr. The 2021 CKD-EPIcr equation demonstrated a greater tendency to overestimate eGFR, leading to a higher transition rate to a higher eGFR category than the 2009 CKD-EPIcr equation. The proportion of G2 was higher in 2021 CKD-EPIcr (25.9%) compared to 2009 CKD-EPIcr (21.8%), whereas the proportion of G3a was lower in 2021 CKD-EPIcr (18.4%) than in 2009 CKD-EPIcr (19.2%). The overall proportion of eGFR category G3 was higher in 2009 CKD-EPIcr (34.3%) compared to 2021 CKD-EPIcr (33.5%). The discrimination of G2 and G3a stages is crucial because various complications of decreased GFR, such as anemia, malnutrition, bone disease, neuropathy, and decreased quality of life, begin to rise when GFR declines to <60 mL/min/1.73 m2 [30]. Furthermore, according to the KDIGO and Korean Society of Nephrology current guidelines, CKD patients with eGFR <60 mL/min/1.73 m2 combined with proteinuria >0.5 g/day or eGFR <30 mL/min/1.73 m2 (GFR categories G4) should be referred to a nephrologist [20,3134]. An overestimation of eGFR may delay timely referral to a nephrologist and disrupt preparation for kidney replacement therapy, which should ideally begin during G4 [20,30,35]. Delayed referral to nephrologists increases the risk of cardiovascular and overall survival, medical expenses, and quality of life [36].

Moreover, the switch from 2009 to 2021 CKD-EPIcr equation showed a net decrease of 3.8% in CKD prevalence, specifically in the G4 category (17.2% to 14.2%). Our findings are consistent with those of a previous study that compared the accuracy of the 2009 and 2021 CKD-EPIcr equations in approximately 40,000 participants, including Black and non-Black individuals. A net decrease of 5.1% in patients classified as eGFR <20 mL/min/1.73 m2 in non-Black patients was observed, indicating the inferior performance of the 2021 CKD-EPIcr equation in classifying patients with CKD at lower eGFR [26]. Patients with lower eGFR, who are near critical decision thresholds, are particularly vulnerable to changes in CKD stages, as an increase in GFR estimates does not signify an improvement of the underlying kidney function. The transition to a higher GFR category may preclude patients with a lower GFR from receiving appropriate medical practices [28].

Our study had some limitations. First, due to the small sample size recruited from a single center, our findings may not reflect the effect of the new CKD-EPIcr equation on the overall Korean population. As a small sample size increases bias, it is important not to neglect the possibility of significant differences based on null findings in this study. Furthermore, the study population includes a very small proportion of patients with eGFR <15 mL/min/1.73 m2 (3.3%). The result of this study may not be applicable to these patients. Second, the differences in estimating the bias might have occurred because of different urinary or plasma exogenous filtration markers compared with previous studies. For example, urinary clearance of iothalamate, plasma clearance of iohexol, or 51Cr-ethylenediaminetetraacetic acid was used to measure GFR in a developmental study of a new eGFR equation. In contrast, systemic inulin clearance was used in our study. Third, the presence of CKD in the study population was calculated based on eGFR measurements without considering albuminuria. Fourth, long-term clinical outcomes driven by discrepancies between the 2009 and 2021 eGFR equations, including mortality, reduction in kidney function, and kidney replacement therapy, were not investigated. Hence, further investigation of the long-term prognosis is necessary. Also, there is a possibility of additional eGFR overestimation due to tubular secretion of creatinine in advanced CKD because our study participants had lower kidney function compared to the previous race-free eGFR equation developmental study [4].

In conclusion, our study demonstrated a higher bias and lower accuracy of the 2021 CKD-EPI equations compared to the 2009 CKD-EPIcr or 2012 CKD-EPIcr-cys equations, the current standards for estimating GFR in Korea. Given the potential economic burden associated with the national modification of the GFR estimation system, possible underestimation of CKD prevalence, and potential delay in nephrology referrals and access to various medical interventions, we do not recommend the adoption of the 2021 CKD-EPI equations in Korea. Further studies are warranted to determine whether variations in medical services occur in response to using different eGFR equations and identify the association between different eGFR equations and clinical outcomes, including mortality and progression to end-stage renal disease.

Supplementary Materials

Supplementary data are available at Kidney Research and Clinical Practice online (https://doi.org/10.23876/j.krcp.23.124).

Notes

Conflicts of interest

All authors have no conflicts of interest to declare.

Data sharing statement

The datasets analyzed during the current study are available from the corresponding author upon reasonable request.

Authors’ contributions

Conceptualization: HJC

Data curation, Formal analysis, Investigation, Methodology, Resources, Visualization: JMC, RHC

Project administration, Supervision: RHC, DKK, HJC

Writing–original draft: JMC, RHC

Writing–review & editing: All authors

All authors read and approved the final manuscript.

References

1. Levey AS, Bosch JP, Lewis JB, Greene T, Rogers N, Roth D. A more accurate method to estimate glomerular filtration rate from serum creatinine: a new prediction equation. Modification of Diet in Renal Disease Study Group. Ann Intern Med 1999;130:461–470.
2. Levey AS, Stevens LA, Schmid CH, et al. A new equation to estimate glomerular filtration rate. Ann Intern Med 2009;150:604–612.
3. Inker LA, Schmid CH, Tighiouart H, et al. Estimating glomerular filtration rate from serum creatinine and cystatin C. N Engl J Med 2012;367:20–29.
4. Inker LA, Eneanya ND, Coresh J, et al. New creatinine- and cystatin C-based equations to estimate GFR without race. N Engl J Med 2021;385:1737–1749.
5. Walther CP, Winkelmayer WC, Navaneethan SD. Updated US prevalence estimates for chronic kidney disease stage and complications using the new race-free equation to estimate glomerular filtration rate. JAMA Netw Open 2022;5e220460.
6. Hundemer GL, White CA, Norman PA, et al. Performance of the 2021 race-free CKD-EPI creatinine- and cystatin C-based estimated GFR equations among kidney transplant recipients. Am J Kidney Dis 2022;80:462–472.
7. Charytan DM, Yu J, Jardine MJ, et al. Potential effects of elimination of the Black race coefficient in eGFR calculations in the CREDENCE trial. Clin J Am Soc Nephrol 2022;17:361–373.
8. Lee CS, Cha RH, Lim YH, et al. Ethnic coefficients for glomerular filtration rate estimation by the Modification of Diet in Renal Disease study equations in the Korean population. J Korean Med Sci 2010;25:1616–1625.
9. Oh YJ, Cha RH, Lee SH, et al. Validation of the Korean coefficient for the modification of diet in renal disease study equation. Korean J Intern Med 2016;31:344–356.
10. Oettl K, Payerl D, Zitta S, Müller T, Estelberger W, Reibnegger G. Quantitative analysis of sinistrin in serum with high-performance liquid chromatography for renal function testing. Anal Biochem 2004;331:183–188.
11. Boele-Schutte E, Gansevoort RT. Measured GFR: not a gold, but a gold-plated standard. Nephrol Dial Transplant 2017;32:ii180–ii184.
12. Koopman MG, Koomen GC, Krediet RT, de Moor EA, Hoek FJ, Arisz L. Circadian rhythm of glomerular filtration rate in normal individuals. Clin Sci (Lond) 1989;77:105–111.
13. Stevens LA, Coresh J, Greene T, Levey AS. Assessing kidney function: measured and estimated glomerular filtration rate. N Engl J Med 2006;354:2473–2483.
14. Florijn KW, Barendregt JN, Lentjes EG, et al. Glomerular filtration rate measurement by “single-shot” injection of inulin. Kidney Int 1994;46:252–259.
15. Prescott LF, Freestone S, McAuslane JA. Reassessment of the single intravenous injection method with inulin for measurement of the glomerular filtration rate in man. Clin Sci (Lond) 1991;80:167–176.
16. Pastore A, Bernardini S, Dello Strologo L, Rizzoni G, Cortese C, Federici G. Simultaneous determination of inulin and p-aminohippuric acid in plasma and urine by reversed-phase high-performance liquid chromatography. J Chromatogr B Biomed Sci Appl 2001;751:187–191.
17. Myles PS, Cui J. Using the Bland-Altman method to measure agreement with repeated measures. Br J Anaesth 2007;99:309–311.
18. Cheung AK, Chang TI, Cushman WC, et al. Executive summary of the KDIGO 2021 clinical practice guideline for the management of blood pressure in chronic kidney disease. Kidney Int 2021;99:559–569.
19. Kidney Disease: Improving Global Outcomes (KDIGO) Acute Kidney Injury Work Group. KDIGO clinical practice guideline for acute kidney injury. Kidney Inter Suppl 2012;2:1–138.
20. Kidney Disease: Improving Global Outcomes (KDIGO) CKD Work Group. KDIGO 2012 clinical practice guideline for the evaluation and management of chronic kidney disease. Kidney Inter Suppl 2013;3:1–150.
21. Delanaye P, Mariat C, Cavalier E, Glassock RJ, Gemenne F, Pottel H. The « race » correction in estimating glomerular filtration rate: an European point of view. Curr Opin Nephrol Hypertens 2021;30:525–530.
22. Williams WW, Hogan JW, Ingelfinger JR. Time to eliminate health care disparities in the estimation of kidney function. N Engl J Med 2021;385:1804–1806.
23. Delanaye P, Vidal-Petiot E, Björk J, et al. Performance of creatinine-based equations to estimate glomerular filtration rate in White and Black populations in Europe, Brazil and Africa. Nephrol Dial Transplant 2023;38:106–118.
24. Pottel H, Björk J, Courbebaisse M, et al. Development and validation of a modified full age spectrum creatinine-based equation to estimate glomerular filtration rate: a cross-sectional analysis of pooled data. Ann Intern Med 2021;174:183–191.
25. Fu EL, Coresh J, Grams ME, et al. Removing race from the CKD-EPI equation and its impact on prognosis in a predominantly White European population. Nephrol Dial Transplant 2023;38:119–128.
26. Meeusen JW, Kasozi RN, Larson TS, Lieske JC. Clinical impact of the refit CKD-EPI 2021 creatinine-based eGFR equation. Clin Chem 2022;68:534–539.
27. Khandpur S, Awasthi A, Behera MR, Purty AJ, Singh NP, Tiwari S. Kidney disease burden in an Asian Indian population: effect of the new 2021 serum creatinine CKD-EPI equation. Diabetes Res Clin Pract 2022;193:110120.
28. Diao JA, Wu GJ, Wang JK, et al. National projections for clinical implications of race-free creatinine-based GFR estimating equations. J Am Soc Nephrol 2023;34:309–321.
29. Jeong TD, Hong J, Lee W, Chun S, Min WK. Accuracy of the new creatinine-based equations for estimating glomerular filtration rate in Koreans. Ann Lab Med 2023;43:244–252.
30. Levey AS, Coresh J, Balk E, et al. National Kidney Foundation practice guidelines for chronic kidney disease: evaluation, classification, and stratification. Ann Intern Med 2003;139:137–147.
31. Oliva-Damaso N, Delanaye P, Oliva-Damaso E, Payan J, Glassock RJ. Risk-based versus GFR threshold criteria for nephrology referral in chronic kidney disease. Clin Kidney J 2022;15:1996–2005.
32. National Kidney Foundation. K/DOQI clinical practice guidelines for chronic kidney disease: evaluation, classification, and stratification. Am J Kidney Dis 2002;39:S1–S266.
33. National Collaborating Centre for Chronic Conditions (UK). Chronic kidney disease: national clinical guideline for early identification and management in adults in primary and secondary care Royal College of Physicians (UK); 2008.
34. Establishment and Development Committee for Chronic Kidney Disease Clinical Practice Guidelines, Korean Academy of Medical Sciences. Primary care chronic kidney disease quick reference guide Seoul: Korean Academy of Medical Sciences, Korea Disease Control and Prevention Agency; 2022.
35. Oliva-Damaso N, Oliva-Damaso E, Rodriguez-Perez JC, Payan J. Improved nephrology referral of chronic kidney disease patients: potential role of smartphone apps. Clin Kidney J 2019;12:767–770.
36. Lee J, Lee JP, An JN, et al. Factors affecting the referral time to nephrologists in patients with chronic kidney disease: a prospective cohort study in Korea. Medicine (Baltimore) 2016;95e3648.

Article information Continued

Figure 1.

Scatter plots and linear regression lines of mGFR with each of the estimating equations.

(A) 2009 CKD-EPIcr, (B) 2012 CKD-EPIcr-cys, (C) 2012 CKD-EPIcys, (D) 2021 CKD-EPIcr, and (E) 2021 CKD-EPIcr-cys.The mGFR values are plotted on the y-axis and the eGFR values of the five CKD-EPI equations are plotted on the x-axis.

CKD-EPI, Chronic Kidney Disease Epidemiology Collaboration; cr, creatinine; cys, cystatin C; mGFR, measured glomerular filtration rate; eGFR, estimated glomerular filtration rate; ρ, Pearson correlation coefficient.

Figure 2.

Bland-Altman plots for the concordance rate between mGFR and eGFR.

(A) 2009 CKD-EPIcr, (B) 2012 CKD-EPIcr-cys, (C) 2012 CKD-EPIcys, (D) 2021 CKD-EPIcr, and (E) 2021 CKD-EPIcr-cys. The x-axis of the plot presents the average measurement of the mGFR and eGFR, and the y-axis presents the difference between mGFR and eGFR. The black line indicates the average difference in measurement between mGFR and eGFR, and the two red dotted lines represent the 95% confidence interval limits for the average difference.

CKD-EPI, Chronic Kidney Disease Epidemiology Collaboration; cr, creatinine; cys, cystatin C; eGFR, estimated glomerular filtration rate; mGFR, measured glomerular filtration rate.

Figure 3.

CKD prevalence and eGFR categories.

(A) CKD prevalence and (B) the distribution of eGFR categories according to CKD-EPI equations. CKD was defined as patients with eGFR <60 mL/min/1.73 m2. The eGFR categories are classified as follows: G1, ≥90; G2, ≥60 and <90; G3a, ≥45 and <60; G3b, ≥30 and <45; G4, ≥15 and <30; and G5, <15 mL/min/1.73 m2.

CKD, chronic kidney disease; CKD-EPI, Chronic Kidney Disease Epidemiology Collaboration; cr, creatinine; cys, cystatin C; eGFR, estimated glomerular filtration rate.

Table 1.

Baseline characteristics of the study participants

Characteristic Value
No. of patients 239
Age (yr) 49.4 ± 15.9
Female sex 94 (40.5)
Weight (kg)a 62.0 (53.5–73.8)
BSA (m2)a 1.66 (1.51–1.80)
Body mass index (kg/m2) 23.9 (22.0–26.5)
SBP (mmHg) 124.7 ± 19.2
Hemoglobin (g/dL) 13.4 ± 6.6
Albumin (g/dL) 4.2 ± 0.4
UPCR (g/g) 0.4 (0.1–1.3)
CKD diagnosed 201 (84.1)
Etiology of CKD
 Glomerulonephritis 64 (31.8)
 Diabetes mellitus 29 (14.4)
 Hypertensive 36 (17.9)
 Polycystic kidney disease 3 (1.5)
 Unknown 69 (34.3)
Serum creatinine (mg/dL) 1.5 ± 0.9
1.3 (1.0–1.8)
Cystatin C (mg/L) 1.3 ± 0.8
1.1 (0.7–1.8)
mGFR (mL/min/1.73 m2 BSA) 58.0 ± 31.2
53.5 (32.4–80.0)
mGFR category (mL/min/1.73 m2)
 ≥90 36 (15.1)
 ≥60, <90 65 (27.2)
 ≥45, <60 39 (16.3)
 ≥30, <45 48 (20.1)
 ≥15, <30 43 (18.0)
 <15 8 (3.3)
eGFR (mL/min/1.73 m2)
 2009 CKD-EPIcr 61.0 ± 31.5
56.4 (36.2–87.7)
 2012 CKD-EPIcys 77.7 ± 42.5
74.3 (36.8–116.1)
 2012 CKD-EPIcr-cys 66.3 ± 34.4
61.9 (37.5–94.2)
 2021 CKD-EPIcr-cys 69.5 ± 35.1
66.0 (39.4–100.0)
 2021 CKD-EPIcr 63.9 ± 32.2
59.1 (38.8–92.6)

Data are expressed as number only, mean ± standard deviation, number (%), or median (interquartile range).

BSA, body surface area; CKD, chronic kidney disease; CKD-EPI, Chronic Kidney Disease Epidemiology Collaboration; cr, creatinine; cys, cystatin C; eGFR, estimated glomerular filtration rate; mGFR, measured glomerular filtration rate; SBP, systolic blood pressure; UPCR, urine protein/creatinine ratio.

a

Missing variable in 102 participants (44.0%). Serum creatinine was standardized with the isotope-dilution mass spectrometry method.

Table 2.

Performance characteristics of GFR estimates calculated by five eGFR equations against mGFR

Equation Linear regressiona
ρ Median bias (mL/min/1.73)b,c Absolute bias (mL/min/1.73 m2)a,d Percentage bias (%)a,e Precision (SD; mL/min/1.73 m2)f Accuracy (%)g
Intercept Slope* 15% 30% 50%
2009 CKD-EPIcr 20.01 (13.37 to 26.65) 0.61 (0.51 to 0.71) 0.628 2.24 (–8.83 to 17.39) 3.74 (0.34 to 7.14) –5.01 (–34.93 to 18.19) 31.50 83.7 91.2 95.0
2012 CKD-EPIcr-cys 9.98 (4.89 to 15.07) 0.71 (0.64 to 0.78) 0.801 6.74 (–2.81 to 20.80) 9.03 (6.39 to 11.67) –13.65 (–42.20 to 5.23) 34.39 82.4 91.6 97.5
2012 CKD-EPIcys 12.75 (7.80 to 17.70) 0.57 (0.52 to 0.63) 0.795 16.07 (2.23 to 38.91) 20.47 (17.18 to 23.76) –32.16 (–66.30 to 5.45) 42.51 61.5 73.6 87.9
2021 CKD-EPIcr 19.40 (12.6 to 26.21) 0.59 (0.5 to 0.69) 0.623 5.40 (–6.04 to 20.40) 6.64 (3.18 to 10.11) –9.85 (–41.01 to 13.07) 32.21 82.0 89.1 94.6
2021 CKD-EPIcr-cys 8.44 (3.29 to 13.58) 0.70 (0.64 to 0.77) 0.806 10.54 (0.30 to 24.37) 12.31 (9.65 to 14.96) –19.77 (–51.14 to –0.78) 35.14 77.8 87.4 97.1

Data are expressed as mean (95% confidence interval)

a

or median (interquartile range)

b

Bias is calculated as eGFR–mGFR.

c

Bias is calculated as eGFR – mGFR.

d

Absolute bias is the difference of eGFR and mGFR.

e

Percentage bias is calculated as (mGFR – eGFR) / mGFR] × 100.

f

Precision is SD of the difference between mGFR and eGFR values.

g

Accuracy is the proportion of the eGFR within 15%, 30%, and 50% of mGFR, respectively.

*

The slopes of the linear regression indicate a mGFR (y-axis) increase as a unit increase in eGFR (x-axis) at p < 0.001.

Pearson correlation coefficient with p < 0.001.

CKD-EPI, Chronic Kidney Disease Epidemiology Collaboration; cr, creatinine; cys, cystatin C; eGFR, estimated glomerular filtration rate; mGFR, measured glomerular filtration rate; ρ, Pearson correlation coefficient; SD, standard deviation.

Table 3.

Distribution of study population and concordance rate according to mGFR and eGFR categories

mGFR (mL/min/1.73 m2) eGFR (mL/min/1.73 m2)
Overall group concordance rate Lin’s CCC for group agreement (95% CI)
≥90 ≥60, <90 ≥45, <60 ≥30, <45 ≥15, <30 <15
2009 CKD-EPIcr 0.393 0.623 (0.540–0.695)
 ≥90 25 7 1 3 0 0
 ≥60, <90 21 22 13 3 5 1
 ≥45, <60 4 10 12 8 5 0
 ≥30, <45 4 8 11 14 10 1
 ≥15, <30 2 2 9 7 19 4
 <15 0 3 0 1 2 2
2012 CKD-EPIcr-cys 0.473 0.766 (0.711–0.812)
 ≥90 32 3 1 0 0 0
 ≥60, <90 31 25 4 5 0 0
 ≥45, <60 2 18 15 3 1 0
 ≥30, <45 1 10 12 16 9 0
 ≥15, <30 0 2 3 11 24 3
 <15 0 1 0 2 4 1
2012 CKD-EPIcys 0.410 0.654 (0.592–0.708)
 ≥90 33 3 0 0 0 0
 ≥60, <90 45 13 4 1 2 0
 ≥45, <60 12 14 9 3 1 0
 ≥30, <45 2 15 11 15 5 0
 ≥15, <30 1 2 3 11 25 1
 <15 1 0 0 2 2 3
2021 CKD-EPIcr 0.372 0.609 (0.524–0.681)
 ≥90 26 6 1 3 0 0
 ≥60, <90 23 23 11 4 3 1
 ≥45, <60 6 13 8 9 3 0
 ≥30, <45 5 7 15 12 8 1
 ≥15, <30 3 2 8 8 18 4
 <15 0 3 1 0 2 2
2021 CKD-EPIcr-cys 0.456 0.746 (0.689–0.793)
 ≥90 32 3 1 0 0 0
 ≥60, <90 33 23 4 5 0 0
 ≥45, <60 3 20 14 1 1 0
 ≥30, <45 1 13 13 16 5 0
 ≥15, <30 0 3 3 11 23 3
 <15 1 0 1 0 5 1

CCC, oncordance correlation coefficient; CI, confidence interval; CKD-EPI, Chronic Kidney Disease Epidemiology Collaboration; cr, creatinine; cys, cystatin C; eGFR, estimated glomerular filtration rate; mGFR, measured glomerular filtration rate.