Validation of operational definitions of mortality in a nationwide hemodialysis population using the Health Insurance Review and Assessment Service databases of Korea

Article information

Kidney Res Clin Pract. 2024;43(2):156-164

Publication date (electronic) : 2023 February 23

doi : https://doi.org/10.23876/j.krcp.22.077

Dong Hee Lee¹, Ye-Jee Kim², Hyangkyoung Kim^,3,*, Hyung Seok Lee^,1,*

¹Division of Nephrology, Department of Internal Medicine, Hallym University Sacred Heart Hospital, Anyang, Republic of Korea

²Department of Clinical Epidemiology and Biostatistics, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Republic of Korea

³Department of Surgery, Kyung Hee University Hospital at Gangdong, Kyung Hee University School of Medicine, Seoul, Republic of Korea

Correspondence: Hyung Seok Lee Division of Nephrology, Department of Internal Medicine, Hallym University Sacred Heart Hospital, 22 Gwanpyeong-ro 170beon-gil, Dongan-gu, Anyang 14068, Republic of Korea. E-mail: pcsacred@gmail.com

Hyangkyoung Kim Department of Surgery, Kyung Hee University Hospital at Gangdong, Kyung Hee University School of Medicine, 892 Dongnam-ro, Gangdong-gu, Seoul 05278, Republic of Korea. E-mail: cindycrow7456@gmail.com

*Hyangkyoung Kim and Hyung Seok Lee contributed equally to this study as co-corresponding authors.Hyangkyoung Kim’s current affiliation: Department of Surgery, Ewha Womans University College of Medicine, Seoul, Republic of Korea

Received 2022 April 13; Revised 2022 August 19; Accepted 2022 September 9.

Abstract

Graphical abstract

Introduction

National population-based studies using data from national health insurance systems can facilitate long-term tracking of the healthcare environment and the collected data can be used for numerous studies including outcome studies, epidemiological studies, and pharmacovigilance studies [1–3]. Korea has a universal, single-payer national health insurance system where the entire Korean population and healthcare providers are eligible to register for the national health insurance program comprising the National Health Insurance Service (NHIS) and Medical Aid [4,5]. In particular, the specific code (V001) assigned to hemodialysis (HD) patients is a useful tool to identify patients on maintenance HD in Korea, and several studies on this population have been conducted [6,7]. All medical claims for medical services issued by healthcare providers are reviewed and assessed by the Health Insurance Review and Assessment Service (HIRA), and the medical expenses are reimbursed by the National Health Insurance Cooperation (NHIC) [8]. Therefore, all medical claims data for medical services provided for dialysis patients enrolled in the national health insurance program or Medical Aid is stored and managed in the HIRA and NHIS databases. Using NHIS or HIRA databases, it is possible to identify every end-stage kidney disease (ESKD) patient within the entire Korean population and analyze the claims data of all ESKD patients on dialysis therapy.

Nevertheless, the HIRA database does not provide detailed information on mortality, whereas it can be obtained from the NHIS database. All-cause mortality is the most objectively measurable surrogate endpoint because it has minimal chance of being affected by bias in patient selection, missing data, or misclassification of the cause of death [9]. Although it is ideal to merge NHIS data with that from Statistics Korea to investigate the time of death as well as the cause of death [10–12], analysis of all-cause mortality is feasible based on mortality information from the NHIS database. In the Korean HD population, alternatively, studies on all-cause mortality have been conducted using HIRA data by defining all-cause mortality as death where no claims were made for a certain period of time such as 30 days, 90 days, or more than 180 days [13–16].

These operational definitions of mortality have been accepted based on the consensus that chronic dialysis patients would have died without the use of medical services for several months. However, this has yet to be verified. This study aimed to validate the operational definition period for mortality that has been used in the analyses of claims data in the HIRA database.

Methods

Study population

To identify incident HD patients aged over 19 years, we excluded patients less than 19 years old and patients who had a specific code for HD (V001) or procedure codes for HD (O7020, O9991) more than 90 days during the year before the initiation of HD treatment. Among them, we identified patients who started HD during the study period and maintained HD for at least 90 days. Patients who underwent kidney transplantation (KT) or peritoneal dialysis (PD) in the study period were also excluded. Therefore, we analyzed a total of 128,876 HD patients who continued HD over 90 days and remained on chronic HD till the end of the study period. Deceased patients, who were confirmed to be deceased during the study period based on analysis of the Certificate Database of NHIS, were assigned to group A. Deceased patients defined according to the period of absence of any claims data for medical service use were assigned to group B. A flow diagram for the selection of the study population is provided in Fig. 1.

Figure 1.

Diagram of the study cohort.

HD, hemodialysis; KT, kidney transplantation; PD, peritoneal dialysis.

Statistical analysis

Demographic data are presented as frequencies in the case of categorical variables or as means and standard deviations or medians and interquartile ranges (IQRs) in the case of continuous variables. Sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), and overall accuracy were calculated according to a 2 × 2 contingency table (Table 1). Patients’ survival probabilities were assessed by Kaplan-Meier survival analysis. Statistical analyses were performed using SAS Enterprise Guide version 7.1 (SAS Institute).

Table 1.

Two-by-two contingency table regarding the agreement in death classification between the NHIS and no insurances claims data for a specific period

Results

There were 151,382 (58.4% male) incident dialysis patients on maintenance HD between January 2009 and December 2019. Among these, 128,876 patients (58.0% male) had not undergone PD or KT. Mean follow-up period was 3.26 ± 2.8 years (median, 2.61 years; IQR, 0.97–4.93 years) and mean age was 66.09 ± 13.8 years. Among the total 128,876 patients, 66,520 deaths were identified in the NHIS data during the study period; these cases were assigned to group A. The all-cause mortality of groups during the study period is presented in Table 2. The total mortality of group B30 during the study period was 89,277, which was the largest difference compared with that of group A (n = 66,520), whilst the smallest difference was noted in group B150 (n = 66,514).

Table 2.

Mortality of incident patients on maintenance hemodialysis according to group classification

Sensitivity, specificity, PPV, NPV, and overall accuracy were calculated by comparing mortality between the A and B groups (Table 3). In groups B120, B150, and B180, accuracy was more than 95%, with group B150 showing the highest accuracy.

Table 3.

Sensitivity, specificity, PPV, NPV, and accuracy of groups defined based on operational definitions of mortality

We performed survival analysis based on Kaplan-Meier analysis; survival curves are depicted in Fig. 2. Mortality was overestimated in groups B30 and B60 compared to the registration information present in the NHIS data (group A). Group B90 had a greater risk of mortality rate overestimation than groups B120, B150, B180 as well as the lowest overall accuracy (Fig. 3).

Figure 2.

Survival curves for all groups.

Registration information; the survival curve of group A is the reference. Groups B30, B60, B90, B120, B150, and B180 are patient groups with presumed deaths defined by operational definition as the absence of any claims data for medical service use over 30, 60, 90, 120, 150, and 180 days, respectively.

Figure 3.

Comparison of the survival curves of groups based on operational definitions of mortality with that of the group with mortality defined based on registration information (group A).

(A) Comparison of the survival curve of group B90 with that of group A. (B) Comparison of the survival curve of group B120 with that of group A. (C) Comparison of the survival curve of group B150 with that of group A. (D) Comparison of the survival curve of group B180 with that of group A. Registration information; the survival curve of group A was set as the reference. Groups B90, B120, B150, and B180 are patient groups with presumed deaths defined by operational definition as the absence of any claims data for medical service use over 90, 120, 150, and 180 days, respectively.

Compared to the mortality dates for group A, the mortality dates of groups B120, B150, and B180 were identical to those of group A in 88.3%, 88.5%, and 88.6% of deceased patients, respectively. Median difference in mortality date between group A and groups B120 (IQR, 1–14), B150 (IQR, 1–13), and B180 (IQR, 1–12) was 3 days.

The probabilities of a difference of a week or less between the mortality dates for group A and B patients were 95.7%, 95.9%, and 96.0% for groups B120, B150, and B180, respectively (Table 4).

Table 4.

Comparison of differences in mortality dates among groups B120, B150, and B180 relative to group A

Discussion

Despite the usefulness of claims data from the health insurance system, analysis of data from NHIS and HIRA databases poses some unique challenges. NHIS data are difficult to access, and HIRA data do not provide detailed mortality information. Given that all-cause mortality is a surrogate endpoint and the hardest objectively measurable outcome, its unavailability in the HIRA data is a disadvantage. To analyze NHIS data, it is necessary to visit one of a limited number of analyzing centers that can only be accessed during the daytime for a limited period, an untenable situation for the majority of physicians in clinical practice. Conversely, the HIRA database provides more favorable accessibility with no daytime access restrictions and can be analyzed in one’s own office via remote access at any time.

To study patients on maintenance HD, nephrologists have applied operational definitions to HIRA data by interpreting the absence of any claims data as death [13–16].

Clinically, it is very hard for ESKD patients on maintenance HD to survive over several months without using any medical services. However, when analyzing HIRA data using an operational definition of death, a patient who is alive may be misclassified as dead in some circumstances, including cases where insurance eligibility was suspended for a period due to long-term overseas stay, emigration, or long-term nonpayment of health insurance premiums. It is not clear how much these exceptional cases affect the agreement between mortality from the NHIS database and presumed mortality from the HIRA database when mortality analysis of HIRA data is performed using operational definitions.

Our study findings indicate that when a period of no claims data of 150 days was used, it provided the most accurate estimate of mortality rate based on NHIS data. The period of 30 days was most sensitive but also least accurate because, in Korea, healthcare centers only report monthly claims data to the HIRA. When the period of no claims data was defined as 90 days or less, the possibility of mortality rate overestimation was high. If mortality is defined by as long as possible a period of no claims data, mortality may be underestimated despite a high PPV. This is because the longer the period of no claims data, the longer the immortal time at the end of the follow-up period. This implies that if the period of no claims data is too long, the patient’s death is reflected with less sensitivity, resulting in low accuracy. This effect was more pronounced as longer the survival duration (Fig. 3). Therefore, when the period of no claims data was set to 90 days or less, there was a high risk of overestimating the mortality rate during the entire study period. Conversely, when it was set to 180 days or more, there was a risk of underestimating the mortality rate.

We investigated the difference between mortality date estimated by each operational definition and that of the NHIS database. In this study, an operational definition of mortality date was considered as the first date of the period that the patient had not used any medical services according to each definition. There was a median difference of 3 days between the date of death in the NHIS data and that of groups B120, B150, and B180 (IQR of 1–14, 1–13, and 1–12, respectively). These results appear to reflect the characteristics of patients on maintenance HD who regularly undergo HD treatment at least every 2 to 3 days.

Mortality dates of groups B120, B150, and B180 were identical to those in the NHIS database in 88.3%, 88.5%, and 88.6% of cases, respectively, and for cases where the mortality date was estimated by the operational definition, there was a difference of a week or less in the mortality date from that of the NHIS in 95.7%, 95.9%, and 96.0% of cases, respectively. These results imply that judicious establishment of operational definitions can provide reliable outcomes in mortality analysis using Korean HIRA data.

This study had several limitations. First, this study utilized the Korean administrative database and the Korean national health insurance system, and thus cannot be generalized to other nations with different health insurance systems or administrative databases. Second, it is not feasible to investigate the cause of death using HIRA and NHIS databases, hence analysis based on the cause of death still requires merging of data from these databases with cause of death information from Statistics Korea. Last, the best accuracy of the applied operational definitions for all-cause mortality analysis in the present study was 96%; remaining inaccuracies should be further reduced by finding more optimal tools in future investigations.

In conclusion, the operational definition for mortality was most accurate when the period of no claims data was set to 150 days. Thus, absence of claims data for 150 days is an acceptable operational definition for the analysis of all-cause mortality in patients on maintenance HD when using HIRA claims data. Future studies using HIRA data should focus on the interpretation of mortality data and clarify the limitations of analyzing mortality rates obtained by operational definitions.

Article information Continued