Objectives The objectives of this study were to investigate the agreement between medical history questionnaire data and claims data and to identify the factors that were associated with discrepancies between these data types. Methods: Data from self-reported questionnaires that assessed an individual’s history of hypertension, diabetes mellitus, dyslipidemia, stroke, heart disease, and pulmonary tuberculosis were collected from a general health screening database for 2014. Data for these diseases were collected from a healthcare utilization claims database between 2009 and 2014. Overall agreement, sensitivity, specificity, and kappa values were calculated. Multiple logistic regression analysis was performed to identify factors associated with discrepancies and was adjusted for age, gender, insurance type, insurance contribution, residential area, and comorbidities. Results: Agreement was highest between questionnaire data and claims data based on primary codes up to 1 year before the completion of self-reported questionnaires and was lowest for claims data based on primary and secondary codes up to 5 years before the completion of self-reported questionnaires. When comparing data based on primary codes up to 1 year before the completion of self-reported questionnaires, the overall agreement, sensitivity, specificity, and kappa values ranged from 93.2 to 98.8%, 26.2 to 84.3%, 95.7 to 99.6%, and 0.09 to 0.78, respectively. Agreement was excellent for hypertension and diabetes, fair to good for stroke and heart disease, and poor for pulmonary tuberculosis and dyslipidemia. Women, younger individuals, and employed individuals were most likely to under-report disease. Conclusions: Detailed patient characteristics that had an impact on information bias were identified through the differing levels of agreement.
Summary
Citations
Citations to this article as recorded by
Using ‘Situation‐Background‐Assessment‐Recommendation’ Method in Palliative Care to Enhance Handover Quality and Nursing Practice: A Mix Method Study Floriana Pinto, Pasquale Roberto, Lucrezia Ferrario, Laura Marotta, Doriana Montani, Gaetano Auletta, Laura Zoppini, Emanuela Foglia Journal of Clinical Nursing.2025; 34(1): 117. CrossRef
The agreement between diagnoses as stated by patients and those contained in routine health insurance data—results of a data linkage study Felicitas Vogelgesang, Roma Thamm, Timm Frerk, Thomas G. Grobe, Joachim Saam, Catharina Schumacher, Julia Thom Deutsches Ärzteblatt international.2024;[Epub] CrossRef
Immeasurable Time Bias in Self-controlled Designs: Case-crossover, Case-time-control, and Case-case-time-control Analyses Han Eol Jeong, Hyesung Lee, In-Sun Oh, Kristian B. Filion, Ju-Young Shin Journal of Epidemiology.2023; 33(2): 82. CrossRef
Feasibility of continuous distal body temperature for passive, early pregnancy detection Azure Grant, Benjamin Smarr, Dukyong Yoon PLOS Digital Health.2022; 1(5): e0000034. CrossRef
Comparing self-reports to national register data in the detection of disabling mental and musculoskeletal disorders among ageing women Jeremi Heikkinen, Risto J. Honkanen, Lana J. Williams, Shae Quirk, Heikki Kröger, Heli Koivumaa-Honkanen Maturitas.2022; 164: 46. CrossRef
Analytical Approaches to Reduce Selection Bias in As-Treated Analyses with Missing In-Hospital Drug Information Yeon-Hee Baek, Yunha Noh, In-Sun Oh, Han Eol Jeong, Kristian B. Filion, Hyesung Lee, Ju-Young Shin Drug Safety.2022; 45(10): 1057. CrossRef
Trajectory and determinants of agreement between parental and physicians' reports of childhood atopic dermatitis Zhuoxin Peng, Stefanie Braig, Deborah Kurz, Johannes M. Weiss, Stephan Weidinger, Hermann Brenner, Dietrich Rothenbacher, Jon Genuneit Pediatric Allergy and Immunology.2022;[Epub] CrossRef
New methodological approaches were able to effectively reduce immeasurable time bias in case-only designs Han Eol Jeong, In-Sun Oh, Hyesung Lee, Kristian B. Filion, Ju-Young Shin Journal of Clinical Epidemiology.2021; 131: 1. CrossRef
Association between domperidone use and adverse cardiovascular events: A nested case‐control and case‐time‐control study Sun Mi Shin, Han Eol Jeong, Hyesung Lee, Ju‐Young Shin Pharmacoepidemiology and Drug Safety.2020; 29(12): 1636. CrossRef
Feasibility of continuous fever monitoring using wearable devices Benjamin L. Smarr, Kirstin Aschbacher, Sarah M. Fisher, Anoushka Chowdhary, Stephan Dilchert, Karena Puldon, Adam Rao, Frederick M. Hecht, Ashley E. Mason Scientific Reports.2020;[Epub] CrossRef
Clinical outcomes of COVID-19 following the use of angiotensin-converting enzyme inhibitors or angiotensin-receptor blockers among patients with hypertension in Korea: a nationwide study Ju Hwan Kim, Yeon-Hee Baek, Hyesung Lee, Young June Choe, Hyun Joon Shin, Ju-Young Shin Epidemiology and Health.2020; 43: e2021004. CrossRef
The agreement between chronic diseases reported by patients and derived from administrative data in patients undergoing joint arthroplasty Bélène Podmore, Andrew Hutchings, Sujith Konan, Jan van der Meulen BMC Medical Research Methodology.2019;[Epub] CrossRef
Metformin combined with dipeptidyl peptidase-4 inhibitors or metformin combined with sulfonylureas in patients with type 2 diabetes: A real world analysis of the South Korean national cohort Yeon Young Cho, Sung-Il Cho Metabolism.2018; 85: 14. CrossRef
Stroke at baseline of the Brazilian Longitudinal Study of Adult Health (ELSA-Brasil): a cross-sectional analysis Fernanda Gabriela de Abreu, Alessandra Carvalho Goulart, Marina Gabriela Birck, Isabela Martins Benseñor Sao Paulo Medical Journal.2018; 136(5): 398. CrossRef
OBJECTIVES This study was conducted to validate self-reported smoking among high school students using urinary cotinine. METHODS: A self report of smoking behavior was collected together with urine sample for cotinine analysis from 130 male and female students in two vocational high school students in November, 2007. Validity and agreement between self-reported smoking and urinary cotinine was analyzed with STATA 9.0 for different definitions of current smokers, and frequent and daily smokers. Urinary cotinine concentration was measured by the DRI Cotinine Assay for urine (Microgenics Corp., Fremont, CA) on Toshiba 200FR. The cut-off point of urinary cotinine was 50 ng/dl. RESULTS: The concentrations of urinary cotinine were significantly different according to the frequency and amount of smoking. Sensitivity and specificity was 90.9% and 91.8% respectively, and the Cohen's kappa value was 0.787 among the current smokers who smoked at least one day during one month preceding the survey. The comparable high sensitivity, specificity, and kappa value were shown also among the other definitions of current smokers, that is, subjective smokers, and weekly smokers. CONCLUSIONS: The results showed the high validity of self-reported smoking among high school students. However, due to the small sample size and limitation of the participants, it is cautious to generalize the results to overall high school students.
Summary
Citations
Citations to this article as recorded by
Effects of a Smoking Cessation Coaching Program to Improve Smoking Habits So-Hyeong Ryu, Jae-Hong Yoo, An-Na Choi, So-Ra Kim, Sang-Sinn Park, Jin-Kook Tak Journal of Social Science.2022; 33(2): 33. CrossRef
Analysis of the Accuracy and Related Factors of Self-Reported Smoking Status according to Urinary Cotinine Concentration in Adolescents: The KoNEHS Cycle (2015~2017) Sunkyoung Jung, Sangshin Park Journal of Environmental Health Sciences.2022; 48(4): 216. CrossRef
Smoking Susceptibility and Tobacco Media Engagement Among Youth Never Smokers Saida I. Coreas, Erik J. Rodriquez, Sana G. Rahman, Sherine El-Toukhy, Wilson M. Compton, Carlos Blanco, Heather L Kimmel, Eliseo J. Pérez-Stable Pediatrics.2021;[Epub] CrossRef
A comparison of self-reported to cotinine-detected smoking status among adults in Georgia Julianne Williams, Ivo Rakovac, Enrique Loyola, Lela Sturua, Nino Maglakelidze, Amiran Gamkrelidze, Kristina Mauer-Stender, Bente Mikkelsen, João Breda European Journal of Public Health.2020; 30(5): 1007. CrossRef
Clustering of chronic diseases risk factors among adolescents: a quasi-experimental study in Sousse, Tunisia Emna Dendana, Rim Ghammem, Jihene Sahli, Jihen Maatoug, Sihem Ben Fredj, Imed Harrabi, Molka Chaieb, Hassen Ghannem International Journal of Adolescent Medicine and Health.2019;[Epub] CrossRef
Consistency and reliability of smoking-related variables: longitudinal study design in asthma and COPD Eveliina Hirvonen, Mikhail Stepanov, Maritta Kilpeläinen, Ari Lindqvist, Tarja Laitinen European Clinical Respiratory Journal.2019; 6(1): 1591842. CrossRef
Underestimation of Self-Reported Smoking Prevalence in Korean Adolescents: Evidence from Gold Standard by Combined Method Jun Hwang, Jong Kim, Do Lee, Hye Jung, Soon-Woo Park International Journal of Environmental Research and Public Health.2018; 15(4): 689. CrossRef
Tobacco smoking and the risk of atrial fibrillation: A systematic review and meta-analysis of prospective studies Dagfinn Aune, Sabrina Schlesinger, Teresa Norat, Elio Riboli European Journal of Preventive Cardiology.2018; 25(13): 1437. CrossRef
Susceptibility to tobacco product use among youth in wave 1 of the population Assessment of tobacco and health (PATH) study Dennis R. Trinidad, John P. Pierce, James D. Sargent, Martha M. White, David R. Strong, David B. Portnoy, Victoria R. Green, Cassandra A. Stanton, Kelvin Choi, Maansi Bansal-Travers, Yuyan Shi, Jennifer L. Pearson, Annette R. Kaufman, Nicolette Borek, Bla Preventive Medicine.2017; 101: 8. CrossRef
Lipid profiles and determinants of total cholesterol and hypercholesterolaemia among 25–74 year-old urban and rural citizens of the Yangon Region, Myanmar: a cross-sectional study Aung Soe Htet, Marte Karoline Kjøllesdal, Wai Phyo Aung, Aye Nyein Moe Myint, Win Thuzar Aye, Myint Myint Wai, Than Than Nu, Ei Mon Hla, Pyone Pyone Soe, Nan Wut Yi Tun, Naw Angela, Mya Mya Khaing, Aung Kyaw Htoo, Soe Tun, Pai Thitsar, Theeoo Lwin, San Sa BMJ Open.2017; 7(11): e017465. CrossRef
Comparative analysis of two tobacco surveillance questionnaires used in NHANES: accuracy of self-reported smoking status Ram B. Jain Toxicological & Environmental Chemistry.2016; 98(1): 137. CrossRef
Influence of Stress, Self-efficacy for Smoking Cessation, Smoking Temptation and Nicotine Dependency in Male College Students who Smoke Nam-Jo Kim, Hae-Sook Hong Journal of Korean Biological Nursing Science.2016; 18(1): 1. CrossRef
Tobacco use and second-hand smoke exposure in young adolescents aged 12–15 years: data from 68 low-income and middle-income countries Bo Xi, Yajun Liang, Yunxia Liu, Yinkun Yan, Min Zhao, Chuanwei Ma, Pascal Bovet The Lancet Global Health.2016; 4(11): e795. CrossRef
Association between Second-Hand Smoking and Laryngopathy in the General Population of South Korea Haewon Byeon, Dongwoo Lee, Sunghyoun Cho, Hiroyoshi Ariga PLOS ONE.2016; 11(11): e0165337. CrossRef
Relationship between women's smoking and laryngeal disorders based on the urine cotinine test: results of a national population-based survey Haewon Byeon, Dongwoo Lee, Sunghyoun Cho BMJ Open.2016; 6(11): e012169. CrossRef
Evaluating the validity of self-reported smoking in Mexican adolescents María del Carmen Valladolid-López, Tonatiuh Barrientos-Gutiérrez, Luz Myriam Reynales-Shigematsu, James F Thrasher, Ingris Peláez-Ballestas, Eduardo Lazcano-Ponce, Mauricio Hernández-Ávila BMJ Open.2015; 5(10): e007485. CrossRef
The Correlation of Different Cotinine Levels With Questionnaire Results Myung Bae Park, Eun Woo Nam, Seon Kui Lee, Chun-Bae Kim, Chhabi Ranabhat Asia Pacific Journal of Public Health.2015; 27(5): 542. CrossRef
The Relationship between Smoking and Personal Psychological Factors and Socioeconomic Status in 8th Grade Students from the 2010-2012 Online Survey of Adolescent Health Behaviors of Korea Cheol-Hwan Kim, Min-jung Jun, Sung-eun Kim Journal of the Korean Society for Research on Nicotine and Tobacco.2015; 6(1): 26. CrossRef
Validation of Self-Reported Smokeless Tobacco Use by Measurement of Serum Cotinine Concentration Among US Adults I. T. Agaku, B. A. King American Journal of Epidemiology.2014; 180(7): 749. CrossRef
Prevalence and validity of self-reported smoking in Indigenous and non-Indigenous young adults in the Australian Northern Territory Mark S Pearce, Kay D Mann, Gurmeet Singh, Belinda Davison, Susan M Sayers BMC Public Health.2014;[Epub] CrossRef
Use of mobile phone text messaging to deliver an individualized smoking behaviour intervention in Chinese adolescents Hui-Jing Shi, Xiao-Xiao Jiang, Chun-Yan Yu, Yue Zhang Journal of Telemedicine and Telecare.2013; 19(5): 282. CrossRef
Lifetime History of Cigarette Smoking Associated with Aggression and Impulsivity in Both Healthy and Personality Disorered Volunteers Elias Dakwar, Marias Popii, Emil F. Coccaro Journal of Personality Disorders.2011; 25(5): 645. CrossRef
Earlier Age of Smoking Initiation May Not Predict Heavier Cigarette Consumption in Later Adolescence Holly E. R. Morrell, Anna V. Song, Bonnie L. Halpern-Felsher Prevention Science.2011; 12(3): 247. CrossRef
Smoking-Induced Acute Eosinophilic Pneumonia in a 15-year-old Girl: A Case Report Ji-Seok Youn, Ji-Won Kwon, Byoung-Ju Kim, Soo-Jong Hong Allergy, Asthma and Immunology Research.2010; 2(2): 144. CrossRef
Evaluating the impact of a school-based helmet promotion program on eligible adolescent drivers: different audiences, different needs? E. Germeni, C. Lionis, V. Kalampoki, B. Davou, M. Belechri, E. Petridou Health Education Research.2010; 25(5): 865. CrossRef
A novel C6-phenyl liquid chromatographic technique for rapid and simultaneous measurements of urinary cotinine and nicotine Bee Lan Lee, Yanhong Gao, Ai Li New, Xu Wang, Woon-Puay Koh, Choon Nam Ong Analytical Methods.2010; 2(7): 878. CrossRef
Smoking and Risk for Diabetes Incidence and Mortality in Korean Men and Women Sun Ha Jee, Athena W. Foong, Nam Wook Hur, Jonathan M. Samet Diabetes Care.2010; 33(12): 2567. CrossRef
After the introduction of National Medical Insurance in 1989, the medical demand has rapidly increased. The impact of increased medical demand was followed by an increase in the number of claims in need of review. We studied a new, fair method for reducing the number of claims reviewed. we analysed 90,583 outpatient claims submitted between september and october; claims were made for services given August of 1994. We finally suggested a screening system for claims review using a statistical method of discriminant analysis of the medical costs. The results were as follows. 1. In the cut-off group, age, days of medication, number of hospital or clinic visits, and total change were significantly high The cut-off rates according to the hospital-type and existence of accompanied disease were significantly different. 2. According to ICD, the cut-off rate was highest in peripheral enthesopathies and allied syndromes(20.76%), lowest in acute sinusitis(0.93%). The mean charges were significantly different according to ICD and existence of cut-off. 3. we build discriminant functions by ICD with such discriminant variables as patient age, sex, existence of accompanied disease, number of hospital or clinic visits, and 9 detailed hospital or clinic charges included in claim. 4. we applied the discriminant function for screening those claims that were expected to be cut-off. The sensitivities comprised from 40% to 70%, and specificities from 70% to 95% by ICD. Acute rhinitis had highest sensitivity(100.00%)and other local infections of skin and subcutaneous tissue had highest specificity(98.45%). The excepted number of cut-off was 17,762(19.61%). The total sensitivity was 49.62%, the total specificity was 82.57% and the error rate was 19.66%. We lacked economic analysis such as cost-benefit analysis. But, if the few method of screening claims using discriminant analysis were applied, the number of claims in need of review will reduce considerably.