Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Self-administered Vitamin D Status Predictor: Older adults are able to use a self-questionnaire for evaluating their vitamin D status

  • Cedric Annweiler ,

    Roles Conceptualization, Formal analysis, Investigation, Methodology, Project administration, Resources, Supervision, Visualization, Writing – original draft

    Cedric.Annweiler@chu-angers.fr

    Affiliations Department of Neurosciences and Aging, Division of Geriatric Medicine, Angers University Hospital; Angers University Memory Clinic; Research Center on Autonomy and Longevity; UPRES EA 4638, University of Angers, UNAM, Angers, France, Robarts Research Institute, Department of Medical Biophysics, Schulich School of Medicine and Dentistry, the University of Western Ontario, London, Ontario, Canada

  • Anastasiia Kabeshova,

    Roles Data curation, Formal analysis, Methodology, Software, Validation, Writing – review & editing

    Affiliation Department of Neurosciences and Aging, Division of Geriatric Medicine, Angers University Hospital; Angers University Memory Clinic; Research Center on Autonomy and Longevity; UPRES EA 4638, University of Angers, UNAM, Angers, France

  • Alix Callens,

    Roles Investigation, Writing – review & editing

    Affiliation Health Faculty, School of Medicine, Angers, France

  • Marie-Liesse Paty,

    Roles Investigation, Writing – review & editing

    Affiliation Health Faculty, School of Medicine, Angers, France

  • Guillaume T. Duval,

    Roles Investigation, Writing – review & editing

    Affiliation Department of Neurosciences and Aging, Division of Geriatric Medicine, Angers University Hospital; Angers University Memory Clinic; Research Center on Autonomy and Longevity; UPRES EA 4638, University of Angers, UNAM, Angers, France

  • Michael F. Holick

    Roles Visualization, Writing – original draft

    Affiliation Section of Endocrinology, Diabetes and Nutrition, Department of Medicine, Boston University Medical Center, Boston, MA, United States of America

Abstract

Background

The 16-item Vitamin D Status Predictor (VDSP) questionnaire helps to identify, without resorting to a blood test, older adults with low vitamin D concentrations. Our objective was to determine whether a self-administered VDSP was concordant with the VDSP administered by a physician, and to examine the concordance of every single item of the VDSP.

Methods

A total of 349 older in- and outpatients (mean, 83.2±7.2years; 59% female) were consecutively recruited in the geriatric ward of the University Hospital of Angers, France. All participants completed a self-administered VDSP questionnaire (self-VDSP) in paper format composed of 17 items exploring age, gender, general condition, nutrition, vision, mood, cognition, gait and falls, and osteoporosis. All participants underwent subsequently a full clinical examination by a physician exploring the same areas (rater-VDSP).

Results

The agreement between the self-VDSP and the rater-VDSP was almost perfect for the probability of having low vitamin D concentrations, regardless of the definition used (i.e., ≤25, ≤50 or ≤75 nmol/L). The agreements between physicians’ and patients’ responses were significant for every single VDSP item. The agreement was fair to perfect for all items, except for cognitive disorders, undernutrition and polymorbidity (poor agreement).

Conclusions

Older adults are able to evaluate their own probabilities of severe vitamin D deficiency, deficiency and insufficiency. A self-questionnaire may promote the use of the VDSP tool in this population, and help clinicians in decisions to supplement their patients in a reasoned way.

Introduction

Vitamin D deficiency defined as a 25-hydroxyvitamin D [25(OH)D] <50 nmol/L (20ng/mL) is highly prevalent in children and adults worldwide, where up to 80% are at risk including those who are elderly [1]. Elders with chronic low circulating 25(OH)D concentrations can suffer a significant number of adverse health events including osteomalacia, osteopenia, osteoporosis due to secondary hyperparathyroidism, and non-skeletal consequences with a greater propensity to fall, and increased risks for type 2 diabetes mellitus, cardiovascular disease, deadly cognitive disorders, cancers, sarcopenia and viral upper respiratory tract infections, among others [2].

Importantly, vitamin D deficiency and its consequences may be easily prevented and corrected by oral supplementation and sensible sun exposure [1,3]. For this reason, the use of the 25(OH)D assay, the only reliable indicator for vitamin D status [1], increased dramatically during the last decade. The whole problem is that, although supplementation is relatively cheap, the determination of serum 25(OH)D concentration can cost at least ten times more than a one-year supplementation in some countries [4]. To save heath care costs, US [5] and French [4] health authorities recently examined the clinical utility of the serum testing of 25(OH)D, and concluded that evidence was insufficient to recommend routine vitamin D screening. This recommendation is consistent with the recommendation from the Institute of Medicine [6] and the Endocrine Society’s Practice Guidelines For Vitamin D [7]. As a result, the recommendation is to provide vitamin D supplementation without first measuring the serum 25(OH)D concentration. Consistently, several studies have reported on vitamin D supplementation for up to 6 years without any evidence for toxicity. For instance, Pietras et al. showed that healthy adults receiving 50,000 IU of vitamin D2 twice a month (equivalent to ingesting 3300 IU/day) maintained healthy circulating concentrations of 25(OH)D in the range of 100–150 nmol/L (40–60 ng/mL) [8]. In contrast, there are some recent concerns raised that giving 25(OH)D3 or high doses of vitamin D may increase the risks of falls and allergies among older adults [9,10], which could limit the incentive to supplement without first knowing the vitamin D status. Furthermore, although both population screening and universal supplementation appear justified from a cost-utility point of view in community-dwelling older women and men [11,12], it was reported that population screening was more cost-effective than universal supplementation after the age of 80 years [11], which encourages the use of blood testing in this population.

To avoid the need for a blood test screening for vitamin D status in older adults, we recently developed the Vitamin D Status Predictor (VDSP), a 16-item questionnaire able to identify older adults with undesirable vitamin D status who may be administered vitamin D supplements without obtaining a blood test for 25(OH)D [13,14].

However, the inherent flaw in any rater-administered questionnaire, including the VDSP, relies on the intervention of a caregiver who may influence the results, consumes more resources and can make the test less accessible on a routine basis. The opportunity to answer a self-questionnaire would facilitate its use and potentially extend the possibilities of use in the general population. We hypothesized that the physician-administered VDSP could be self-administered in older adults. The aim of this study was to examine the concordance of answers to a self-administered questionnaire with information collected by a physician during a full clinical examination.

Materials and methods

Participants

The study was conducted in accordance with the ethical standards set forth in the Helsinki Declaration (1983). The entire study protocol was approved by the Ethical Committee of the University Hospital of Angers, France (No 2015–03). We studied in- and outpatients aged 65 and over consecutively recruited in the VDSP-G (Vitamin D Status Predictor for Geriatrics) study. The VDSP-G study is an observational cross-sectional study designed to apply the VDSP among all patients consecutively hospitalized or seen in consultation in the geriatric acute care unit of the University Hospital of Angers, France, from March to May 2015 [14]. After giving their written informed consent for research, included participants received a full medical examination consisting of a self-administered VDSP questionnaire, various rater-administered structured questionnaires and a standardized clinical examination.

Self-administered VDSP questionnaire

A self-administered questionnaire in paper format was given to each patient meeting the selection criteria at their arrival in the ward. This questionnaire consisted of 17 items (Table 1). Except for the age, height, weight, and the number of drugs taken per day, all items corresponded to a question with a forced choice in closed-ended format (i.e., yes or no). If necessary, the self-questionnaire was completed with the help of the relatives. Finally, the algorithms previously published [13] were applied to the items of the self-VDSP to identify among participants those with probable severe vitamin D deficiency (i.e., serum 25(OH)D ≤25nmol/L), vitamin D deficiency (i.e., serum 25(OH)D ≤50nmol/L) or vitamin D insufficiency (i.e., serum 25(OH)D ≤75nmol/L) [1]. Briefly, the VDSP is based on a 16-item questionnaire coupled with combinatorial non-linear algorithms that were built from models of feed forward artificial neural networks (multilayer perceptron) [13,14]. In practice, clinicians submit the 16 responses to the tool, which combines them using three dedicated algorithms to identify severe vitamin D deficiency, deficiency or insufficiency.

Medical examination: Rater-administered VDSP questionnaire.

Participants underwent a full clinical examination by a physician. The following 16 items from the original VDSP were collected standardizedly: gender, age (in years), number of therapeutic classes used per day, body mass index (BMI, in kg/m2), use walking aids, use psychoactive drugs (i.e., benzodiazepines, anti-depressants, and/or neuroleptics), wearing glasses, sad mood, fear of falling, history of falls in the preceding year, cognitive disorders, undernutrition, polymorbidity, history of vertebral fractures, living alone, use osteoporotic medications (bisphosphonates, denosumab, strontium, and/or calcium and vitamin D supplements). The BMI was calculated based on anthropometric measurements. Undernutrition was defined as a BMI below 21 kg/m2 [15]. Polymorbidity was defined as having more than three chronic diseases (i.e., diseases of indefinite duration or running a course with minimal change). A fall was defined as an event resulting in a person coming to rest unintentionally on the ground or at other lower level, not as the result of a major intrinsic event or an overwhelming hazard, according to the French Society of Geriatrics and Gerontology (SFGG) and the French national agency for health [16]. The history of vertebral fractures was sought from interview of the patients and/or their relatives and from the medical records. The fear of falling was sought using the following standardized question "Are you afraid of falling?", as previously published [17]. The presence of cognitive disorders was identified using the Mini-Mental State Examination [18] and/or the history of dementia from medical records. Finally, sad mood was sought using the following question from the 4-item Geriatric Depression Scale: "Do you feel discouraged and sad?" [19]. Finally, just as for the self-VDSP, we applied the algorithm previously published [13] to the items of the rater-VDSP to identify among participants those with probable severe vitamin D deficiency or vitamin D deficiency or vitamin D insufficiency [1].

Statistics

Firstly, physicians’ and patients’ responses regarding patient information were summarized using frequencies and percentages or means ± standard deviations, as appropriate. Secondly, interrater agreement in physicians’ and patients’ quantitative responses was analyzed with the intraclass correlation coefficient (ICC). The ICC is the proportion of the variability in the observations due to the differences between pairs. The ICC takes values from 0 (no agreement) to 1 (perfect agreement) [20]. Finally, agreement in physicians’ and patients’ qualitative responses was calculated with Cohen's kappa (ĸ), which is a coefficient of pairwise agreement between observers [21]. ĸ = 1 implies perfect agreement, and ĸ = 0 suggests that the agreement is no better than that which would be obtained by chance. According to Landis, values are judged on a scale as poor if ĸ≤0.20, fair if 0.21≤ĸ≤0.40, moderate if 0.41≤ĸ≤0.60, substantial if 0.61≤ ĸ≤0.80 and almost perfect if ĸ>0.80 [22]. P-values<0.05 were considered statistically significant. All statistics were performed using SPSS (version19.0; SPSS, Inc., Chicago, IL) and R 3.1.0 (GNU project).

Results

Table 2 reports the characteristics of 349 included participants (mean±standard deviation, 83.2±7.2years; 59.0% female; 52.7% inpatient; 99.1% Caucasian) obtained with the rater- and self-administered questionnaires. Using the rater-VDSP, 19.5% of participants were classified as having probable severe vitamin D deficiency, 42.2% as having probable vitamin D deficiency, and 78.4% as having probable vitamin D insufficiency. Parallel, using the self-VDSP, 19.2% of participants were classified as having probable severe vitamin D deficiency, 47.9% as having probable vitamin D deficiency, and 85.4% as having probable vitamin D insufficiency.

thumbnail
Table 2. Physicians’ and patients’ responses regarding patient information (n = 349).

https://doi.org/10.1371/journal.pone.0186578.t002

Comparison between rater- and self-VDSP underscored that the agreements between physicians’ and patients’ responses were significant for every single item of the VDSP (Table 3). The P-values were strictly less than 0.001 for all items except for the items 11 to 13 (i.e., cognitive disorders, undernutrition, polymorbidity) with P-values of 0.008, 0.003 and 0.010 respectively. Similarly, the magnitude of the agreement was fair to perfect for all items, with the exception of items 11 to 13 (poor agreement). Specifically, the patients tended to underestimate the existence of cognitive disorders, undernutrition and polymorbidity (Table 2).

thumbnail
Table 3. Agreement between physicians’ (rater-VDSP) and patients’ (self-VDSP) responses (n = 349).

https://doi.org/10.1371/journal.pone.0186578.t003

Finally, Table 3 shows that the agreement was almost perfect for the identification of those likely to have severe vitamin D deficiency, vitamin D deficiency or vitamin D insufficiency while using the rater-VDSP or the self-VDSP (Table 3).

Discussion

The present findings report that the self-administered VDSP shows an almost perfect agreement with the VDSP administered by a physician. The agreement was significant for all separate VDSP items, and the small divergences were mainly linked to the underestimation by patients of their health issues (cognitive disorders, undernutrition, polymorbidity). The clinical relevance is that older adults are able to evaluate their own probabilities of severe vitamin D deficiency, vitamin D deficiency and vitamin D insufficiency, which should save time for caregivers and promote the use of the VDSP tool.

To the best of our knowledge, we report here the first evidence that older adults are able to assess their own probability of hypovitaminosis D, with a high concordance with physician assessment. Only few nonsignificant divergences were observed; all about underreporting by patients of cognitive disorders, undernutrition, polymorbidity. Two explanations may be provided. First, the divergence may result from the use of a question wording in the self-VDSP that was subtly different from the rater-VDSP, and asked patients about their health perception without proposing clear severity level, leaving the patients to judge if they were subject to ‘memory lapses’, ‘malnourishment’ or ‘a lot of chronic diseases’ without specifying a number. Thus, the patients’ answers could vary from the physicians' answers, which were based on a clear definition in the three cases. Second, comparative self-rating and other-rating data may also be considered as “a coin with two faces”: symptom underestimation by the patient can be seen as overestimation by the physician [23]. Third, it should be acknowledged that distorted self-perceptions have already been reported among patients for these three aspects. For instance, subjective memory complaints are not always superimposed with objective cognitive disorders, but may either precede the onset of objective disorders, or be related to anxiety, or be more restrictive than cognitive disorders that may involve cognitive fields other than memory, or be cancelled by anosognosia in the case of dementia [24]. Also, underestimation of weight loss has been regularly reported among patients [25,26]. This general tendency to minimise symptoms is also consistent with the underreporting of polymorbidity here, and has been explained by an overall underestimation of risk perception in patients due to either a lack of knowledge about health issues or a coping strategy [27]. Regardless of the reason for these divergences, their magnitude was not important enough to alter the agreement between the classifications offered by the rater-VDSP and the self-VDSP into individuals with or without severe vitamin D deficiency, deficiency or insufficiency.

Developing new simple, effective and affordable strategies to identify older adults with undesirable vitamin D status is urgent in the context of growing awareness that this condition is common and serious in older adults, with consequent major increases in the number of blood tests and related health costs. Current guidelines regarding the decision to supplement vitamin D in clinical practice are mostly justified by the efficacy of supplementation. For example, the dosage of vitamin D is encouraged in people at high risk of falls and bone fractures [3] because vitamin D supplementation has demonstrated to prevent falls and fractures [28]. This approach, although evidence-based, is yet limited since the question of testing should not be reduced to the efficacy of supplementation. Indeed, despite a relatively low number of clinical trials reporting prevention of adverse health events with vitamin D supplements, accumulating evidence report that vitamin D deficiency precedes and predicts the incident onset of multiple health conditions [2]. Thus, given the limited cost of supplementation and the potential benefits, vitamin D supplementation is desirable among people in whom hypovitaminosis D is observed. This is especially true as it has been calculated that population screening is more cost-effective than universal supplementation after the age of 80 years [11]. However, currently, the only way to diagnose vitamin D deficiency and insufficiency depends on a blood test. That is why, to rationalize the use of serum 25(OH)D assays and save health costs, clinical diagnostic tools like the VDSP are needed to identify individuals at high risk of undesirable vitamin D status, since blood testing continues to remain restrictive due to its expense. The accessibility of such a tool, however, depends on the availability of careers, and it will be improved if the tool is made available directly to the users, who could then test themselves and alert their career in case of probable vitamin D deficiency or insufficiency. This may also open some perspectives in primary care. As older outpatients are able to answer the questionnaire in the waiting room, this approach is easy to implement in clinical practice and will certainly help clinicians in decisions to supplement their patients.

Our results open a new perspective in the field of Quantified Self (QS). QS is a recent trend in the general population based on self-measures of health and function using new digital technologies in order to become healthier or remain healthy [29]. Nowadays, the miniaturization of digital technologies allows measuring human physiological parameters to reflect health status (e.g., blood pressure or caloric expenditures). The main disadvantage of such ‘high-tech’ QS is however to consider the individuals more as measurement objects than actors of their own health, the latter point being yet crucial for health improvement. To promote the active participation of individuals, the World Health Organization recommends using self-administered questionnaires to rate and monitor individuals' health [3032]. This approach is also thought to educate people about wellness and promote healthy lifestyles [3032]. Because of the increasing popularity of QS, a self-administered questionnaire evaluating vitamin D status could thus be an interesting solution to identify vitamin D deficiency and insufficiency, to trigger a reasoned strategy of supplementation, and to improve older adults' health.

Besides the originality of the research question on an important issue in clinical routine, the strengths of our study include the standardized collection of data from a single research centre and the testing of older participants of both genders. Additionally, agreements between self-VDSP and rater-VDSP were evaluated using the different consensus definitions of severe vitamin D deficiency, deficiency and insufficiency described in previous literature and used in clinical practice. Regardless, a number of limitations should be acknowledged. First, the study cohort was restricted to in- and outpatients who were probably in poorer health and with more frequent hypovitaminosis D than the population of all seniors. Second, our sample size was relatively small and could not be calculated a priori. Third, patients were allowed to get help from their relatives to complete the VDSP, if needed. This aid was authorized as part of the study to be representative of the "real life" where patients have the opportunity to seek for help around them. Fourth, the VDSP was designed to identify older adults with undesirable vitamin D status as defined by low circulating 25(OH)D concentration according to the consensus definition of hypovitaminosis D [1]. Thus, it did not account for other recently discovered D3-hydroxyderivatives such as 20-hydroxyvitamin D3, which biological role remains unclear [33]. Finally, although we were able to control for important characteristics that could modify the agreements, other covariables such as the socio-economic conditions or the education level might have influenced the participants' answers to the self-administered questionnaire [34].

In conclusion, our study shows that older adults are able to evaluate their own probability of having severe vitamin D deficiency, deficiency or insufficiency, which should save time for caregivers and promote the use of the VDSP tool. Further research is needed to corroborate this finding by correlating the VDSP tool with serum 25(OH)D levels in people of various ages and health conditions. If confirmed this tool opens new perspective in the approach of evaluating vitamin D deficiency and insufficiency in older adults, and could be useful in daily clinical practice. A VDSP completed by the older adults themselves could provide valuable information to the caregivers, help to identify those with undesirable vitamin D status, and ultimately guide the supplementation plan.

Acknowledgments

We are grateful to the participants for their cooperation.

The authors thank Axel Alessandri, BS, and David Gicquel, BS, from the School of Medicine, University of Angers, UNAM, Angers, France, for their help in collecting participants’ data.

Patient level data are freely available from the corresponding author at CeAnnweiler@chu-angers.fr. There is no personal identification risk within this anonymized raw data, which is available after notification and authorization of the competent authorities. Data requests may be sent to the following address: Centre Hospitalier Universitaire, Délégation à la recherche clinique et à l'innovation (DRCI), 4 rue Larrey, F-49933 Angers cedex 9 France.

References

  1. 1. Hossein-nezhad A, Holick MF. Vitamin D for health: a global perspective. Mayo Clin Proc. 2013;88: 720–755. pmid:23790560
  2. 2. Muscogiuri G, Altieri B, Annweiler C, Balercia G, Pal HB, Boucher BJ, et al. Vitamin D and chronic diseases: the current state of the art. Arch Toxicol. 2017;91: 97–107. pmid:27425218
  3. 3. Heaney RP. Guidelines for optimizing design and analysis of clinical studies of nutrient effects. Nutr Rev. 2014;72: 48–54.
  4. 4. French National Authority for Health. Clinical utility of the measurement of vitamin D. Saint-Denis: Haute Autorité de Santé (HAS); 2013. Available from: http://www.has-sante.fr/portail/jcms/c_1356838/fr/utilite-clinique-du-dosage-de-la-vitamine-d-rapport-d-evaluation
  5. 5. US Preventive Services Task Force. Screening for vitamin D deficiency: draft recommendation statement. AHRQ publication no 13-05183-EF-2. Available from: www.uspreventiveservicestaskforce.org/draftrec.htm Accessed December 15, 2016.
  6. 6. Institute of Medicine (US) Committee to Review Dietary Reference Intakes for Vitamin D and Calcium; Ross AC, Taylor CL, et al. Dietary Reference Intakes for Calcium and Vitamin D. Washington, DC: National Academies Press, Institute of Medicine; 2011.
  7. 7. Holick MF, Binkley NC, Bischoff-Ferrari HA, Gordon CM, Hanley DA, Heaney RP, et al. Evaluation, treatment and prevention of vitamin D deficiency: an Endocrine Society clinical practice guideline. J Clin Endocrinol Metab. 2011;96: 1911–1930. pmid:21646368
  8. 8. Pietras SM, Obayan BK, Cai MH, Holick MF. Vitamin D2 treatment for vitamin D deficiency and insufficiency for up to 6 years. Arch Intern Med. 2009;169: 1806–1808. pmid:19858440
  9. 9. Bischoff-Ferrari HA, Dawson-Hughes B, Orav EJ, Staehelin HB, Meyer OW, Theiler R, et al. Monthly High-Dose Vitamin D Treatment for the Prevention of Functional Decline: A Randomized Clinical Trial. JAMA Intern Med. 2016;176: 175–183. pmid:26747333
  10. 10. Annweiler C, Duval G, Launay CP. Estimating vitamin D status and the choice of supplementation dose. JAMA Intern Med. 2016;176: 865.
  11. 11. Lee RH, Weber T, Colón-Emeric C. Comparison of cost-effectiveness of vitamin D screening with that of universal supplementation in preventing falls in community-dwelling older adults. J Am Geriatr Soc. 2013;61: 707–714. pmid:23631393
  12. 12. Carter GD, Carter CR, Gunter E, Jones J, Jones G, Makin HL, et al. Measurement of vitamin D metabolites: an international perspective on methodology and clinical interpretation. J Steroid Biochem Mol Biol. 2004;89–90: 467–471. pmid:15225822
  13. 13. Annweiler C, Kabeshova A, Legeay M, Fantino B, Beauchet O. Derivation and validation of a clinical diagnostic tool for the identification of older community-dwellers with hypovitaminosis D. J Am Med Dir Assoc. 2015;16: 536.e8-19
  14. 14. Annweiler C, Riou J, Alessandri A, Gicquel D, Henni S, Féart C, Kabeshova A. Clinical Identification of Geriatric Patients with Hypovitaminosis D: The ‘Vitamin D Status Predictor for Geriatrics’ Study. Nutrients. 2017;9(7).
  15. 15. Haute Autorité de Santé. Stratégie de prise en charge en cas de dénutrition protéinoénergétique chez la personne âgée; 2007. Available from: http://www.hassante.fr/portail/jcms/c_546549/strategie-de-prise-en-charge-en-cas-de-denutritionproteino-energetique-chez-la-personne-agee
  16. 16. Beauchet O, Dubost V, Revel Delhom C, Berrut G, Belmin J; French Society of Geriatrics and Gerontology. How to manage recurrent falls in clinical practice: guidelines of the French Society of Geriatrics and Gerontology. J Nutr Health Aging. 2011;15: 79–84. pmid:21267524
  17. 17. Ayoubi F, Launay CP, Annweiler C, Beauchet O. Fear of falling and gait variability in older adults: a systematic review and meta-analysis. J Am Med Dir Assoc. 2015;16:14–19. pmid:25230892
  18. 18. Folstein MF, Folstein SE, McHugh PR. "Mini-mental state". A practical method for grading the cognitive state of patients for the clinician. J Psychiatr Res. 1975;12: 189–198. pmid:1202204
  19. 19. Shah A, Herbert R, Lewis S, Mahendran R, Platt J, Bhattacharyya B. Screening for depression among acutely ill geriatric inpatients with a short Geriatric Depression Scale. Age Ageing. 1997;26: 217–221. pmid:9223718
  20. 20. Koch GG, Gary G. Intraclass correlation coefficient. In: Kotz S, Johnson NL, editors. Encyclopedia of Statistical Sciences 4. New York: John Wiley & Sons; 1982. pp. 213–217.
  21. 21. Cohen J. Weighted kappa: nominal scale agreement with provision for scaled disagreement or partial credit. Psychol Bull. 1968;70: 213–220. pmid:19673146
  22. 22. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33: 159–174. pmid:843571
  23. 23. Dorz S, Borgherini G, Conforti D, Scarso C, Magni G. Comparison of self-rated and clinician-rated measures of depressive symptoms: a naturalistic study. Psychol Psychother. 2004;77: 353–361. pmid:15355586
  24. 24. Schmand B, Jonker C, Geerlings MI, Lindeboom J. Subjective memory complaints in the elderly: depressive symptoms and future dementia. Br J Psychiatry. 1997;171: 373–376. pmid:9373429
  25. 25. Ramboer C, Verhamme M, Vermeire L. Patients' perception of involuntary weight loss: implications of underestimation and overestimation. Br Med J (Clin Res Ed). 1985;291: 1091.
  26. 26. Mogre V, Abedandi R, Salifu ZS. Distorted self-perceived weight status and underestimation of weight status in diabetes mellitus type 2 patients. PLoS One. 2014;9:e95165. pmid:24736567
  27. 27. Everett B, Salamonson Y, Rolley JX, Davidson PM. Underestimation of risk perception in patients at risk of heart disease. Eur J Cardiovasc Nurs. 2016;15: e2–9. pmid:25336396
  28. 28. Bischoff-Ferrari HA, Dawson-Hughes B, Staehelin HB, Orav JE, Stuck AE, Theiler R, et al. Fall prevention with supplemental and active forms of vitamin D: a meta-analysis of randomised controlled trials. BMJ. 2009;339: b3692. pmid:19797342
  29. 29. den Braber M. Quantified Self: insight in yourself through self-monitoring. Ned Tijdschr Geneeskd. 2013;157: A7028. pmid:24345365
  30. 30. World Health Organization. Health interview surveys: Towards international harmonization of methods and instruments. WHO Regional Publications—European Series No 58; 1996.
  31. 31. Andrews G, Kemp A, Sunderland M, Von Korff M, Ustun TB. Normative data for the 12 item WHO Disability Assessment Schedule 2.0. PLoS One. 2009;4: e8343. pmid:20020047
  32. 32. Ustün TB, Chatterji S, Kostanjsek N, Rehm J, Kennedy C, Epping-Jordan J, et al. Developing the World Health Organization Disability Assessment Schedule 2.0. Bull World Health Organ. 2010;88: 815–823. pmid:21076562
  33. 33. Slominski AT, Kim TK, Shehabi HZ, Semak I, Tang EK, Nguyen MN, Benson HA, Korik E, Janjetovic Z, Chen J, Yates CR, Postlethwaite A, Li W, Tuckey RC. In vivo evidence for a novel pathway of vitamin D₃ metabolism initiated by P450scc and modified by CYP27B1. FASEB J. 2012;26: 3901–3915. pmid:22683847
  34. 34. Beauchet O, Launay CP, Merjagnan C, Kabeshova A, Annweiler C. Quantified self and comprehensive geriatric assessment: older adults are able to evaluate their own health and functional status. PLoS One. 2014;9: e100636. pmid:24968016