A comparison of the 33-item Hypomania Checklist with the 33-item Hypomania Checklist-external assessment for the detection of bipolar disorder in adolescents
International Journal of Bipolar Disorders volume 9, Article number: 41 (2021)
Adolescents with bipolar disorder (BD) are often misdiagnosed as having major depressive disorder (MDD), which delays appropriate treatment and leads to adverse outcomes. The aim of this study was to compare the performance of the 33-item Hypomania Checklist (HCL-33) with the 33-item Hypomania Checklist- external assessment (HCL-33-EA) in adolescents with BD or MDD.
147 adolescents with BD and 113 adolescents with MDD were consecutively recruited. The HCL-33 and HCL-33-EA were completed by patients and their carers, respectively. The sensitivity, positive predictive value (PPV), specificity, negative predictive value (NPV), and area under the curve (AUC) were calculated and compared between the two instruments, using cut-off values based on the Youden’s index.
The total scores of the HCL-33 and HCL-33-EA were positively and significantly correlated (rs = 0.309, P < 0.001). Compared to the HCL-33, the HCL-33-EA had higher sensitivity and NPV (HCL-33: sensitivity = 0.58, NPV = 0.53; HCL-33-EA: sensitivity = 0.81, NPV = 0.60), while the HCL-33 had higher specificity and PPV (HCL-33: specificity = 0.61, PPV = 0.66; HCL-33-EA: specificity = 0.37, PPV = 0.63).
Both the HCL-33 and HCL-33-EA seem to be useful for screening depressed adolescents for BD. The HCL-33-EA would be more appropriate for distinguishing BD from MDD in adolescents due to its high sensitivity in Chinese clinical settings.
Bipolar Disorder (BD) is a chronic mood disorder characterized by depressive and manic or hypomanic episodes (Phillips and Kupfer 2013). Compared to manic episodes, bipolar depressive episodes usually have higher rates of morbidity and mortality (McIntyre and Calabrese 2019). A major challenge in clinical practice is to diagnose BD accurately, as it is difficult to differentiate from other psychiatric disorders, in particular major depressive disorder (MDD). The difficulty arises because the first episode of mood disturbance in BD is frequently depression (McIntyre and Calabrese 2019). In addition, patients are more likely to seek medical treatment for their depressive symptoms than when they are experiencing manic and/hypomanic symptoms (Cuomo et al. 2020; Zimmerman and Galione 2011). The misdiagnosis of BD as MDD may have serious clinical consequences (Patella et al. 2019; Hwang et al. 2010) due to the delay of appropriate treatment and the inappropriate prescription of antidepressants that increase the risk of chronicity and recurrence of BD (McIntyre and Calabrese 2019; Fagiolini et al. 2013).
To improve accuracy in diagnosing BD, standardized and structured or semi-structured diagnostic interviews have been developed, such as the Mini-International Neuropsychiatric Interview (MINI) (Lecrubier et al. 1997), and the Structured Clinical Interview for DSM-5 (SCID-5) (First et al. 2015). These interviews are comprehensive, but time-consuming and their administration is labor-intensive and expensive in clinical or research settings (Nejati et al. 2020). Although comprehensive clinical assessment is essential and irreplaceable, tailor-made screening tools (Hong et al. 2014, Bae et al. 2014) can assist in detecting BD and minimize the risk of misdiagnosis. A study conducted in advanced practice registered nurses reported that screening depressed patients using validated screening tools (e.g., the Mood Disorder Questionnaire (MDQ)) in primary care may reduce the time-lag to the diagnosis and treatment of BD (Kriebel-Gasparro 2016).
The 32-item Hypomania Checklists (HCL-32) is a widely used self-report screening tool for assessing bipolarity in mood disorders. The 33-item Hypomania Checklist (HCL-33) is a modified version of the HCL-32. The Chinese version of the HCL-33 has been validated in both adult (Feng et al. 2016) and adolescent (Zhang et al. 2021) samples to screen for BD in depressed patients. An HCL-33-external assessment version (HCL-33-EA) has been recently developed to rate patients’ symptoms by their carers (e.g., family members, friends, etc.) (Łojko et al. 2016). Given that individuals in a manic or hypomanic state are often unaware of changes in their mood and behavior, carers are privileged observers who can provide valuable additional information to the clinician. The Chinese version of the HCL-33-EA has also been validated in adults (Fang et al. 2019).
To the best of our knowledge, no study has directly compared the properties of the HCL-33 and HCL-33-EA in adolescents. Thus, the aim of this study was to compare the sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), and area under the curve (AUC) of the HCL-33 and the HCL-33-EA in Chinese adolescents.
Study sample and sites
This study was conducted between August 2020 and November 2020 in the Department of Child Psychiatry at Beijing Anding Hospital of Capital Medical University, a major tertiary psychiatric hospital in China. Participants who met the following inclusion criteria were consecutively recruited during the study period: (1) aged between 13 and 17 years; (2) diagnosed with BD or MDD according to the International Classification of Diseases, Tenth Revision (ICD-10) (WHO 1992) based on a diagnostic interview by two senior psychiatrists; (3) had a current depressive episode defined as a total score of 7 or higher on the 17-item Hamilton Depression Rating Scale (HAMD) (Hamilton 1960; Xie and Shen 1984); (4) were able to understand the aim and contents of the assessment and to provide verbal informed consent, whilst their legal guardians gave written informed consent. Adolescents with cognitive impairment were excluded. The study protocol was approved by the Ethics Committee of the Beijing Anding Hospital, China.
Instruments and evaluation
Patients’ and their carers’ demographic information was collected by two research psychiatrists in face-to-face interviews and was supplemented by a review of the electronic medical records. The HCL-33—Chinese version (Feng et al. 2016) was used to assess the patients' hypomanic symptoms. The Chinese version of the HCL-33 has been validated with good psychometric properties in both Chinese adults (Fang et al. 2019) and adolescents (Zhang et al. 2021). Patients’ carers completed the HCL-33-EA-Chinese version. Each item of the two scales has the dichotomous response format (yes/no). The total scores of the two HCL scales are calculated by adding up items with a “yes” response.
All analyses were performed with the Statistical Package for Social Sciences (SPSS), Version 24.0. Patients’ and carers’ sociodemographic and clinical characteristics were compared between the BD and MDD groups; categorical variables were compared using chi-square tests, while normally distributed continuous variables were compared with two independent sample t tests; otherwise, Mann–Whitney U tests and Wilcoxon tests were used. Normality was examined with the one-sample Kolmogorov–Smirnov test. In order to explore the threshold for discriminating BD from MDD, receiver-operator curves (ROC) were generated and cut-off values were selected based on the Youden’s index from the respective curve (Youden 1950). The criterion validity of the HCL-33 and HCL-33-EA was estimated by sensitivity, specificity, PPV, NPV, and AUC. The association between the HCL-33 and the HCL-33-EA assessments was examined with Spearman correlation analysis. The level of statistical significance was set as P < 0.05 (two-tailed).
Of the 274 potential participants consecutively screened for the study, 260 met the inclusion criteria and completed the assessment;113 with MDD and 147 with BD. Table 1 presents the patients’ sociodemographic and clinical information; their mean age was 15.42 (standard deviation (SD) = 1.62) years; 22.69% were male. There was no significant difference of the demographic and clinical features between the MDD and BD groups. The vast majority of carers (93.85%) were married, 22.31% were male, and 12.69% were unemployed; their mean age was 43.10 (SD = 5.28) years, and their mean years in education was 13.17 (SD = 3.02) years (Table 2).
The mean scores of the HCL-33 and the HCL-33-EA were 13.38 (SD = 6.06) and 10.37 (SD = 5.52), respectively. The HCL-33 total score was significantly higher than that of the HCL-33-EA (Wilcoxon test; Z = − 6.478, P < 0.001) and the two scales’ scores were significantly and positively correlated (Spearman correlation coefficient: rs = 0.309, P < 0.001). The frequency of the items’ positive responses is shown in Table 3. Table 4 compares the sensitivity, specificity, PPV, NPV, and AUC between the HCL-33 and the HCL-33-EA in differentiating BD from MDD using cut-off values calculated according to Youden’ s index. The HCL-33 had a higher specificity and PPV, while the HCL-33-EA had a higher sensitivity and NPV (Table 3 and Fig. 1).
An insufficient recognition of hypomanic symptoms by clinicians and by patients’ families leads to a failure to diagnose BD and subsequently to delayed or inappropriate treatment (Fagiolini et al. 2013). Although structured diagnostic interviews and screening instruments are available for identifying hypomania, to our knowledge, the HCL-33-EA is the only tool allowing patients’ carers to rate patients (Fang et al. 2019). The HCL-33-EA is user-friendly because it takes no more than fifteen minutes to administer and through the carers’ informed insight into the patient’s mood and behavior it can facilitate the early identification of hypomanic symptoms (Fang et al. 2019).
To the best of our knowledge, this was the first study that compared the psychometric properties of the self- and external assessment versions of the HCL-33 in adolescents. A significant and positive association between the total scores of the HCL-33 and the HCL-33-EA was found, similar to findings of the comparison between the HCL-33 and the HCL-33-EA in adult patients (Fang et al. 2019). More specifically, the mean score of the HCL-33-EA in this adolescent sample (10.37) was close to what was found in adults (11.0) (Feng et al. 2016). The total score of the HCL-33-EA was significantly lower than that of the HCL-33 in this study, which is also consistent with previous findings (Fang et al. 2019). In addition, compared to the HCL-33 self-assessment, external assessment with the HCL-33-EA had a higher sensitivity and negative predictive value, and a lower specificity and positive predictive value. This finding was consistent with that of a study comparing the HCL-33 and HCL-33-EA in an adult sample (Wang et al. 2021). Whilst the satisfactory sensitivity indicates that the HCL-33-EA may be an effective tool for differentiating BD from MDD, the lower specificity of HCL-33-EA may be the result of false positives. The discrepancy between the psychometric properties of the HCL-33 and HCL-33-EA in this study may be attributed to their different cut-off values. In a validation study in Russian adults (Mosolov et al. 2021), the HCL-33 cut-off value was 16, which is higher than the corresponding figure in this study. This discrepancy may be due to different target populations, i.e., adolescents vs. adults. A previous validation study on the HCL-33 in Chinese adolescents (Zhang et al. 2021) proposed a cut-off value of 18, which is higher than the cut-off value of 14 in this study. The discrepancy between the two studies is possibly due to different clinical characteristics of the participants. Similarly, the psychometric properties of the HCL-33-EA were less robust (specificity = 0.37), indicating that the HCL-33-EA needs further refinement for adolescent patients.
There were several limitations that need to be addressed. First, the study was conducted in a single center, which limits the generalizability of the findings. Second, due to the relatively small sample size, the two scales’ psychometric properties could not be compared separately by basic demographic variables, such as gender and age. Third, the ICD-10 is the official classification manual in clinical practice in China, therefore, we cannot identify bipolar subtypes I and II and compare psychometric properties between the HCL-33 and HCL-33-EA in distinguishing different BD subtypes from MDD. Fourth, information on psychiatric comorbidities is lacking in the electronic medical record system, preventing exploration of potentially confounding effects on the psychometric properties of the two instruments. Fifth, the adolescents included in this study were very young, therefore some of them diagnosed with MDD may be diagnosed with BD in the future, which may bias the findings of this study to an uncertain extent. Finally, although the consecutive sampling method was adopted, the proportion of girls was higher than expected, which may influence the findings of the study. However, the higher proportion of girls reflects the actual distribution of genders in clinical practice.
In adolescents the sensitivity and negative predictive values of the HCL-33-EA were higher, while the specificity and positive predictive value were lower than the corresponding values in the HCL-33. In view of its high sensitivity, the HCL-33-EA would be more appropriate for screening for BD in depressed adolescents in Chinese clinical settings.
Availability of data and materials
The datasets generated and analyzed in the current study are not publicly accessible due to privacy and ethical restrictions.
Area under the curve
Hamilton Depression Rating Scale
33-Item Hypomania Checklist
33-Item Hypomania Checklist- external assessment
International Classification of Diseases, Tenth Revision
Major depressive disorder
Mood Disorder Questionnaire
Mini-International Neuropsychiatric Interview
Negative predictive value
Positive predictive value
Structured Clinical Interview for DSM-5
Bae SO, Kim MD, Lee JG, Seo J-S, Won S-H, Woo YS, et al. Is it useful to use the Korean version of the mood disorder questionnaire for assessing bipolar spectrum disorder among Korean college students? Asia Pac Psychiatry. 2014;6(2):170–8.
Cuomo A, Aguglia A, Aguglia E, Bolognesi S, Goracci A, Maina G, et al. Mood spectrum symptoms during a major depressive episode: differences between 145 patients with bipolar disorder and 155 patients with major depressive disorder. Arguments for a dimensional approach. Bipolar Disords. 2020;22(4):385–91.
Fagiolini A, Forgione R, Maccari M, Cuomo A, Morana B, Dell’Osso MC, et al. Prevalence, chronicity, burden and borders of bipolar disorder. J Affect Disord. 2013;148(2):161–9.
Fang M, Wang YY, Feng Y, Ungvari GS, Ng CH, Wang G, et al. Exploration of the psychometric properties of the 33-item Hypomania Checklist - external assessment (HCL-33-EA). J Affect Disord. 2019;245:987–90.
Feng Y, Xiang YT, Huang W, Wang G, Feng L, Tian TF, et al. The 33-item Hypomania Checklist (HCL-33): a new self-completed screening instrument for bipolar disorder. J Affect Disord. 2016;190:214–20.
First M, Williams J, Karg R, Spitzer R. Structured clinical interview for DSM-5—research version (SCID-5 for DSM-5, research version; SCID-5-RV). Arlington: American Psychiatric Association; 2015. p. 1–94.
Hamilton M. A rating scale for depression. J Neurol Neurosurg Psychiatry. 1960;23:56–62.
Hong N, Bahk W-M, Yoon B-H, Shin YC, Min KJ, Jon D-I. Characteristics of bipolar symptoms in psychiatric patients: pattern of responses to the Korean version of the Mood Disorder Questionnaire. Asia Pac Psychiatry. 2014;6(2):120–6.
Hwang SHJ, Childers ME, Wang PW, Nam JY, Keller KL, Hill SJ, et al. Higher prevalence of bipolar I disorder among Asian and Latino compared to Caucasian patients receiving treatment. Asia Pac Psychiatry. 2010;2(3):156–65.
Kriebel-Gasparro AM. Advanced practice registered nurses: gateway to screening for bipolar disorder in primary care. Open Nurs J. 2016;10:59–72.
Lecrubier Y, Sheehan DV, Weiller E, Amorim P, Bonora I, Sheehan KH, et al. The Mini International Neuropsychiatric Interview (MINI) A short diagnostic structured interview reliability and validity according to the CIDI. Eur Psychiatry. 1997;12(5):224–31.
Łojko D, Dudek D, Angst J, Siwek M, Michalak M, Rybakowski J. The 33-item Hypomania Checklist (HCL-33)—a study of the consistency between self- and external assessments in Polish bipolar patients. Psychiatr Pol. 2016;50(6):1085–92.
McIntyre RS, Calabrese JR. Bipolar depression: the clinical characteristics and unmet needs of a complex disorder. Curr Med Res Opin. 2019;35(11):1993–2005.
Mosolov SN, Yaltonskaya PA, Senko OV, Angst J. Validation of the Russian version of the hypomania checklist (HCL-33) for the detection of bipolar disorder in patients with a current diagnosis of recurrent depression. J Affect Disord Rep. 2021;4: 100086.
Nejati S, Ariai N, Björkelund C, Skoglund I, Petersson E-L, Augustsson P, et al. Correspondence between the neuropsychiatric interview M.I.N.I. and the BDI-II and MADRS-S self-rating instruments as diagnostic tools in primary care patients with depression. Int J Gen Med. 2020;13:177–83.
Patella AM, Jansen K, Cardoso TA, Souza LDM, Silva RAD, Coelho F. Clinical features of differential diagnosis between unipolar and bipolar depression in a drug-free sample of young adults. J Affect Disord. 2019;243:103–7.
Phillips ML, Kupfer DJ. Bipolar disorder diagnosis: challenges and future directions. Lancet. 2013;381(9878):1663–71.
Wang Y-Y, Feng Y, Fang M, Guo C, Ungvari GS, Hall BJ, et al. Comparing screening abilities of the 33-item hypomania checklist (HCL-33) and the 33-item hypomania checklist external assessment (HCL-33-EA) for the detection of bipolar disorder. Front Psychiatry. 2021. https://doi.org/10.3389/fpsyt.2021.518722.
World Health Organization. The ICD-10 classification of mental and behavioural disorders: clinical descriptions and diagnostic guidelines. Geneva: World Health Organization; 1992.
Xie G, Shen Q. Use of the Chinese version of the Hamilton rating scale for depression in general population and patients with major depression. Chin J Nerv Ment Dis. 1984;10:346.
Youden WJ. Index for rating diagnostic tests. Cancer. 1950;3(1):32–5.
Zhang Y, Li W, Zhang WY, He F, Pan HP, Cheung T, et al. Validation of the 33-item Hypomania Checklist (HCL-33) in screening adolescents with bipolar disorder. J Affect Disord. 2021;281:786–91.
Zimmerman M, Galione JN. Screening for bipolar disorder with the mood disorders questionnaire: a review. Harv Rev Psychiatry. 2011;19(5):219–28.
The study was supported by the National Science and Technology Major Project for Investigational New Drugs (2018ZX09201-014), the Beijing Municipal Science & Technology Commission (No. Z181100001518005), and the University of Macau (MYRG2019-00066-FHS).
Ethics approval and consent to participate
The study protocol was approved by the Ethics Committee at Beijing Anding Hospital, China (2020- Keyan (No. 10)). All participants provided verbal informed consent, whilst their legal guardians gave written informed consent.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Chen, X., Bai, W., Zhao, N. et al. A comparison of the 33-item Hypomania Checklist with the 33-item Hypomania Checklist-external assessment for the detection of bipolar disorder in adolescents. Int J Bipolar Disord 9, 41 (2021). https://doi.org/10.1186/s40345-021-00246-0
- Bipolar disorder
- External assessment