Skip to main content

Patient-evaluated cognitive function measured with smartphones and the association with objective cognitive function, perceived stress, quality of life and function capacity in patients with bipolar disorder

Abstract

Background

Cognitive impairments in patients with bipolar disorder (BD) have been associated with reduced functioning. Aims: To investigate the association between (1) patient-evaluated cognitive function measured daily using smartphones and stress, quality of life and functioning, respectively, and (2) patient-evaluated cognitive function and objectively measured cognitive function with neuropsychological tests.

Methods

Data from two randomized controlled trials were combined. Patients with BD (N = 117) and healthy controls (HC) (N = 40) evaluated their cognitive function daily for six to nine months using a smartphone. Patients completed the objective cognition screening tool, the Screen for Cognitive Impairment in Psychiatry and were rated with the Functional Assessment Short Test. Raters were blinded to smartphone data. Participants completed the Perceived Stress Scale and the WHO Quality of Life questionnaires. Data was collected at multiple time points per participant. p-values below 0.0023 were considered statistically significant.

Results

Patient-evaluated cognitive function was statistically significant associated with perceived stress, quality of life and functioning, respectively (all p-values < 0.0001). There was no association between patient-evaluated cognitive function and objectively measured cognitive function (B:0.0009, 95% CI 0.0017; 0.016, p = 0.015). Patients exhibited cognitive impairments in subjectively evaluated cognitive function in comparison with HC despite being in full or partly remission (B: − 0.36, 95% CI − 0.039; − 0.032, p < 0.0001).

Conclusion

The present association between patient-evaluated cognitive function on smartphones and perceived stress, quality of life and functional capacity suggests that smartphones can provide a valid tool to assess disability in remitted BD. Smartphone-based ratings of cognition could not provide insights into objective cognitive function.

Background

Bipolar disorder (BD) is estimated as one of the most important causes of disability worldwide (Pini et al. 2005; Vos et al. 2012). BD is characterized by recurrent episodes of depression, (hypo)mania and mixed episodes intervened by periods of euthymia (Goodwin and Jamison 1996) and with a high degree of comorbidity and functional impairment (Sanchez-Moreno et al. 2009). In addition to the affective symptoms, patient with BD often experience cognitive deficits (Martinez-Aran et al. 2000, 2004) even during periods of remission (Kessing 1998; Torres et al. 2007; Bourne et al. 2013; Jensen et al. 2016). Cognitive dysfunction in patients with BD is associated with prolonged illness duration, reduced chances of recovery independently of affective symptoms (Etkin et al. 2013), and impaired quality of life and social functioning (Jensen et al. 2016; Dion et al. 1988; Dickerson et al. 2001; Mackala et al. 2014). Recent studies have indicated that cognitive deficits in patients with BD are among the strongest predictors of functional impairments (Martínez-Arán et al. 2004; Baune and Malhi 2015). Thus, correct identification and treatment of cognitive dysfunction is of major clinical importance.

The relationship between objectively assessed cognitive function with neuropsychological tests and patient-evaluated cognitive function is debatable with studies presenting disparity in findings. The majority of studies have found an absence of a relationship between these measures (Demant et al. 2015; Martinez-Aran et al. 2005; Svendsen et al. 2012; van der Werf-Eldering et al. 2011; Burdick et al. 2005), while one has found a significant association (Arts et al. 2011). Overall, it therefore seems that patients with the most subjective cognitive complaints may not always display the greatest objective cognitive impairments and vice versa. This is major challenge in the clinical assessment of cognitive functions in patients with BD (Miskowiak et al. 2018). New tools to get insights into patients’ cognitive function in daily life and how it relates to quality of life and functional capacity would thus improve identification of cognitive impairments in the clinic and inform clinicians about their clinical importance (Miskowiak et al. 2018).

Ecological momentary assessments (EMA) reflect the methods used to collect assessments of individuals’ real-time states repeatedly over time during naturalistic settings, and may reduce recall bias (Shiffman et al. 2008). Today a median of 76% of adults across 18 advanced economies reported having a smartphone (Taylor and Silver 2019), and many people use a smartphone on a daily basis (Ericsson Mobility Report November. 2018). The rapid evolution and ubiquity of mobile networks have resulted in increasing growth of e-mental health technologies, including electronic platforms offering tolls for remote self-monitoring (Lal and Adair 2014). By using daily smartphone-based self-monitoring potential recall bias in self-reported patient data is minimized. Thus, smartphones extends the use of EMA beyond its classical use for self-reports and offer the opportunity to collect fine-grained data unobtrusively and outside the clinical settings (Ebner-Priemer and Trull 2009).

However, no prior study has collected data on patient-evaluated daily smartphone-based measures of cognitive function. The present study therefore explores how patients’ smartphone-based evaluations of cognitive function related to perceived stress, quality of life, and functional capacity as well as its association with objectively measured cognitive function on neuropsychological tests. Data in the present study were collected during two randomized controlled trials (RCT) investigating the effect of daily smartphone-based self-monitoring in patients with BD (Faurholt-Jepsen et al. 2014, 2019).

Aims and hypotheses

The present study aimed to (1) investigate the associations between daily patient-evaluated cognitive function measured using smartphones and perceived stress, quality of life and functioning, respectively, in patients with BD, (2) examine the association between patient-evaluated daily cognitive function measured using smartphones and objectively-measured cognitive function in patients with BD, and (3) examine whether group status (patient versus healthy control individuals (HC)) interacted with the associations between perceived stress, quality of life and functioning. The analyses were based on patient-reported data on cognitive function measured daily using smartphones and objectively-measured cognitive function, clinically rated depressive and manic symptoms and functioning as well as patient-based questionnaires concerning perceived stress and quality of life collected at multiple time points for each patient during follow-up.

Based on prior evidence we hypothesized that (1) impaired daily patient-evaluated cognitive function would be associated with increased perceived stress, and with decreased quality of life and functional capacity in patients with BD, (2) there would be no association between patient-evaluated daily cognitive function measured using smartphones and objectively-measured cognitive function, and (3) patients would report poorer cognitive function compared with HC, and the associations between daily evaluated cognitive function and perceived stress, quality of life and functioning, respectively, in patients with BD and HC would be different.

Methods

Participants, settings and design

The present study combines data collected as part of two randomized controlled trials (RCTs) investigating the effect of smartphone-based monitoring in patients with BD (the MONARCA I trial and the MONARCA II trial) (Faurholt-Jepsen et al. 2014, 2019). In addition, a group of HC collecting smartphone-based data on cognitive function was included for comparison (Kessing et al. 2017). Thus, data was collected as part of studies published in study protocols á priori.

Patients with bipolar disorder

The MONARCA I trial: The patients were recruited from The Copenhagen Clinic for Affective Disorders, Copenhagen, Denmark during a period from September 2011 to March 2013. The clinic is a specialized outpatient clinic with a catchment area consisting of the Capital Region in Denmark corresponding to 1.4 million people. Patients with a newly diagnosis of BD or with treatment-resistant BD were referred to the clinic. The staff consists of specialists in psychiatry, psychologists, nurses, and a social worker, all with specific experience and knowledge regarding BD. Treatment at the clinic comprises a 2 years program including combined evidence-based psychopharmacological treatment and supporting therapy, including group psychoeducation (Kessing et al. 2013). The trial had a six-month follow-up period. Inclusion criteria: BD diagnosis according to ICD-10 using the Schedules for Clinical Assessment in Neuropsychiatry (SCAN) interview (Wing et al. 1990), age between 18 and 60 years, a Hamilton Depression Rating Scale 17-item (HDRS-17) score ≤ 17 (Hamilton 1967) and Young Mania Rating Scale (YMRS) score ≤ 17 (Young et al. 1978) at the time of inclusion. Exclusion criteria: Pregnancy, a lack of Danish language skills, inability to learn the technicalities for using a smartphone, unwilling to use the trial smartphone as the primary cell phone, and severely physical illness or schizophrenia, schizotypal or delusional disorders according to the SCAN interview.

The MONARCA II trial: All patients with a diagnosis of BD who had previously been treated at the Copenhagen Clinic for Affective Disorder, Copenhagen, Denmark (as described above) in the period from 2004 to January 2016 and who at the time of recruitment were being treated at community psychiatric centres, private psychiatrists and general practitioners were invited to participate in the trial. Patients were included in the study for a nine-month follow-up period if they had a BD diagnosis according to ICD-10 using the Schedules for Clinical Assessments in Neuropsychiatry (SCAN) (Wing et al. 1990) and previously were treated at the Copenhagen Clinic for Affective Disorder. Patients with schizophrenia, schizotypal or delusional disorders, previous use of the MONARCA system, pregnancy and lack of Danish language skills were excluded. Patients with other comorbid psychiatric disorders and substance use were eligible for the trial.

As part of the MONARCA I trial and the MONARCA II trial, patients were randomized to either using a smartphone-based monitoring system (the Monsenso system) for daily self-monitoring (the intervention group) or to treatment as usual (the control group). Patients included in the intervention group from both trials collected daily smartphone-based self-monitoring data on cognitive function and were included in the analyses in the present report. Inclusion and exclusion criteria were investigated and assessed by two clinical researchers (MFJ and ASJ).

Healthy control individuals

In the present study, a group of HC was included in the analyses to investigate differences in the association between cognitive functioning and stress, quality of life and functioning, respectively with those in the patient population. The HC were part of a larger cohort study (Kessing et al. 2017) and recruited consecutively from the Blood Bank at Rigshospitalet, Copenhagen University Hospital, Denmark, by approaching blood donors in the waiting room on random occasions from September 2015 to August 2016. The inclusion criteria were: age over 18 years, no history of psychiatric illness and no first-generation family history of psychiatric illness. The exclusion criteria were: lack of Danish language skills and pregnancy. The healthy individuals participated as part of a larger cohort study (Kessing et al. 2017).

Daily smartphone-based monitoring

On a daily basis during the follow-up, participants in the trials used a smartphone with the Monsenso app installed and were instructed to use the system for evaluation (Faurholt-Jepsen et al. 2014). The app allowed for daily evaluation of cognitive function (evaluated from not present, present to some degree or present (scale: 0, + 1, + 2)). Further details regarding the Monsenso system are described elsewhere (Faurholt-Jepsen et al. 2014).

Clinical measurements

In the MONARCA I trial outcome measurements were conducted monthly for the entire trial period of 6 months. In the MONARCA II trial outcome measurements were conducted at baseline, after 4 weeks, 3 months, 6 months and 9 months. The HC used the smartphone-based system on a daily basis for 4 months and outcome measurements were conducted at baseline and after 4 months.

All clinical assessments were conducted by researchers (MFJ and HÞ), who were blinded to all smartphone-based data. Thus, data on severity of depressive and manic symptoms as well as functioning were collected rater-blinded.

Clinical rater-blinded assessments: The severity of depressive and manic symptoms were clinically assessed using the HDRS (Hamilton 1967) and the YMRS (Young et al. 1978). Functioning were clinically rated using the Psychosocial Assessment Short Test (FAST), which is an 24-item interviewer-administrated interview concerning autonomy, occupational functioning, cognitive functioning, financial issues, interpersonal relationships and leisure time (Rosa et al. 2007). Each item is scored from 0 to 3. Higher scores indicate functional impairment and scores above 11 indicate impaired functioning.

Patient-reported questionnaires: The following questionnaires were filled in by the patients at all visits with the researcher: Perceived stress according to Cohen’s Perceived stress scale (PSS), which is a 14-item questionnaire measuring the degree to which situations in one’s life are appraised as stressful. Each item is scored from 0 to 4. Higher scores indicate higher perceived stress (Cohen et al. 1983); Quality of life according to WHO Quality of Life-BREF (WHOQoL), which is a 26-item questionnaire concerning physical health, psychological health, social relationships, environment. Each item is scored from 1 to 5. Higher score indicates better quality of life (WHO 1998).

Assessments of cognitive function: As part of the MONARCA I trial objectively-evaluated cognitive function with the Screen for Cognitive Impairment in Psychiatry (SCIP) (Guilera et al. 2009; Rojo et al. 2010) and patient-evaluated cognitive function with the Massachusetts General Hospital Cognitive and Physical Functioning questionnaire (CPFQ) (Fava et al. 2009) were collected at baseline, after 3 months and 6 months. The SCIP consist of five short performance-based tests that assesses verbal learning, delayed verbal memory, working memory, verbal fluency and processing speed with a high validity and reliability in patients with BD (Guilera et al. 2009; Jensen et al. 2015). The SCIP exists in three parallel versions to minimize learning effects with repeated testing, and in the present study the administration order of the SCIP versions was defined using a randomization list to randomly one of the three SCIP versions to each patient during follow-up. The CPFQ is a 7-item questionnaire which measures patients’ experience of cognitive and physical symptoms. The CPFQ was included to increase the internal validity of the findings by investigating a well-known subjective measure of cognition against both the smartphone-based cognitive function as well as the performance-based cognition measure, SCIP.

An overview of assessments during the studies is presented in Table 1.

Table 1 Assessments during the MONARCA studies

Statistical methods

The hypotheses and statistical analyses for the present study were defined á priori.

Since the PSS questionnaire reflects perceived stress during the two previous weeks, the WHOQoL questionnaire reflects quality of life for the previous 2 weeks, and the FAST rating scale reflects psychosocial functioning during the previous week, mean measures of cognitive function measured using smartphones for the days the scales were reflecting were used in the present report. Calculated total scores for the PSS and the WHOQoL were used in the present study. Since five subitems on the FAST scale reflect cognitive function, in addition to total scores of the FAST, analyses excluding measures on cognitive function (item 10, 11, 12, 13 and 14) on the FAST scale as well as analyses only including measures of cognitive function (item 10, 11, 12, 13 and 14) were conducted in the present study.

In relation to aim 1: To investigate the association between both objectively-measured cognitive function and PSS, WHOQoL and FAST, respectively as well as the association between patient-evaluated cognitive function and PSS, WHOQoL and FAST, respectively, a two-level linear mixed effect model was employed (Tables 2 and 3). In all models, we first considered an unadjusted model (model 1). Secondly, we considered a model adjusted for age and gender as possible covariates. Thirdly, we considered a model adjusted for age, gender, and severity of depressive and manic symptoms according to HDRS and YMRS, respectively as possible covariates. In sensitivity analysis, we restricted all statistical analyses in relation to aim 2 (Tables 2 and 3) to include patients with a HDRS score ≤ 14 and a YMRS score ≤ 14, and in addition for the results presented in Table 4 to include patients with a HDRS score ≤ 7 and a YMRS score ≤ 7.

Table 2 Associations between objective clinically evaluated cognitive function and patient evaluated perceived stress, quality of life and functioning, respectively in patients with bipolar disorder, N = 67
Table 3 Associations between patient-evaluated cognitive function measured using smartphone and patient-evaluated perceived stress, quality of life and functioning, respectively in patients with bipolar disorder, N = 117
Table 4 Associations between patients-evaluated cognitive function and objective clinically evaluated cognitive function in patients with bipolar disorder

In relation to aim 2: To investigate the association between patient-evaluated cognitive function and objectively-measured cognitive function a two-level linear mixed effect model, which accommodates both variation of the variables of interest within patients (intra-individual variation) and between individuals (inter-individual variation) was employed. The models included a fixed effect of time (measurement visit number) and a patients-specific random effect allowing for individual intercept and a slope for each participant (Table 4). In addition, the association between these measures according to the sub-domains on the SCIP reflecting verbal learning and memory, delayed memory, working memory, verbal fluency and processing speed were employed. Model 1 reflects unadjusted analyses, model 2 includes age and gender as covariates, and model 3 includes age, gender, HDRS and YMRS score as covariates.

In relation to aim 3: To investigate differences in the association between cognitive function measures using smartphones and perceived stress, quality of life and functioning in patients with BD and HC, interactions between the groups (BD or HC) and outcome measures were investigated for each of the considered models and reported accordingly.

As few prior studies have investigated associations between daily patient-reported cognitive function and perceived stress, quality of life and functioning, respectively, in patients with BD, we were not able to make statistical power analyses prior to the study since potential effects were unknown. However, to account for multiple testing in the statistical models the Bonferroni correction method was used. Thus, p-values below 0.0023 in the individual analyses were considered statistically significant. Model assumptions were checked visually by means of residuals and QQ plots for each of the statistical analyses. Data were entered using Excel and Epidata®, STATA (StataCorp LP, College Station, TX, USA) version 13 was used for statistical analyses.

Ethical considerations

The trials were approved by the Regional Ethics Committee in the Capital Region of Denmark (H-2-2011-056, H-2-2014-059 and H-7-2014-007) and the Danish Data protection agency (2013-41-1710). The law on handling of personal data was respected. Prior to commencement the trials were registered at ClinicalTrials.gov (NCT01446406 and NCT02221336). Electronic data collected from the smartphones were stored at a secure server at Concern IT, Capital Region, Denmark (I-suite number RHP-292 2011-03). The trial complied with the Helsinki Declaration of 1975, as revised in 2008.

Results

Background characteristics

In the MONARCA I trial, a total of 123 potential participants with BD receiving treatment at the Copenhagen Clinic for Affective Disorder, Denmark at the time of the study were assessed for eligibility. Among these, 78 patients (63.4%) were included. A total of 33 patients in the intervention group of the MONARCA I trial provided patient-evaluated cognitive function measured daily using smartphone-based data which was included in the present study.

In the MONARCA II trial, a total of 735 patients with BD previously receiving treatment at the Copenhagen Clinic for Affective Disorder, Denmark were assessed for eligibility. Of these 544 patients were not included due to; unable to get in contact with the patient (n = 240), declined to participate (main reasons: did not have the time, did not want to participate in a research study or had moved too far away making transportation a problem) (n = 282 patients), or were excluded due to previous use of the MONARCA system (n = 22). A total of 84 patients in the intervention group of the MONARCA II trial provided smartphone-based data on level of patient-evaluated cognitive function measured daily using the Monsenso smartphone-based system and was included in the present study. Figure 1 present level of patient-evaluated cognitive function measured using smartphones in the included patient population (combined populations from the MONARCA I trial and the MONARCA II trial) (N = 117).

Fig. 1
figure 1

Patient-evaluated cognitive function measured daily using the Monsenso smartphone-based system, N = 117

A total of 255 HC blood donors were approached at random occasions at the Blood bank at Rigshospitalet, Copenhagen during a 9-month recruitment period. Over half of the HC (n = 129) were ineligible to participate and another 49 were not interested in participating in the study or did not have the time to participate. Of the remaining 77 individuals, 46 were included in the study. Six of those were not included in the final cohort due to a lack of smartphone data. Thus, the final cohort of HC comprised 40 HC.

As seen from Table 5, patients had a mean age of 30.9 (SD 9.9) years (HC: 35.2 (SD 12.8) years) and 62.4% (n = 73) were women (HC: 55% (n = 22)). During the study the patients had a median HDRS score of 7 [IQR 3-14] and a median YMRS score of 2 [IQR 0-4]. There were statistically significant differences in background characteristics between patients with BD and HC. At baseline the patients had a FAST score of 21.0 (SD 14.7) (HC: 1.61 (SD 2.10)) corresponding to moderate impaired functional capacity using a standardized cut-off defined by others (Bonnín et al. 2018). There was an adherence to patient-evaluated cognitive function of 66.4% of the days.

Table 5 Background characteristics of patients with bipolar disorder (BD) and healthy control individuals (HC) using smartphones for daily self-monitoring, N = 157

Patient-evaluated cognitive function and perceived stress, quality of life and functioning

In both the unadjusted models and the models adjusted for age, gender and scores on the HDRS and YMRS, there was a statistically significant positive association between patient-evaluated cognitive function measured using smartphones and scores on the PSS (fully adjusted model: B:0.027, 95% CI 0.017; 0.036, p < 0.0001). Thus, for every increase of 10 point on the PSS scale, there was an increase of 0.17 on scores of patient-evaluated cognitive function measured smartphones (scale: 0 to 2). Further, in both the unadjusted and the models adjusted for age, gender and scores on the HDRS and YMRS, there was a statistically significant negative association between patient-evaluated cognitive function measured using smartphones and scores on the WHOQoL (fully adjusted model: B:− 0.024, 95% CI − 0.032; − 0.017, p < 0.0001). In addition, in both the unadjusted and the models adjusted for age, gender and scores on the HDRS and YMRS, there was a statistically significant positive association between patient-evaluated cognitive function measured using smartphones and scores on the FAST (fully adjusted model: B:0.014, 95% CI 0.0062; 0.021, p < 0.0001)–including in analyses using FAST scores excluding the cognitive items (item 10-14) (p < 0.0001) and in analyses only including the cognitive item (p = 0.001) (Table 3).

In sensitivity analyses, restricting all of the statistical analyses listed above to only include patients with a HDRS score ≤ 14 and a YMRS score ≤ 14 did not alter the estimates to a large extent (PSS, adjusted model: B:0.027, 95% CI 0.017; 0.037, p < 0.0001; WHOQoL, adjusted model: B:− 0.020, 95% CI − 0.028; − 0.012, p < 0.0001; FAST, adjusted model: B:0.017, 95% CI: 0.010; 0.023, p < 0.0001; FAST without cognitive items, adjusted model: B:0.018, 95% CI: 0.010; 0.026, p < 0.001). In further sensitivity analyses, restricting all of the statistical analyses listed above to only include patients with a HDRS score ≤ 7 and a YMRS score ≤ 7 did not alter the estimates to a large extent (PSS, adjusted model: B:0.027, 95% CI: 0.018; 0.036, p < 0.0001; WHOQoL, adjusted model: B:− 0.030, 95% CI − 0.037; − 0.022, p < 0.0001; FAST, adjusted model: B:0.0084, 95% CI 0.00035; 0.017, p = 0.041).

Patient-evaluated cognitive function versus objectively measured cognitive function

There was no statistically significant association between patient-evaluated cognitive function measured using smartphones and objectively-measured cognitive function using the SCIP in unadjusted analyses and in analyses adjusted for age and gender (and in models adjusted for age, gender and scores on the HDRS and the YMRS) (model 2: B: 0.0017, 95% CI − 0.0078; 0.011, p = 0.73) (Table 4). In addition, there was no statistically significant association between patient-evaluated cognitive function measured using the CPFQ and objectively measured cognitive function using the SCIP (p = 0.21). There were no statistically significant associations between sub-domains on the SCIP and patient-evaluated cognitive function measured using smartphones and the CPFQ, respectively (Table 4). There was a statistically significant association between patient-evaluated cognitive function measured using smartphones and patient-evaluated cognitive function measured using the CPFQ (model 3: B: 0.019, 95% CI 0.0087; 0.030, p < 0.0001).

There were no statistically significant associations between objectively-measured cognitive function using the SCIP and PSS, WHOQoL and FAST–including analyses using FAST without the cognitive items (all p-values > 0.03) (Table 4). In sensitivity analyses, restricting the statistical analyses to include patients with a HDRS score ≤ 14 and a YMRS score ≤ 14 there were no statistically significant associations between objectively measured cognitive function using the SCIP and PSS, WHOQoL and FAST. PSS, adjusted model: B:− 0.13, 95% CI − 0.38; 0.12, p = 0.31; WHOQoL, adjusted model: B:0.054, 95% CI − 0.11; 0.22, p = 0.53; FAST, adjusted model: B:− 0.022, 95% CI − 0.024; 0.17, p = 0.80.

In addition, there were no statistically significant associations between objective clinically evaluated cognitive function and HDRS and YMRS, respectively (all p value > 0.04) (Table 4).

Patients with bipolar disorder versus healthy control individuals

Patients with BD reported a statistically significant lover mean level of cognitive function measured using smartphones compared with the HC (B: − 0.36, 95% CI − 0.039; − 0.032, p < 0.0001).

When investigating the association between cognitive function measured using smartphones and PSS, WHOQoL and FAST, there was a statistically significant interaction between between the groups (BD or HC) and the outcome measures. Thus, results are reported separately (for the association between cognitive function measured using smartphones and PSS, WHOQoL and FAST in patients with BD, see results section above).

In HC, in both the unadjusted and the models adjusted for age and gender, there was no statistically significantly associations between cognitive function measured smartphones and scores on the PSS (p = 0.61), the WHOQoL (p = 0.75), and the FAST (p = 0.55).

Discussion

This is the first study to investigate associations between fine-grained real-time collected data on daily patient-evaluated cognitive function measured with smartphones and objectively-measured cognitive function, perceived stress, quality of life and functional capacity in patients with BD. Notably, the majority of patients included in the present study were in full or partly in remission. Interestingly and as hypothesized, we found that impaired daily patient-evaluated cognitive function was associated with increased perceived stress, decreased quality of life and functioning in patients with BD. In contrast, daily patient-evaluated cognitive function measured using smartphones was not associated with objectively measured cognitive function measured using the SCIP. Similarly, there was no association between patient-evaluated cognitive function measured using questionnaires (CPFQ) and objectively measured cognitive function using the SCIP, but there was an association between patient-evaluated cognitive function measured using smartphones and patient-evaluated cognitive function measured using questionnaires (CPFQ).

The finding that smartphone-based patient-evaluated cognitive difficulties were associated with more perceived stress, lower quality of life and functional capacity in patients with BD was novel. Patients with BD often do not recover full functional capacity despite the absence of affective symptoms, leading to heavy costs due to lost productivity (Wyatt and Henter 1995). Several previous studies have reported on clinical and demographic factors’ impact on work functioning in these patients (Sanchez-Moreno et al. 2009; Elinson et al. 2007; Faurholt-Jepsen et al. 2019). Further, patients experience decreased quality of life despite being in remission, and functional recovery and quality of life have been suggested as important treatment targets for patients with BD (Tse et al. 2014; Depp et al. 2012). The findings from the present study are in line with previous studies suggesting that cognitive impairments are related to poor quality of life in patients with BD (Bonnin et al. 2010; Martinez-Aran et al. 2007; Torrent et al. 2012). This implies that when patients present with subjective cognitive complaints at a clinic visit, it should lead to assessment, evaluation and special attention to stress, quality and function in order to specifically address these important impairments of the patients’ everyday life.

The lack of association between smartphone-based patient-evaluated cognitive function and objectively-measured cognitive performance on neuropsychological tests add to the growing evidence for no or poor association between objective cognitive function and patient-evaluated cognitive function with studies presenting disparity in findings (Demant et al. 2015; Martinez-Aran et al. 2005; Svendsen et al. 2012; van der Werf-Eldering et al. 2011; Burdick et al. 2005; Arts et al. 2011). This points to the need to screen for both subjective and objective cognitive impairments in patients with BD allowing for continuous tracking of changes in cognitive function and response to treatment and/or affective episodes. Also, it points to the need to examine both subjective and objective measures of cognitive functioning in future trials investigating the effect of potential treatment interventions (Miskowiak et al. 2018; 2017).

Using smartphones for this type of monitoring enable clinicians to track cognitive function in detail and real-time with multiple evaluations. Also, it may provide insights into daily variations during prolonged time periods outside the clinical settings allowing clinicians and patients to investigate treatment response and response to affective episodes. However, the brief screening tools used in the present study cannot replace full evaluations of cognition, and rapid changes and/or clear deficits should lead to referral for further thorough assessments including evaluation of other secondary causes of cognitive deficits, as suggested by the International Society of Bipolar Disorders Targeting Cognition Task Force (Miskowiak et al. 2018).

Overall, the present study stresses the importance of considering subjective cognitive problems as relevant for intervention decisions and focusing on stress, quality of life and psychosocial functioning even when no objective impairments are detectable. This seems to be important even when no affective symptoms are present as these are not necessarily the reason for subjective cognitive problems.

Advantages

The patients included from the two RCTs in the present study were clinically well characterized and were receiving treatment or had received treatment at the Copenhagen Clinic for Affective Disorders, Denmark. During the studies the majority of patients were in full or partly on remission, and thus the cognitive impairments as well as the increased levels of stress, and decreased quality of life and functioning were not due to affective symptoms. The clinical evaluations were conducted multiple times during follow-up by experienced researchers with a specific knowledge within bipolar disorder. Also, the objectively measured cognitive function, functional capacity, depressive and manic symptoms were conducted rater-blinded, since the researchers did not have access to the smartphone data. Further adding to increase the internal validity of the finding of no association between daily patient-evaluated cognitive function measured using smartphones and objectively-measured cognitive function measured using the SCIP, similarly no association was found between subjective measure of cognition using the CPFQ and the observer-based SCIP.

The smartphone-based system used in the present studies (the Monsenso system) were developed by the authors and has been shown easy to use with a high usability, usefulness, ease of learning to use and interface quality–also when compared with other smartphone-based systems (Bardram et al. 2013; Faurholt-Jepsen et al. 2019). The use of smartphones for real-time fine-grained monitoring reduced the risk of recall bias. Since we were not able to conduct statistical power analyses for the present study, multiple testing was taken into account in the statistical analyses.

Overall, the findings from the present study are found to be generalizable to patients with bipolar disorder not presenting with affective episodes who are willing to use a monitoring tool during prolonged time periods.

Limitations

First, the patients included in the study were recruited as part of two RCTs (the MONARCA I and II trials) investigating the effect of daily smartphone-based monitoring on the severity of depressive and manic symptoms (Faurholt-Jepsen et al. 2019; 2015). Thus, the sample size and follow up period were defined according to the RCTs’ design. It is possible that a larger sample with a longer follow up period could have resulted in other findings. Data on perceived stress and quality of life was collected using questionnaires and due to the nature of the intervention the patients were not blinded to smartphone data. In contrast, clinical assessments of cognitive function, functioning and severity of depressive and manic symptoms were conducted by experienced researchers who were blinded to smartphone data. Second, the smartphone-based scale for monitoring of cognitive function ranged from 0 to 2, limiting the opportunity to investigate associations using a scale with higher granularity. It may be that minor cognitive impairments could have been both over and underestimated by the patients. Along this line, aside from the SCIP we did not include other more comprehensive objective measures of cognitive function. In addition, the patients conducted smartphone-based self-monitoring with an adherence of 66.4%, and it may be that patient-evaluated cognitive function during more or less severe affective states were not collected. However, this is the first study investigating daily parameters in this population. Third, the patients were participating in two RCTs as part of the intervention group and the intervention in itself could have influenced the patients’ symptoms. Fourth, the results are based on association analyses and therefore the cause and consequence between cognitive impairments on the one hand and perceived stress, quality of life and functioning on the other is not entirely clear form the present study. Whether cognitive impairments per se cause increased stress, reduced quality of life and functioning is not clear but could be interesting to investing further in future studies. Fifth, in the statistical analyses the included covariates did not affect the estimates. It may be that other confounding variables could have altered the associations.

Perspectives

The rapid evolution of smartphone-based technology and the ubiquity of mobile networks have fostered increasing growth of e-mental health technologies including electronic platforms offering tools for remote self-monitoring in BD. Smartphones allow for long-term fine-grained real-time assessments outside the clinical settings (Ebner-Priemer and Trull 2009) and provide unique opportunities to a better understanding of the nature, correlates and clinical implications of cognitive dysfunction in patient with BD. This will add to the opportunity to intervene and potentially initiate treatment to prevent impaired functioning and quality of life in these patients.

Conclusions

Smartphone-based patients-evaluated cognitive difficulties were associated with more perceived stress, lower quality of life and poorer functional capacity even during full or partly remission. In contrast, there was no association between daily subjective cognitive function measures using smartphones and objective cognitive function in patients with BD. In patients presenting with subjective cognitive complaints evaluation and special attention to stress, quality and functioning should be a priority. Subjective cognitive impairment was associated with clinical disability pointing toward smartphones as a valid tool.

Availability of data and material

Not applicable.

References

  • Arts B, Jabben N, Krabbendam L, van Os J. A 2-year naturalistic study on cognitive functioning in bipolar disorder. Acta Psychiatrica Scandinavica. 2011;123:190–205.

    Article  CAS  PubMed  Google Scholar 

  • Bardram, J. E. et al. Designing mobile health technology for bipolar disorder: a field trial of the monarca system. in In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems pages. 2013; 2627–2636.

  • Baune BT, Malhi GS. A review on the impact of cognitive dysfunction on social, occupational, and general functional outcomes in bipolar disorder. Bipolar Disord. 2015;17:41–55.

    Article  PubMed  Google Scholar 

  • Bonnin CM, et al. Clinical and neurocognitive predictors of functional outcome in bipolar euthymic patients: a long-term, follow-up study. J Affect Disord. 2010;121:156–60.

    Article  CAS  PubMed  Google Scholar 

  • Bonnín CM, et al. Thresholds for severity, remission and recovery using the functioning assessment short test (FAST) in bipolar disorder. J Affect Disord. 2018;240:57–62.

    Article  PubMed  Google Scholar 

  • Bourne C, et al. Neuropsychological testing of cognitive impairment in euthymic bipolar disorder: an individual patient data meta-analysis. Acta Psychiatr Scand. 2013;128:149–62.

    Article  CAS  PubMed  Google Scholar 

  • Burdick KE, Endick CJ, Goldberg JF. Assessing cognitive deficits in bipolar disorder: are self-reports valid? Psychiatry Res. 2005;136:43–50.

    Article  PubMed  Google Scholar 

  • Cohen S, Kamarck T, Mermelstein R. A global measure of perceived stress. J Health Soc Behav. 1983;24:385–96.

    Article  CAS  PubMed  Google Scholar 

  • Demant KM, Vinberg M, Kessing LV, Miskowiak KW. Assessment of subjective and objective cognitive function in bipolar disorder: correlations, predictors and the relation to psychosocial function. Psychiatry Res. 2015;229:565–71.

    Article  PubMed  Google Scholar 

  • Depp CA, et al. Meta-analysis of the association between cognitive abilities and everyday functioning in bipolar disorder. Bipolar Disord. 2012;14:217–26.

    Article  PubMed  PubMed Central  Google Scholar 

  • Dickerson FB, Sommerville J, Origoni AE, Ringel NB, Parente F. Outpatients with schizophrenia and bipolar I disorder: do they differ in their cognitive and social functioning? Psychiatry Res. 2001;102:21–7.

    Article  CAS  PubMed  Google Scholar 

  • Dion GL, Tohen M, Anthony WA, Waternaux CS. Symptoms and functioning of patients with bipolar disorder six months after hospitalization. Hosp Community Psychiatry. 1988;39:652–7.

    CAS  PubMed  Google Scholar 

  • Ebner-Priemer UW, Trull TJ. Ecological momentary assessment of mood disorders and mood dysregulation. Psychol Assess. 2009;21:463–75.

    Article  PubMed  Google Scholar 

  • Elinson L, Houck P, Pincus HA. Working, receiving disability benefits, and access to mental health care in individuals with bipolar disorder. Bipolar Disord. 2007;9:158–65.

    Article  PubMed  Google Scholar 

  • Ericsson Mobility Report November. 32 (2018).

  • Etkin A, Gyurak A, O’Hara R. A neurobiological approach to the cognitive deficits of psychiatric disorders. Dialogues Clin Neurosci. 2013;15:419–29.

    PubMed  PubMed Central  Google Scholar 

  • Faurholt-Jepsen M, et al. Daily electronic monitoring of subjective and objective measures of illness activity in bipolar disorder using smartphones–the MONARCA II trial protocol: a randomized controlled single-blind parallel-group trial. BMC Psychiatry. 2014;14:309.

    Article  PubMed  PubMed Central  Google Scholar 

  • Faurholt-Jepsen M, et al. Daily electronic self-monitoring in bipolar disorder using smartphones–the MONARCA I trial: a randomized, placebo-controlled, single-blind, parallel group trial. Psychol Med. 2015;45:2691–704.

    Article  CAS  PubMed  Google Scholar 

  • Faurholt-Jepsen M, et al. The effect of smartphone-based monitoring on illness activity in bipolar disorder- The MONARCA II randomized controlled single-blinded trial. Psychol Med. 2019a;2019:1–11.

    Google Scholar 

  • Faurholt-Jepsen M, et al. Differences in mood instability in patients with bipolar disorder type I and II: a smartphone-based study. Int J Bipolar Disorders. 2019b;7:5.

    Article  Google Scholar 

  • Faurholt-Jepsen M, et al. Smartphone-based self-monitoring in bipolar disorder: evaluation of usability and feasibility of two systems. Int J Bipolar Disorders. 2019c;7:1.

    Article  Google Scholar 

  • Fava M, Iosifescu DV, Pedrelli P, Baer L. Reliability and validity of the Massachusetts general hospital cognitive and physical functioning questionnaire. Psychother Psychosom. 2009;78:91–7.

    Article  PubMed  Google Scholar 

  • Goodwin FK, Jamison KR. Manic-Depressive illness, vol. 1996. New Oxford University Press; 1996

  • Guilera G, et al. Clinical usefulness of the screen for cognitive impairment in psychiatry (SCIP-S) scale in patients with type I bipolar disorder. Health Qual Life Outcomes. 2009;7:28.

    Article  PubMed  PubMed Central  Google Scholar 

  • Hamilton M. Development of a rating scale for primary depressive illness. Br J Soc Clin Psychol. 1967;6:278–96.

    Article  CAS  PubMed  Google Scholar 

  • Jensen JH, et al. Optimising screening for cognitive dysfunction in bipolar disorder: validation and evaluation of objective and subjective tools. J Affect Disord. 2015;187:10–9.

    Article  PubMed  Google Scholar 

  • Jensen JH, Knorr U, Vinberg M, Kessing LV, Miskowiak KW. Discrete neurocognitive subgroups in fully or partially remitted bipolar disorder: associations with functional abilities. J Affect Disord. 2016;205:378–86.

    Article  PubMed  Google Scholar 

  • Kessing LV. Cognitive impairment in the euthymic phase of affective disorder. Psychol Med. 1998;28:1027–38.

    Article  CAS  PubMed  Google Scholar 

  • Kessing LV, et al. Treatment in a specialised out-patient mood disorder clinic v. standard out-patient treatment in the early course of bipolar disorder. Br J Psychiatry. 2013;202:212–9.

    Article  PubMed  Google Scholar 

  • Kessing LV, et al. The Bipolar Illness Onset study: research protocol for the BIO cohort study. BMJ Open. 2017;7:e015462.

    Article  PubMed  PubMed Central  Google Scholar 

  • Lal S, Adair CE. E-Mental Health: A Rapid Review of the Literature. PS. 2014;65:24–32.

    Article  Google Scholar 

  • Mackala SA, Torres IJ, Kozicky J, Michalak EE, Yatham LN. Cognitive performance and quality of life early in the course of bipolar disorder. J Affect Disord. 2014;168:119–24.

    Article  PubMed  Google Scholar 

  • Martinez-Aran A, et al. Cognitive dysfunctions in bipolar disorder: evidence of neuropsychological disturbances. Psychother Psychosom. 2000;69:2–18.

    Article  CAS  PubMed  Google Scholar 

  • Martinez-Aran A, et al. Do cognitive complaints in euthymic bipolar patients reflect objective cognitive impairment? Psychother Psychosom. 2005;74:295–302.

    Article  CAS  PubMed  Google Scholar 

  • Martinez-Aran A, et al. Functional outcome in bipolar disorder: the role of clinical and cognitive factors. Bipolar Disord. 2007;9:103–13.

    Article  CAS  PubMed  Google Scholar 

  • Martínez-Arán A, et al. Cognitive function across manic or hypomanic, depressed, and euthymic states in bipolar disorder. Am J Psychiatry. 2004a;161:262–70.

    Article  PubMed  Google Scholar 

  • Martínez-Arán A, et al. Cognitive impairment in euthymic bipolar patients: implications for clinical and functional outcome. Bipolar Disord. 2004b;6:224–32.

    Article  PubMed  Google Scholar 

  • Miskowiak K, et al. Methodological recommendations for cognition trials in bipolar disorder by the International Society for Bipolar Disorders Targeting Cognition Task Force. Bipolar Disord. 2017;19:614–26.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  • Miskowiak KW, et al. Assessing and addressing cognitive impairment in bipolar disorder: the International Society for Bipolar Disorders Targeting Cognition Task Force recommendations for clinicians. Bipolar Disord. 2018;20:184–94.

    Article  CAS  PubMed  Google Scholar 

  • Pini S, et al. Prevalence and burden of bipolar disorders in European countries. Eur Neuropsychopharmacol. 2005;15:425–34.

    Article  CAS  PubMed  Google Scholar 

  • Rojo E, et al. Neurocognitive diagnosis and cut-off scores of the Screen for Cognitive Impairment in Psychiatry (SCIP-S). Schizophr Res. 2010;116:243–51.

    Article  PubMed  Google Scholar 

  • Rosa AR, et al. Validity and reliability of the Functioning Assessment Short Test (FAST) in bipolar disorder. Clin Pract Epidemiol Ment Health. 2007;3:5.

    Article  PubMed  PubMed Central  Google Scholar 

  • Sanchez-Moreno J, et al. Functioning and disability in bipolar disorder: an extensive review. Psychother Psychosom. 2009;78:285–97.

    Article  CAS  PubMed  Google Scholar 

  • Shiffman S, Stone AA, Hufford MR. Ecological momentary assessment. Annu Rev Clin Psychol. 2008;4:1–32.

    Article  PubMed  Google Scholar 

  • Svendsen AM, Kessing LV, Munkholm K, Vinberg M, Miskowiak KW. Is there an association between subjective and objective measures of cognitive function in patients with affective disorders? Nord J Psychiatry. 2012;66:248–53.

    Article  PubMed  Google Scholar 

  • Taylor, K. & Silver, L. Smartphone Ownership Is Growing Rapidly Around the World, but Not Always Equally | Pew Research Center. http://www.pewglobal.org/2019/02/05/smartphone-ownership-is-growing-rapidly-around-the-world-but-not-always-equally/ (2019).

  • Torrent C, et al. Long-term outcome of cognitive impairment in bipolar disorder. J Clin Psychiatry. 2012;73:e899–905.

    Article  PubMed  Google Scholar 

  • Torres IJ, Boudreau VG, Yatham LN. Neuropsychological functioning in euthymic bipolar disorder: a meta-analysis. Acta Psychiatr Scand Suppl. 2007. https://doi.org/10.1111/j.1600-0447.2007.01055.x.

    Article  PubMed  Google Scholar 

  • Tse S, Chan S, Ng KL, Yatham LN. Meta-analysis of predictors of favorable employment outcomes among individuals with bipolar disorder. Bipolar Disord. 2014;16:217–29.

    Article  PubMed  Google Scholar 

  • van der Werf-Eldering MJ, et al. Is the lack of association between cognitive complaints and objective cognitive functioning in patients with bipolar disorder moderated by depressive symptoms? J Affect Disord. 2011;130:306–11.

    Article  PubMed  Google Scholar 

  • Vos T, et al. Years lived with disability (YLDs) for 1160 sequelae of 289 diseases and injuries 1990–2010: a systematic analysis for the Global Burden of Disease Study 2010. The Lancet. 2012;380:2163–96.

    Article  Google Scholar 

  • WHO. Development of the World Health Organization WHOQOL-BREF quality of life assessment. The WHOQOL Group. Psychol Med. 1998;28:551–8.

    Article  Google Scholar 

  • Wing JK, et al. SCAN. Schedules for clinical assessment in neuropsychiatry. Arch Gen Psychiatry. 1990;47:589–93.

    Article  CAS  PubMed  Google Scholar 

  • Wyatt RJ, Henter I. An economic evaluation of manic-depressive illness–1991. Soc Psychiatry Psychiatr Epidemiol. 1995;30:213–9.

    CAS  PubMed  PubMed Central  Google Scholar 

  • Young RC, Biggs JT, Ziegler VE, Meyer DA. A rating scale for mania: reliability, validity and sensitivity. Br J Psychiatry. 1978;133:429–35.

    Article  CAS  PubMed  Google Scholar 

Download references

Acknowledgements

The authors would like to thank the patients for participating in the study, the nurses Hanne Steenberg Nicolajsen and Bente Støyer, Psychiatric Center Copenhagen, Denmark for assisting the patients in using the smartphone-based monitoring system and Anne Sophie Jacoby (ASJ) for assisting with the clinical evaluations in the MONARCA I trial.

Funding

The MONARCA I trial was funded by the EU 7th 564 Frame Program, the Mental Health Services in the Capital Region of Denmark, the Tryg foundation, the Gert Einar Joergensens foundation, and the A.P. Moeller og Hustru Chastine Mc-Kinney Moellers foundation for general purposes. The MONARCA II trial was funded by The Mental Health Services in the Capital Region of Denmark including the Centre for Telemedicine in the Capital Region of Denmark and the EU 7th Frame Program, the IT University of Copenhagen, The Tryg foundation and the Lundbeck Foundation. The research team has no financial connection to any of the funders. The funding organizations had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; and decision to submit the manuscript for publication.

Author information

Authors and Affiliations

Authors

Contributions

MFJ and LVK performed the statistical analyses and wrote the first draft of the manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Maria Faurholt-Jepsen.

Ethics declarations

Ethics approval and consent to participate

The trials were approved by the Regional Ethics Committee in the Capital Region of Denmark (H-2-2011-056, H-2-2014-059 and H-7-2014-007) and the Danish Data protection agency (2013-41-1710). The law on handling of personal data was respected. Prior to commencement the trials were registered at ClinicalTrials.gov (NCT01446406 and NCT02221336). Electronic data collected from the smartphones were stored at a secure server at Concern IT, Capital Region, Denmark (I-suite number RHP-292 2011-03). The trial complied with the Helsinki Declaration of 1975, as revised in 2008.

Consent for publication

Not applicable.

Competing interests

MFJ and HÞ have no conflicts of interest. KWM has been a consultant for Lundbeck, Allergan and Janssen within the last three years. MF and JEB are co-founders and shareholders in Monsenso ApS. EMC has been a consultant for Eli Lilly, Astra Zeneca, Servier, Bristol-Myers Squibb, Lundbeck, and Medilink. MV has been a consultant for Lundbeck within the last 3 years. LVK has during recent 3 years been a consultant for Sunovion and Lundbeck.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Faurholt-Jepsen, M., Miskowiak, K.W., Frost, M. et al. Patient-evaluated cognitive function measured with smartphones and the association with objective cognitive function, perceived stress, quality of life and function capacity in patients with bipolar disorder. Int J Bipolar Disord 8, 31 (2020). https://doi.org/10.1186/s40345-020-00205-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s40345-020-00205-1

Keywords