- Open Access
Digital health developments and drawbacks: a review and analysis of top-returned apps for bipolar disorder
International Journal of Bipolar Disorders volume 8, Article number: 39 (2020)
Although a growing body of literature highlights the potential benefit of smartphone-based mobile apps to aid in self-management and treatment of bipolar disorder, it is unclear whether such evidence-based apps are readily available and accessible to a user of the app store.
Using our systematic framework for the evaluation of mental health apps, we analyzed the accessibility, privacy, clinical foundation, features, and interoperability of the top-returned 100 apps for bipolar disorder. Only 56% of the apps mentioned bipolar disorder specifically in their title, description, or content. Only one app’s efficacy was supported in a peer-reviewed study, and 32 apps lacked privacy policies. The most common features provided were mood tracking, journaling, and psychoeducation.
Our analysis reveals substantial limitations in the current digital environment for individuals seeking an evidence-based, clinically usable app for bipolar disorder. Although there have been academic advances in development of digital interventions for bipolar disorder, this work has yet to be translated to the publicly available app marketplace. This unmet need of digital mood management underscores the need for a comprehensive evaluation system of mental health apps, which we have endeavored to provide through our framework and accompanying database (apps.digitalpsych.org).
With the rise of digital tools and applications, smartphone apps offer promising tools to augment support and self-management for individuals with bipolar disorder (BD). With a prevalence rate of > 1% of the world’s population, patients who need chronic illness management may not have access to subspeciality clinics, and primary care providers are increasingly comfortable working with this patient population, provided supportive technology to facilitate monitoring and follow-up. (Rowland and Marwaha 2018). Studies have suggested that, as of 2019, smartphone ownership among individuals with bipolar disorder exceeds 75% (Hidalgo-Mazzei et al. 2019; Young et al. 2020), and there is evident interest in app use among individuals with BD, with 40% of young adults with bipolar disorder having used an app for symptom management and 79% of those not using an app wanting to try (Nicholas et al. 2017).
The feasibility and preliminary efficacy of mobile interventions for bipolar disorder have been validated in a variety of settings, with programs including a personal digital assistant (Depp et al. 2010), weekly text-services, and other short-message based interventions demonstrating evidence of benefit (Bopp et al. 2010). There is a robust literature base of both internet-based and smartphone-based interventions supporting self-management strategies for ongoing monitoring, education, and maintaining hope (Gliddon et al. 2017). Smartphone apps can enable both active (user-inputted) and passive (automatically collected) data collection to aid in BD diagnostics, advance evidence-based treatments like social rhythm therapy, and self-management (Torous and Powell 2015). Software applications such as Mood Rhythm and MONARCA, for example, use sensors and self-assessments in order to gain data about sleep, social activity, and mood to provide more information for both the patients and their clinicians (Matthews et al. 2016). In a 6-month, randomized, placebo-controlled, single-blind, parallel group trial utilizing MONARCA, bipolar patients who used the app, in comparison to those who did not, had fewer symptoms of mania, highlighting that both active and passive data collection may meaningfully augment conventional treatment (Faurholt-Jepsen et al. 2015). A study involving smartphone-based monitoring systems in conjunction with wrist worn accelerometers demonstrated adequate usability and feasibility (Faurholt-Jepsen et al. 2019a). Indeed, digital phenotyping—deriving metrics like location and activity patterns, social phone utilization, and symptom change—are emerging as mobile target interventions for BD (Huckvale et al. 2019). These metrics may help elucidate digital biomarkers to detect both diagnostic mood status and symptom change (Ortiz and Grof 2016), ultimately facilitating the potential for early relapse detection (Jacobson et al. 2019; Faurholt-Jepsen et al. 2019b). Survey studies have indicated that individuals with bipolar disorder are interested in and open to using apps for illness management, including apps with automatic data collection to complement traditional user-inputted metrics (Daus et al. 2018). Digital phenotyping is the latest promising avenue of exploration, adding to the robust base of literature supporting the efficacy of and receptiveness to smartphone interventions for BD.
However, these promising research findings may not translate into widely available apps that patients and clinicians can use as tools today if these digital tools are not available to an end user of the app store. While a search on the app store yields numerous results with the “bipolar” search term, it is unclear whether order in returned search is at all associated with app quality or clinical utility. Since the last systematic review of publicly available apps for BD in 2015, which highlighted serious concerns around privacy, evidence, engagement, and potential for harm, it is unknown if the landscape has meaningfully changed in response to emerging research about the potential of digital interventions for BD, and whether an average app store user is now more able to access quality, research-supported apps (Nicholas et al. 2015). Other excellent recent reviews have focused on the evidence for bipolar disorders apps based on the research literature, but what is available and being offered to patients today in the public app marketplace is likely different than the subject of this review (Bauer et al. 2020). We intend to address this lacuna in the existing literature: while recent work by our team and others has thoroughly investigated the potential of apps in research settings, far less attention has been paid to what an app store end user is able to find and access. Advances in digital health research are promising, but without widespread translation to the broader public their impact is limited. We thus sought to examine the safety, relevance, and clinical utility of the apps that are most readily available for lay person seeking tools for BD, which is also understudied when compared to technology for anxiety, depression, and other mental health conditions.
In the absence of strict oversight to help guide users find appropriate tools in the app store, we have proposed an enduring and reproducible framework to guide the evaluation and assessment of mobile health apps (Henson et al. 2019; Lagan et al. 2020). The framework is based on the American Psychiatric Association’s app evaluation model which has been well studied and utilized (Martinengo et al. 2019; Cohen et al. 2020; Bergin and Davies 2020; Ondersma and Walters 2020; Levine et al. 2020). The framework comprises 105 different questions examining app accessibility, origin, functionality, privacy, features, and clinical foundation, ultimately providing a comprehensive picture of app quality and utility. Each question in the framework corresponds to a principle in the American Psychiatric Association’s app evolution model but now is reduced to a reproducible data point or number to encourage transparency and cultural respect. Seeking to identify the attributes of the most accessible apps for bipolar disorder, we applied this framework to the 100 top-returned apps on the Apple iOS store, investigating a wide array of their features along with correspondence to evidence-based principles of BD treatment and self-management.
Beyond appearing in the search, there was no inclusion criteria for app analysis, as an objective of this study was to assess the features of the most readily available and easily findable apps for a layperson. On February 20, 2020 the term “bipolar” was entered into the iOS app store. Of the first 107 returned apps, nine were not usable (5 required an access code; 2 were unavailable in English; 2 became unavailable over the course of the study). The remaining 98 apps were downloaded onto an iPhone 6 and iPhone 8 for complete assessment. Apps that were not free to download were purchased by raters for analysis.
Each app was assessed by at least two raters (AMR, ANR, EL, SL). Apps were evaluated based on our previously established 105 question framework created in conjunction with the American Psychiatric Association (APA). These 105 questions are based on the APA’s App Evaluation Model, with questions sorted into six categories: Origin, Functionality, and Accessibility (31 questions); Inputs and Outputs (15 questions); Privacy and Security (14 questions); Evidence and Clinical Foundation (8 questions); Features and Engagement Style (31 questions); and Interoperability and Data Sharing (6 questions). The questions are all objective and can be coded with a binary or numeric answer. The framework employed thus promotes comprehensive user testing while minimizing subjectivity and providing transparent assessment results. The ratings for each individual app are available upon request, and the apps suitable for mental health and wellness use are included in the database which can be accessed at https://apps.digitalpsych.org/Apps.
Of the first 107 bipolar disorder related apps, nine (8%) were inaccessible without an access code or unavailable in English, and thus, a total of 98 iOS bipolar disorder apps were evaluated with our framework (Fig. 1).
Function and relevance
In the iOS Store, apps returned on a search bipolar disorder (BD) were categorized in Business (n = 1), Education (n = 4), Entertainment (n = 2), Games (n = 13), Health and Fitness (n = 34), Lifestyle (n = 19), Magazine and Newspaper (n = 1), Medical (n = 19), Productivity (n = 2), Social Networking (n = 3), and Stickers (n = 2). The range of primary app functions reflects that the top returned apps are not necessarily patient facing or relevant to an individual with bipolar disorder. Only 56 apps (57%) explicitly mentioned bipolar disorder in their app description, title, or content.
Origin and accessibility
The framework’s questions around origin and accessibility offer a comprehensive picture of who can download and access the app, including considerations like availability across different platforms, cost, offline functionality, last update, app size, and availability in different languages.
Of the 98 apps top returned iOS apps, 35 apps were also available on the Google Play store. 72 apps were free to download, although 41 of these apps required an in-app purchase or required a subscription to access the full swath of content. Of the 22 apps that were not free to download, the minimum cost was $0.99 USD and the maximum cost was $49.99 USD with a median cost of $1.99. Sixty six apps did not require an active internet connection after download and could be accessed offline, while 32 apps required internet connection after download to access content.
Many of the apps were infrequently downloaded and not currently updated, prompting concern given that lack of update in the last 180 days—a metric associated with lower app quality (Wisniewski et al. 2019a). Only 38 apps had been updated in the last 180 days in the iOS Store, with 10 apps still in the first version. The average rating for analyzed apps was 4.2 in the iOS store and 4.0 in the Google Play store. 44 apps had over 20 reviews in the iOS store and 23 apps had over 20 reviews in the Google Play store. The fact that more than half of the apps available on iOS had fewer than 20 reviews suggests that apps returned on search for BD may not be widely downloaded (the iOS app store does not provide direct data on number of downloads). The average app size was 47.5 MB in the Apple Store and 20.6 MB in the Google Play store, and 20 apps were available in at least one other language in addition to English, with the majority (n = 19) of these offering Spanish functionality.
Regarding app origin, only two apps were affiliated with a university or healthcare organization, and both were treatment guideline apps intended for physicians. None of the top 100 apps had government affiliation, although several governmental organizations, including the Department of Veterans Affairs and Department of Defense, have ventured into the mental health app space and developed apps (Owen et al. 2018). None of the apps that had been assessed in research studies for effectiveness at BD management or treatment appeared in the top 100.
Inputs and outputs
Questions about inputs and outputs help illustrate the kind of data that each app collects and returns to the user. The most common inputs among the 98 apps analyzed were surveys (n = 48), diaries or user inputted text entries (n = 38), geolocation (n = 9), and camera (n = 9). Six of the apps that collected geolocation data from a user’s phone were mood-tracking apps, while two were apps with a peer support or community forum. The most common outputs were notifications (n = 49), summaries of data (n = 41), graphs of data (n = 40). 8 apps provided a link to formal care or coaching within the app itself.
Privacy and confidentiality
Privacy policies were available to the public in 66 of the 98 apps, through either a link from the app store description or within the app itself. 27 apps (40.9%) of apps with privacy policies mentioned the disclosure of users’ personal information to third parties. Although several apps included features that prompted users to enter personal health information such as medication tracking (n = 5) alongside identifying data, only one app claimed to be HIPAA compliant.
Questions about clinical foundation assess each app’s veracity of claims, support in peer-reviewed studies, and potential to cause harm. 93 apps in our analysis provided what they claimed, while 5 apps did not meet their claims, failing to offer the features that were advertised in their app description. One app’s description read, for example, “stimulate vital areas of the brain and heal naturally…prepare yourself for Coronavirus!” despite providing no psychoeducation or links to information about COVID-19 (Brainwaves Psychological 2020). Another claimed to provide meditation and yoga, but instead primarily served as a game without offering comprehensive meditation modules.
Only one app had supporting feasibility and efficacy studies, with 7 Cups of Tea backed by one feasibility study (Baumel and Schueller 2016) and two efficacy studies (Baumel et al. 2018; Baumel 2015), none of which involved participants with bipolar disorder specifically. Although another app, Daylio, was the subject of an article in JMIR’s mHealth (Chaudhry 2016), the article offered an in depth description of the app without a supporting feasibility or efficacy study and thus was not included in our analysis.
12 apps were rated as capable of causing harm to a user. 11 of these potentially harmful apps offered unmoderated forums or information that was triggering and not aligned with current treatment guidelines. One app, for example, encouraged users to “break the silence on your hopelessness and depression by speaking up in a small way and using a background that reflects your inner misery and despair” and provided phone wallpapers with messages including, “I disappoint myself” and “I don’t like what I’m becoming” (Wallpapers 2020). The other app was a “bipolar test and personality quiz” that offered users a “test” for bipolar disorder (Bipolar Test 2020). The questions, however, did not align with the clinically-validated Mood Disorder Questionnaire (MDQ) and even if a user obtained a result confirming they were at high risk of BD, the app provided no links or references and did not direct users to a medical professional or other resources.
Features and engagement style
Mood-tracking, journaling, and psychoeducation were the most common features offered by apps returned in the search for bipolar disorder. 43 apps offered mood-tracking, 41 apps provided a platform for journaling, and 19 apps provided psychoeducation about either BD specifically or coping strategies and treatments more broadly. The most common engagement style was through user-generated data (n = 44), gamification (n = 23), and peer support (n = 13). Features varied significantly as a function of cost (χ2 = 15.982, p = 0.042), with apps that were totally free more likely to offer screeners or assessments, and apps with either up-front costs or in-app purchases more likely to provide meditation and mindfulness (Table 1, Fig. 2).
Our analysis reveals that a simple app store search may not be sufficient for an individual seeking to find an app suitable to BD education, management, or treatment, as many apps in the top 100—including paid apps—were irrelevant or raised concerns that warrant a cautious approach to app selection.
Some apps offered harmful or misleading content. The order that the search returned apps was not indicative of clinical utility, as some misleading, stigmatizing, and dangerous apps appeared before apps with features suitable to BD management and treatment. One app encouraged users to “break the silence on your hopelessness and depression by speaking up in a small way and using a background that reflects your inner misery and despair” and provided phone wallpapers with messages including, “I disappoint myself” and “I don’t like what I’m becoming” (Wallpapers 2020). Another app’s description read, “stimulate vital areas of the brain and heal naturally…prepare yourself for Coronavirus!” despite providing no psychoeducation or links to information about COVID-19 (Brainwaves Psychological 2020). One app offered no features besides downloadable stickers of an “unpredictable bipolar bear” depicted in cartoon imagery (The Bipolar Bear Bonacorso 2020).
Only one app that appeared in the search had supporting feasibility and efficacy studies, and even those peer-reviewed publications did not involve individuals with Bipolar Disorder, instead focusing on the app’s ability to mitigate symptoms of depression. While the overtly incorrect claims by some apps are a serious area of concern, even subtler claims made by commercial apps, such as “manage your symptoms of Bipolar Disorder!” should be approached cautiously given the lack of evidence across all returned apps.
Another challenge was that some apps offered what appeared to be evidence-based interventions, but upon closer inspection were likely not. For example, thirteen apps claimed to offer peer support in some form; nine of them, however, did so via unmoderated forums, where users were able to post and view content posted on a public forum, or the “moderators” did not intervene until after a comment was reported. One mood tracking app, for example, automatically published all mood and diary entries to a public newsfeed and required an in-app purchase in order to access a private diary that would not be published (Moodtrack Social Diary 2020). In all of these apps, the risk of triggering, non clinically-useful content was concerning. The concept of peer support was also defined loosely. While certified peer specialists have been shown to improve treatment outcomes across a range of mental health conditions (Felton et al. 1995), no apps we reviewed utilized certified peer specialists, instead defining “peer” to be anyone else using the app. Integrating peer specialist support into technology is a continuing area of research, with preliminary evidence of both feasibility and efficacy, but our analysis reveals that these advances in peer specialist technology research have yet to be translated to the area of publicly available BD apps (Fortuna et al. 2018).
Comparison with prior work
In terms of evidence-based apps, however, the commercial app space has not significantly progressed: as in the 2015 review by Nicholas et al., we identified just one app supported by feasibility or efficacy studies. This finding suggests that research around digital tools for Bipolar Disorder has not been translated into many evidence-based, clinically relevant apps on the app store. As the need for digital resources becomes increasingly urgent in the wake of the COVID-19 pandemic, the app store content most available to end users is of the utmost importance.
Overall, while our analysis demonstrates that some strides have been made in the landscape of apps for bipolar disorder since 2015, a noticeable gap between research and practice is still present. Despite the body of research highlighting the potential of apps to support individuals with bipolar disorder, such research has yet to be translated to the publicly available app marketplace, where only one app that appears in a user’s search for “bipolar” is backed by supporting studies. Although there is evidence that individuals with bipolar disorder are interested in apps with automatic data collection to aid in symptom management, few of the apps utilized passive data (Daus et al. 2018). And while the effectiveness of peer support has received growing attention, available “peer support” apps have yet to progress beyond a potentially triggering community forum model. If the potential of technology is to be fully harnessed, research-backed apps must be made available to the public, and a comprehensive app evaluation system is urgent in light of limited regulation from the app stores.
This study employed a single search term, “bipolar,” as we sought to analyze the most immediately accessible apps for a layperson seeking BD resources in the app store. Utilizing this limited search term, however, prevented a full perusal of apps that may be relevant for an individual with bipolar disorder; it is possible that mood-tracking, mindfulness, and other tools for self-management may not explicitly reference BD at all but nonetheless offer clinical benefit. For example, the app HealthRhythms was designed to target bipolar disorder but does not return in any search for the term (Measure Health 2020). Recognizing the limited scope of this work, we view our analysis as a marker of the current state of the field and call for better processes in finding a relevant, clinically usable app via the app store for an individual seeking resource for Bipolar Disorder. This review is just one component of our broader effort to link clinicians and patients with safe, effective apps. Our database of mental health apps enables users to filter and find apps based on desired characteristics and thus connects individuals to tailored tools more effectively than a simple app store search (Nicholas et al. 2015).
Additional limitations arise from individual differences in the algorithm that determines which apps appear in what order on an iOS store search. The algorithm in fact changes daily, as a search a week later conducted on the same phone yielded the same apps but in a slightly different order. A growing body of literature highlights the rampant turnover characterizing the app space, with, for example, a clinically relevant app for depression becoming available every 2.9 days (Larsen et al. 2016). Given the dynamic nature of the app store, and the increasing focus on developing technology to support mental health (Monteith et al. 2016), it is possible that clinically relevant apps for BD have emerged in between drafting and publication of this study.
Despite both the continued proliferation of mental health apps and promising research around the efficacy of smartphone apps for management and treatment of bipolar disorder, our study highlights how it remains difficult for an individual seeking a relevant app for BD to find an appropriate tool in the app store. The primary shortcoming is that users must wade through irrelevant, misleading, and even potentially dangerous apps to find a relevant one. The lack of privacy protection and transparency around user data, along with the lack of supporting evidence among available apps and potential for misleading content, all raise concerns about the most accessible public facing apps and highlight the need for a way to evaluate apps beyond app store metrics.
We employed a framework for app assessment that is research based and entirely reproducible, paving the way for future analyses of health apps and providing a tool to help clinicians, patients, and the wider public reap the benefits of digital health. All of our results are available to the public on our database that is informed by our evaluation model. Recognizing the limitations of this study, we regularly update our database to reflect the changing nature of available apps and emergence of new ones. We encourage crowd-sourcing and collaboration around app evaluation in order to provide clarity amidst the profusion of available apps for end users, ultimately equipping them to make an informed choice around an app to help them meet their goals.
Availability of data and materials
The full dataset generated and analyzed during the current study is available from the corresponding author upon request. App evaluations are also published on our database of mental health apps (https://apps.digitalpsych.org).
Brainwaves Psychological. App Store. 2020. https://apps.apple.com/gb/app/brainwaves-psychological/id1264799896.
Bauer M, Glenn T, Monteith S, Bauer R, Whybrow PC, Geddes J. Ethical perspectives on recommending digital technology for patients with mental illness. Int J Bipolar Disord. 2017;5(1):6.
Bauer M, Glenn T, Geddes J, Gitlin M, Grof P, Kessing LV, et al. Smartphones in mental health: a critical review of background issues, current status and future concerns. Int J Bipolar Disord. 2020;8(1):2.
Baumel A. Online emotional support delivered by trained volunteers: users’ satisfaction and their perception of the service compared to psychotherapy. J Ment Health. 2015;24(5):313–20.
Baumel A, Schueller SM. Adjusting an available online peer support platform in a program to supplement the treatment of perinatal depression and anxiety. JMIR Ment Health. 2016;3(1):e11.
Baumel A, Tinkelman A, Mathur N, Kane JM. Digital Peer-Support Platform (7Cups) as an adjunct treatment for women with postpartum depression: feasibility, acceptability, and preliminary efficacy study. JMIR MHealth UHealth. 2018;6(2):e38.
The Bipolar Bear Bonacorso. App Store. 2020. https://apps.apple.com/us/app/the-bipolar-bear-bonacorso/id1185944061.
Bergin A, Davies EB. Technology Matters: Mental health apps—separating the wheat from the chaff. Child Adolesc Ment Health. 2020;25(1):51–3.
Bipolar Test: Personality Quiz. App Store. 2020. https://apps.apple.com/us/app/bipolar-test-personality-quiz/id1126273769.
Bopp JM, Miklowitz DJ, Goodwin GM, Stevens W, Rendell JM, Geddes JR. The longitudinal course of bipolar disorder as revealed through weekly text messaging: a feasibility study. Bipolar Disord. 2010;12(3):327–34.
Chaudhry BM. Daylio: mood-quantification for a less stressful you. mHealth. 2016;2:89.
Cohen AB, Mathews SC, Dorsey ER, Bates DW, Safavi K. Direct-to-consumer digital health. Lancet Digit Health. 2020;2(4):e163–5.
Daus H, Kislicyn N, Heuer S, Backenstrass M. Disease management apps and technical assistance systems for bipolar disorder: Investigating the patients’ point of view. J Affect Disord. 2018a;229:351–7.
Daus H, Kislicyn N, Heuer S, Backenstrass M. Disease management apps and technical assistance systems for bipolar disorder: Investigating the patients´ point of view. J Affect Disord. 2018b;229:351–7.
Dehling T, Gao F, Schneider S, Sunyaev A. Exploring the Far side of mobile health: information security and privacy of mobile health apps on iOS and Android. JMIR MHealth UHealth. 2015;3(1):e8.
Depp CA, Mausbach B, Granholm E, Cardenas V, Ben-Zeev D, Patterson TL, et al. Mobile interventions for severe mental illness: design and preliminary data from three approaches. J Nerv Ment Dis. 2010;198(10):715–21.
Faurholt-Jepsen M, Frost M, Ritz C, Christensen EM, Jacoby AS, Mikkelsen RL, et al. Daily electronic self-monitoring in bipolar disorder using smartphones—the MONARCA I trial: a randomized, placebo-controlled, single-blind, parallel group trial. Psychol Med. 2015;45(13):2691–704.
Faurholt-Jepsen M, Torri E, Cobo J, Yazdanyar D, Palao D, Cardoner N, et al. Smartphone-based self-monitoring in bipolar disorder: evaluation of usability and feasibility of two systems. Int J Bipolar Disord. 2019;7(1):1.
Faurholt-Jepsen M, Frost M, Busk J, Christensen EM, Bardram JE, Vinberg M, et al. Differences in mood instability in patients with bipolar disorder type I and II: a smartphone-based study. Int J Bipolar Disord. 2019;7(1):5.
Felton CJ, Stastny P, Shern DL, Blanch A, Donahue SA, Knight E, et al. Consumers as peer specialists on intensive case management teams: Impact on client outcomes. Psychiatr Serv. 1995;46(10):1037–44.
Fortuna KL, DiMilia PR, Lohman MC, Bruce ML, Zubritsky CD, Halaby MR, et al. Feasibility, acceptability, and preliminary effectiveness of a peer-delivered and technology supported self-management intervention for older adults with serious mental illness. Psychiatr Q. 2018;89(2):293–305.
Gliddon E, Barnes SJ, Murray G, Michalak EE. Online and mobile technologies for self-management in bipolar disorder: a systematic review. Psychiatr Rehabil J. 2017;40(3):309–19.
Henson P, David G, Albright K, Torous J. Deriving a practical framework for the evaluation of health apps. Lancet Digit Health. 2019;1(2):e52–4.
Hidalgo-Mazzei D, Nikolova VL, Kitchen S, Young AH. Internet-connected devices ownership, use and interests in bipolar disorder: from desktop to mobile mental health. Digit Psychiatry. 2019;2(1):1–7.
Huckvale K, Venkatesh S, Christensen H. Toward clinical digital phenotyping: a timely opportunity to consider purpose, quality, and safety. NPJ Digit Med. 2019;2:21.
Jacobson NC, Weingarden H, Wilhelm S. Digital biomarkers of mood disorders and symptom change. Npj Digit Med. 2019;2(1):1–3.
Lagan S, Aquino P, Emerson MR, Fortuna K, Walker R, Torous J. Actionable health app evaluation: translating expert frameworks into objective metrics. Npj Digit Med. 2020;3(1):1–8.
Larsen ME, Nicholas J, Christensen H. Quantifying app store dynamics: longitudinal tracking of mental health apps. JMIR MHealth UHealth. 2016;4(3):e96.
Levine DM, Co Z, Newmark LP, Groisser AR, Holmgren AJ, Haas JS, et al. Design and testing of a mobile health application rating tool. Npj Digit Med. 2020;3(1):1–7.
Martinengo L, Van Galen L, Lum E, Kowalski M, Subramaniam M, Car J. Suicide prevention and depression apps’ suicide risk assessment and management: a systematic assessment of adherence to clinical guidelines. BMC Med. 2019;17(1):231.
Matthews M, Abdullah S, Murnane E, Voida S, Choudhury T, Gay G, et al. Development and evaluation of a smartphone-based measure of social rhythms for bipolar disorder. Assessment. 2016;23(4):472–83.
McHugh ML. Interrater reliability: the kappa statistic. Biochem Medica. 2012;22(3):276–82.
Measure Health. App Store. 2020. https://apps.apple.com/us/app/measure-health/id1334243207.
Mercurio M, Larsen M, Wisniewski H, Henson P, Lagan S, Torous J. Longitudinal trends in the quality, effectiveness and attributes of highly rated smartphone health apps. Evid-Based Mental Health. 2020;23(3):107–11.
Monteith S, Glenn T, Geddes J, Whybrow PC, Bauer M. Big data for bipolar disorder. Int J Bipolar Disord. 2016;4(1):10.
Nicholas J, Larsen ME, Proudfoot J, Christensen H. Mobile Apps for bipolar disorder: a systematic review of features and content quality. J Med Internet Res. 2015;17:8.
Nicholas J, Boydell K, Christensen H. Beyond symptom monitoring: consumer needs for bipolar disorder self-management using smartphones. Eur Psychiatry. 2017;44:210–6.
Ondersma SJ, Walters ST. Clinician’s Guide to Evaluating and Developing eHealth Interventions for Mental Health. Psychiatr Res Clin Pract. 2020. https://doi.org/10.1176/appi.prcp.2020.20190036.
Ortiz A, Grof P. Electronic monitoring of self-reported mood: the return of the subjective? Int J Bipolar Disord. 2016;4(1):28.
Owen JE, Kuhn E, Jaworski BK, McGee-Vincent P, Juhasz K, Hoffman JE, et al. VA mobile apps for PTSD and related problems: public health resources for veterans and those who care for them. MHealth. 2018;4:12.
Rowland TA, Marwaha S. Epidemiology and risk factors for bipolar disorder. Ther Adv Psychopharmacol. 2018;8(9):251–69.
Moodtrack Social Diary. App Store. 2020. https://apps.apple.com/us/app/moodtrack-social-diary/id549251057.
Torous J, Powell AC. Current research and trends in the use of smartphone applications for mood disorders. Internet Interv. 2015;2(2):169–73.
Unhappy Wallpapers. App Store. 2020. https://apps.apple.com/us/app/unhappy-wallpapers/id1170714938.
Wisniewski H, Liu G, Henson P, Vaidyam A, Hajratalli NK, Onnela J-P, et al. Understanding the quality, effectiveness and attributes of top-rated smartphone health apps. Evid Based Ment Health. 2019;22(1):4–9.
Wisniewski H, Liu G, Henson P, Vaidyam A, Hajratalli NK, Onnela JP, Torous J. Understanding the quality, effectiveness and attributes of top-rated smartphone health apps. Evid-Based Mental Health. 2019;22(1):4–9.
Young AS, Cohen AN, Niv N, Nowlin-Finch N, Oberman RS, Olmos-Ochoa TT, et al. Mobile phone and smartphone use by people with serious mental illness. Psychiatr Serv Wash DC. 2020;71(3):280–3.
This study has been supported by the generosity of the Argosy Foundation.
This study has been supported by the generosity of the Argosy Foundation.
Ethics approval and consent to participate
Consent for publication
JT reports unrelated funding from Otsuka.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Lagan, S., Ramakrishnan, A., Lamont, E. et al. Digital health developments and drawbacks: a review and analysis of top-returned apps for bipolar disorder. Int J Bipolar Disord 8, 39 (2020). https://doi.org/10.1186/s40345-020-00202-4
- Bipolar disorder