Abstract
Background: The number and diversity of employee mental health programs (EMHPs), solutions employers offer to their workforce to improve mental health, have expanded rapidly in recent years, driven by advancements in digital technology and increased global awareness of employee mental health. This dynamic has resulted in a diverse and nontransparent EMHP landscape. While existing taxonomies address specific aspects of mental health programs, a comprehensive taxonomy for classifying EMHPs in more detail remains absent. Establishing such a taxonomy would benefit researchers and practitioners by providing a common standard for categorizing EMHPs and thereby enhance transparency.
Objective: This research aimed to develop and evaluate a comprehensive taxonomy to holistically classify EMHPs, providing a practical and standardized tool for various target groups to categorize, develop, and select EMHPs.
Methods: A thorough taxonomy development process with 4 iterations was applied. The first 2 iterations used conceptual-to-empirical approaches and involved scoping reviews to identify relevant dimensions and characteristics of EMHPs. The latter 2 iterations used empirical-to-conceptual approaches and included semistructured qualitative interviews. The third iteration, involving employee interviews, aimed to identify further dimensions and characteristics of EMHPs to develop the initial taxonomy. During the fourth iteration, 17 international experts were interviewed to refine and validate the initial taxonomy. After the fourth iteration, the taxonomy was evaluated by applying it to 3 real-world EMHPs through a focus group with 5 experts to ensure that all ending conditions and the evaluation goals were met. The interrater reliability was analyzed using the proportion of observed agreement and Fleiss κ.
Results: The resulting taxonomy comprises 2 metadimensions, 21 dimensions, and 69 characteristics, offering a standardized framework for EMHP classification and analysis. Experts successfully applied the taxonomy to classify 3 selected EMHPs, resulting in an overall proportion of observed agreement of 85% and a Fleiss κ of 66%. Across dimensions, the proportion of observed agreement ranged from 64% to 100%, with Fleiss κ ranging from 20% to 100% (P values ranging from P=.004 to P<.001).
Conclusions: This taxonomy contributes to establishing a common standard for holistic EMHP classification. It benefits both mental health researchers and practitioners in fostering transparency and serves as a structured tool for EMHP analysis. The taxonomy enables researchers to conduct relevant future research, including the systematic identification of EMHP archetypes. In practice, the taxonomy can guide providers in market gap identification and EMHP development, inform employers in decision-making, and assist policymakers in setting up targeted support mechanisms for EMHP implementation.
doi:10.2196/67752
Keywords
Introduction
Background
Deteriorating mental health poses a major global challenge [], particularly affecting the working population, which represents a substantial share of global society [,]. As a result, employee mental health has gained increasing attention from both research and society in recent years [-]. Employers are increasingly acknowledging the relevance of employee mental health and providing targeted support. In response, the number and diversity of employee mental health programs (EMHPs)—defined here as solutions employers offer to their employees to sustain or regain good mental health []—have expanded rapidly [-]. This evolution has been largely driven by digital technology [-]. Numerous new players have entered the market with technology-based EMHPs [], including several apps, platforms, and novel artificial intelligence–enabled tools that address employees’ mental well-being [].
Transparency on available and examined programs is paramount as researchers investigate different aspects of EMHPs, such as their effectiveness and use patterns [,-]. Metareviews, for example, often focus on specific EMHP types, such as digital ones [,,]. Despite the presence of numerous segmentation criteria, there is still no widely accepted framework with standardized definitions to clearly describe or classify EMHPs. Furthermore, both employer representatives responsible for employee mental health and employees themselves should have access to better resources to understand what programs are available and suitable for their needs []. Developing a comprehensive taxonomy to categorize these programs across multiple relevant criteria would enhance transparency, support informed decision-making, and improve accessibility for all stakeholders.
Prior Work
Currently, few taxonomies exist for classifying mental health programs—particularly EMHPs—and those that do typically address only specific aspects rather than providing a comprehensive, holistic framework. To illustrate, Muñoz et al [] present a taxonomy to classify mental health interventions by delivery mode. Similarly, Liverpool et al [] review different digital delivery modes of youth mental health interventions. Gagnon et al [] and Pineda et al [] developed taxonomies with 4 and 6 dimensions, respectively, each representing a criterion or parameter, for classifying digital mental health interventions (DMHIs). These taxonomies enabled a more multidimensional approach to programs, moving beyond a single-perspective approach. Other taxonomies include Lukka and Palva’s [] classification of DMHIs based on gamification levels and the stepped care model of Ferrari et al [] for classifying video game–based interventions targeting young people. Two additional frameworks have recently been published. Bradley et al [] propose a classification system to guide users in choosing suitable DMHIs, using a 6-statement decision aid, in which each statement represents a relevant dimension of DMHIs. Hopkin et al [] offer a framework with 8 dimensions for categorizing digital mental health technologies (DMHTs). Although these 2 taxonomies offer more comprehensive structures, each encompassing more than 5 dimensions, they address general digital programs and do not account for the specific needs of EMHPs. More broadly, existing taxonomies—whether focused on digital or nondigital programs—tend to overlook occupational mental health contexts and fail to consider dimensions particularly relevant for EMHPs. One exception is the work by David et al [], which presents an approach to occupational mental health for health care workers focusing on distinct mental health stages. This framework is derived from the integrated approach to workplace mental health by LaMontagne et al []. However, this approach does not classify EMHPs along several dimensions. The newer taxonomy by Thomas et al [] specifically addresses EMHPs, classifying them along 3 dimensions: primary purpose, delivery agent location, and latitude in providing. While this taxonomy provides a valuable initial structure for EMHP classification, it lacks the breadth to capture a wider range of relevant dimensions that consider other critical aspects of EMHPs.
Objectives
To address the limited comprehensiveness of existing taxonomies for EMHPs, we aimed to (1) develop a comprehensive yet concise taxonomy for classifying EMHPs along multiple dimensions, and (2) evaluate the taxonomy by applying it to 3 selected real-world EMHPs.
Methods
Study Context
This study forms part of a broader research endeavor by the authors’ research team, which investigates various facets of EMHPs, including employee preferences, use behavior, influencing factors for use, and the overall landscape and types. A clear understanding of EMHP types is essential for conducting transparent and insightful analyses of the aforementioned aspects. Given the lack of a comprehensive taxonomy that holistically classifies EMHPs, we initiated this study to develop such a framework.
Taxonomy Development Process
We followed the thorough and well-established taxonomy development process outlined by Nickerson et al [] and the widely adopted extension proposed by Kundisch et al [] (). The process began with the preparation steps, including the definition of metacharacteristics, ending conditions, and evaluation goals. We then conducted the core development process, completing 4 iterations. Finally, we evaluated the resulting taxonomy.

Preparation Steps
Metacharacteristics represent the foundational components of taxonomy design, including objects, dimensions, and characteristics. To ensure conceptual clarity, we defined the metacharacteristics at the outset of the study. Drawing from the research context, we defined the objects of this taxonomy as all possible EMHPs, the dimensions as the criteria or parameters by which EMHPs can be described and classified, and the characteristics as the specific attributes or options that can be attributed to each dimension. Ending conditions refer to defined states that indicate when the taxonomy development process can be concluded. We defined 5 subjective and 5 objective ending conditions based on the study by Nickerson et al [] ().
| Ending condition | Description |
| Subjective | |
| Concise | The taxonomy comprises an appropriate number of relevant dimensions to be meaningful while not overwhelming the user with an unnecessarily extensive number of dimensions. |
| Robust | The dimensions and characteristics of the taxonomy allow for meaningful differentiation between EMHPs, ensuring that these distinctions are relevant for users. |
| Comprehensive | All relevant EMHPs can be classified using the taxonomy and relevant characteristics of a random sample of real-world EMHPs are reflected in the taxonomy. |
| Extendable | New dimensions or characteristics can easily be added to the taxonomy to further evolve it if required by landscape dynamics or further research. |
| Explanatory | The dimensions and characteristics of the taxonomy reveal relevant and understandable information about any EMHP that is classified using the taxonomy. |
| Objective | |
| Completeness | At least 1 EMHP is classified under every characteristic of every dimension to ensure that every characteristic of the taxonomy is represented in the real world. |
| No addition in the last iteration | No new dimensions or characteristics were added in the last iteration (last interview of the fourth iteration); if this were not true, further validation of the last change would be required. |
| No merge or split in the last iteration | No dimensions or characteristics were merged or split in the last iteration (last interview of the fourth iteration); if this were not true, further validation of the last change would be required. |
| Uniqueness of dimensions | Every dimension is unique and not repeated, that is, no dimension duplication; otherwise, the taxonomy would contain redundancies. |
| Uniqueness of characteristics | Every characteristic is unique within its dimension, that is, no characteristic duplication within 1 dimension; otherwise, the taxonomy would contain redundancies. |
aEMHP: employee mental health program.
Evaluation goals refer to specific activities a finalized taxonomy should be able to perform. We defined 3 evaluation goals in line with our research objectives and based on the study by Kundisch et al [] ().
| Evaluation goal | Description |
| Describing | The taxonomy can be used to describe EMHPs by several characteristics across multiple dimensions, meaning users can present relevant information about any EMHP using the taxonomy. |
| Classifying | The taxonomy can be used to classify EMHPs by assigning at least 1 characteristic per each dimension, meaning users can comprehensively describe any EMHP, presenting information for every dimension of the taxonomy. |
| Analyzing | The taxonomy can be used to analyze EMHPs based on similarities or differences to other EMHPs across dimensions and characteristics, meaning users can compare different EMHPs with each other and detect the most relevant similarities or differences. |
aEMHPs: employee mental health programs.
Core Taxonomy Development Process
Overview
The first 2 iterations of the core taxonomy development process used conceptual-to-empirical approaches, involving 2 scoping reviews according to the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses Extension for Scoping Reviews) guidelines [] to generate first codes for the initial taxonomy. The final 2 iterations used empirical-to-conceptual approaches with semistructured qualitative interviews to identify additional codes and to refine and validate the taxonomy.
First Iteration
The first scoping review (first iteration) aimed to identify relevant taxonomies on general mental health programs, including EMHPs, and was conducted on January 2, 2024, using the following 2 search queries on PubMed:
- ((taxonomy[MeSH Terms]) OR (framework[MeSH Terms]) OR (structure[MeSH Terms]) OR (classification[MeSH Terms]) OR (categorization[MeSH Terms])) AND ((mental health intervention[MeSH Terms]) OR (mental health program[MeSH Terms]))
- ((taxonomy[Title/Abstract]) OR (framework[Title/Abstract]) OR (structure[Title/Abstract]) OR (classification[Title/Abstract]) OR (categorization[Title/Abstract])) AND ((mental health intervention*[Title/Abstract]) OR (mental health program*[Title/Abstract]))
The first review’s PRISMA-ScR checklist [], detailed screening process (), and overview of the literature records () are provided for further details.
Second Iteration
The second scoping review (second iteration) aimed to identify relevant studies specifically on EMHPs and was initially conducted on January 12, 2023, with the literature records having been analyzed in January 2024, using the following 2 search queries on PubMed:
- ((mental health[MeSH Terms]) OR (psychology[MeSH Terms])) AND ((employee assistance program[MeSH Terms]) OR (employer intervention[MeSH Terms]) OR (workplace intervention[MeSH Terms])) OR ((mental health[MeSH Terms]) AND (workplace[MeSH Terms]) AND (health promotion[MeSH Terms]))
- (mental health[Title/Abstract]) AND ((employee assistance program[Title/Abstract]) OR (employer intervention[Title/Abstract]) OR (workplace intervention[Title/Abstract]))
For both reviews (first and second iterations), we followed established procedures to identify the respective search terms. We conducted initial paper searches to identify relevant papers and derive established and widely used keywords and MeSH terms. We subsequently discussed these terms within our entire author team—including SM and LF, who have extensive experience conducting scoping reviews and have published more than 20 peer-reviewed papers—prior to executing the final searches. In 2 coding rounds, authors BS and RH systematically screened the resulting papers from both reviews and assigned codes to text segments representing potential dimensions and characteristics of EMHPs. The final set of codes informed the initial taxonomy. For the second review, similar documentation is provided as for the first ( and ), detailing how codes were derived and incorporated into the taxonomy.
Third Iteration
During the third iteration, we conducted interviews with a representative sample of employees, selected to reflect diversity across characteristics, such as age, gender, and education. We recruited the participants through purposive sampling from the broader network of all authors to ensure representativeness. These interviews were conducted from February to March 2023 via phone or video calls or in person and contributed to 2 research studies conducted by our research team, while only 1 part of the factually anonymized transcripts was analyzed for this study. For this study, the purpose of the interviews was to identify relevant dimensions and characteristics of EMHPs to inform the initial taxonomy, whereas for the other study, the purpose was to identify relevant EMHP types, as well as facilitators of and barriers to using EMHPs. The findings of the other study were published in a peer-reviewed paper on employee preference and use behavior by Sevov et al []. The EMHP dimensions and characteristics for this study were derived based on thematic analysis according to Braun and Clarke [], which was conducted in 2 coding rounds by authors BS and RH. To ensure transparency and methodological rigor, we provide additional details, including the interview guide (), the COREQ (Consolidated Criteria for Reporting Qualitative Research) checklist [], and an overview of the participant sample ().
Fourth Iteration
During the fourth iteration, we conducted interviews with employee mental health experts to refine and validate the initial taxonomy. We recruited experts from 3 groups: first, relevant representatives from employers offering EMHPs (referred to as employers); second, representatives from providers of EMHPs (providers); and third, academic key opinion leaders (KOLs) who conduct research in employee mental health and related fields. To ensure geographic and cultural diversity, we systematically recruited employers and providers from multiple countries, including Germany, the United Kingdom, France, the United States, and Japan. Employers were identified through LinkedIn keyword search per country (“employee mental health” and “occupational mental health”) and were contacted directly. Providers were identified through Google keyword searches in English per country (“employee mental health program provider COUNTRY”), and representatives were contacted using publicly available information. For Germany and France, these searches were additionally conducted in the respective local languages. KOLs were selected based on publication volume in employee mental health research, identified through a PubMed keyword search (“(employee mental health[Title/Abstract]) OR (employee mental health program[Title/Abstract]) OR (employee assistance program[Title/Abstract])”), and were contacted using publicly available email addresses. In total, we contacted 73 experts: 43 employers, 20 providers, and 10 KOLs.
These interviews were conducted from January to April 2024 via video calls and involved presenting and discussing the taxonomy. Using an iterative approach, we revised the taxonomy after each interview based on expert feedback and presented the updated version to the next interviewee. This process continued until both the predefined ending conditions and the minimum requirements for a representative expert sample were met, concluding after the 17th interview. The final expert sample included 5 participants from Germany, 3 from the United States, 3 from the United Kingdom, 2 from France, 2 from Japan, 1 from Sweden, and 1 from Mexico. Of these, 8 were employers, 5 were providers, and 4 were KOLs. Following the final interview, we reviewed all transcripts within the author team and made final adjustments to the taxonomy on wording based on the interview inputs to ensure clarity and consistency. Additional details related to this iteration are provided, including the interview guide (), the COREQ checklist [], and the participant sample ().
Taxonomy Evaluation
Evaluation Design
After the fourth iteration, we conducted a focus group to evaluate the taxonomy—a well-established method for taxonomy evaluation []. Using the 3 predefined evaluation goals, 5 experts participated in the evaluation, applying the taxonomy to 3 established real-world EMHPs. The evaluation design was carefully defined based on the framework for taxonomy evaluation proposed by Szopinski et al () [].

EMHP Selection
The selected EMHPs were established programs that had been available on the market for at least 3 years. This means that they were publicly available, for example, via a website, generally recognized, that is, among the top results in online or app store searches, and adopted and offered by multiple organizations, as evidenced by client listings on provider websites. Importantly, none of the selected EMHPs were affiliated with experts from the fourth iteration. We also selected these programs to ensure diversity: one was a fully digital online platform for employee mental health, another a purely app-based mindfulness program, and the third a program that featured digital and nondigital components focused on coaching and counseling.
Expert Selection
The experts were identified through purposive sampling to ensure that all participants were EMHP specialists with practitioner background and none of them had been involved in the fourth iteration. The selected EMHP experts represented diverse educational backgrounds, primarily in psychology or business economics, with several holding a PhD and having experience in scientific research. To ensure adequate program-specific insight, 1 representative from each of the 3 classified EMHPs participated in the focus group. During the moderated session, the experts first reflected on the taxonomy’s robustness, comprehensibility, and wording. They then independently applied the taxonomy to 1 of the 3 real-world EMHPs by selecting relevant characteristics per dimension, which was followed by a group discussion on the taxonomy and the first classification []. After the focus group, the same experts were asked to apply the taxonomy to the remaining 2 EMHPs in written form to ensure independent and unbiased classification.
Qualitative Analysis
The qualitative reflection of the taxonomy during the focus group comprised explicit expert input on the subjective ending conditions and the understandability of the taxonomy. The experts debated whether more or less dimensions or characteristics should have been added and whether the presented characteristics were meaningful and clear to users. They weighed the advantages and disadvantages of possible changes and provided explicit and consensual conclusions on these potential adjustments. Authors BS and LF conducted the focus group and reviewed the field notes and the transcript after the session to qualitatively analyze whether the subjective ending conditions were met based on explicit expert statements and whether the experts were able to use the taxonomy to classify EMHPs based on the classification of the first EMHP and the subsequent group discussion.
Interrater Analysis
We assessed interrater reliability among the focus group experts regarding their classifications using the proportion of observed agreement and Fleiss κ []. We used Fleiss’ approach as it represents an established extension of Cohen κ that can be applied when having a constant number of more than 2 raters assessing nominal or categorical variables, which was the case in our taxonomy evaluation [,]. Characteristics were coded as binary variables, that is, 1=selected, 0=not selected, to meet the mutual exclusivity condition required for Fleiss κ analysis []. The proportion of observed agreement and κ were calculated for each dimension. We then computed the unweighted average across dimensions to determine the overall proportion of observed agreement and overall κ. This analysis provided empirical data that complemented the qualitative focus group discussions and supported the conclusion of the taxonomy evaluation against the predefined evaluation goals. Additional details of the evaluation process are provided, including the COREQ checklist [] and the ACCORD (Accurate Consensus Reporting Document) checklist [].
Ethical Considerations
The ethics committee of Witten/Herdecke University reviewed and approved this research project without raising any ethical concerns (S-317/2023). Voluntary and informed consent was obtained in advance and in writing from all participants of the qualitative interview studies and the focus group, covering both participation and publication of study findings in a peer-reviewed paper. The interview studies and the focus group adhered to established ethical scientific research standards and complied with the General Data Protection Regulation. The recordings of the qualitative interviews and the focus group session were transcribed in a factually anonymized way, ensuring that individual participants could not be identified—or only with disproportionate effort []. The participants of the interview studies and the focus group received no monetary compensation for their involvement.
Results
Final Taxonomy
The final taxonomy is presented as a morphological box comprising 2 metadimensions, that is, distinct categories of dimensions, 21 dimensions (Dn) and 69 characteristics (Cn.m) (). A morphological box is defined as “a structured method for systematically looking at key characteristics or parameters of a solution [ie, dimensions] and the realistic options for each parameter [ie, characteristics]” []. This format offers an intuitive and systematic way to visualize the taxonomy, allowing users to mark applicable characteristics of any EMHP and generate a visual classification. To avoid misinterpretation, all dimensions are described in detail (). The first metadimension (D1-D14) applies to all mental health programs, while the second one (D15-D21) captures EMHP-specific aspects. Classification across dimensions is based on the nature of the EMHP, that is, the specific program or module being classified, with several dimensions particularly relevant for differentiating digital EMHPs. Although many characteristics within these dimensions (eg, D10, D11, D13, and D15) predominantly apply to digital EMHPs, they are not exclusive to them. Following Nickerson et al [], the taxonomy includes dimensions with mutually exclusive characteristics, meaning only 1 characteristic can apply per dimension. However, certain dimensions (D1, D2, D3, D7, D9, and D16) are not mutually exclusive, allowing multiple characteristics to be selected simultaneously to avoid loss of information and to account for the complex nature of EMHPs []. For example, many EMHPs address multiple mental health issues, and it may be particularly valuable to capture the specific combination of issues targeted.


Dimensions and Characteristics of the Taxonomy
Each iteration of the taxonomy development process contributed to the final taxonomy (). The first 3 iterations independently yielded relevant dimensions and characteristics that formed the initial taxonomy. The fourth iteration then refined the initial taxonomy and provided valuable insights. While 2 new dimensions were added, the experts consistently confirmed most dimensions and their related characteristics of the initial taxonomy. Only the wording was refined or minor changes, such as adding 1 characteristic, were made and validated during the subsequent interviews. As some dimensions sparked debates, we examined the different expert views and relied on consensus and fit with our research objectives to finally design the respective dimension.
| Iteration | Key results |
| First iteration—scoping review: taxonomies |
|
| Second iteration—scoping review: EMHPs |
|
| Third iteration—semistructured interviews: employees |
|
| Fourth iteration—semistructured interviews: experts |
|
aEMHPs: employee mental health programs.
All 21 dimensions of the final taxonomy are presented in the following, each accompanied by a concise explanation and, where relevant, insights from the expert interviews.
The Purpose (D1) of an EMHP defines the program’s core objective. Experts debated how the characteristics reflect programs addressing chronic mental health conditions. Based on expert consensus, active management of chronic mental illness was categorized under Treatment (C1.2), since such conditions are typically treated regardless of the temporary severity and the frequency and duration of formal treatment. The characteristics of this dimension are therefore based on the mental health stage of the individual, representing a framework that is both concise and established in the literature [,,].
The Targeted mental health issue (D2) specifies which concrete conditions an EMHP addresses. Experts discussed whether to define issues by symptoms or diagnoses. We purposely focused on diagnosable conditions according to the International Classification of Diseases, Eleventh Revision (ICD-11) by the World Health Organization while also including certain symptoms explicitly listed in ICD-11 when particularly relevant []. Several experts suggested including other issues as characteristics. This represented a trade-off between robustness and conciseness, as we targeted meaningful differentiation without listing too many characteristics. While no explicit cutoff point was defined, we prioritized the characteristics presented in the final taxonomy based on the frequency of mental health issues targeted in existing EMHPs and the input from literature and the experts. Besides, geographic variations in relevance of targeted mental health issues emerged from the expert interviews: in Japan, for example, substance use was considered seldom while anger management was rated important, and in the United States, grief and loss, suicidal ideation, and neurodivergence were considered more relevant. Ultimately, these mental health issues were categorized under Other based on their lower prevalence in the analyzed EMHPs and the consolidated expert input.
The Therapeutic approach (D3) indicates whether an EMHP is based on established therapeutic approaches, that is, clearly defined and well-researched approaches. Experts agreed on including Behavioral (C3.1), Psychodynamic (C3.2), and Pharmacological therapy (C3.3), confirming cognitive behavior therapy as the most prevalent in occupational contexts, consistent with metareview findings [,,,]. As with D2, for D3, several other examples were stated by the experts. While single experts argued for the inclusion of holistic therapy, systemic therapy, hypnotherapy, and other concrete examples, these less prevalent approaches were categorized under Other (C3.4). We also considered whether coaching—or related approaches such as counseling or consulting—should be included as its own therapeutic approach. We chose not to include this characteristic in the initial taxonomy, as coaching, counseling, or consulting encompasses a wide range of formats and does not represent clearly defined therapeutic approaches. Instead, coaches may draw on elements from various established therapeutic approaches in their coaching sessions, which the taxonomy can accommodate. For example, if a program offers coaching that is explicitly based on behavioral therapy, the characteristic Behavioral therapy including cognitive (C3.1) can be selected. In addition to the included approaches, we added the characteristic None (C3.5) to capture EMHPs that provide information or raise awareness on employee mental health without a therapeutic approach, for example, through leaflets, books, or awareness sessions. This refinement was proposed by one expert and subsequently validated by all other experts.
The Scientific evidence (D4) captures whether peer-reviewed studies exist for the specific EMHP, focusing on the program itself rather than its underlying therapeutic approach, since delivery can influence effectiveness. The Focus (D5) distinguishes between EMHPs that concentrate primarily on mental health and those that address broader aspects of employee well-being, such as physical health alongside mental health. The Delivery mode (D6) describes how users access and use the program, particularly whether digital components are involved. The Interaction form (D7) specifies whether and how EMHP users interact with others during program use. The Human guidance/facilitation (D8) indicates whether and to what extent EMHP use is guided by a human. The Qualification of human guide/facilitator (D9) details the credentials of a human guide, such as officially approved licenses and certifications or professional training programs, which determine the reliability and suitability of an EMHP. The Degree of personalization (D10) reflects the extent to which EMHP content or delivery is tailored to individual users. The Gamification level (D11) indicates the extent to which gaming features are present in an EMHP. Although one expert raised concerns about this dimension, suggesting that gamification might trivialize mental health issues and undermine program objectives, the dimension was retained based on consensus among other experts, the growing use of gamified EMHPs [,], and evidence indicating that gamification can lead to higher intention to use, particularly among men []. The Activity level of user (D12) describes the degree of activity required when using an EMHP. The Availability (D13) specifies whether EMHP content is accessible on demand or bound to fixed times. The Frequency (D14) captures how often an EMHP is delivered. The Location of use (D15) identifies where an EMHP is used, such as the workplace or externally. Although one expert questioned this dimension’s relevance, both previous research and the employee interviews suggest that the location can influence EMHP use rates due to stigmatization and anonymity concerns []. The Target group level (D16) specifies the level of the social ecological model [], meaning whether an EMHP targets individual employees, groups such as departments and project teams, or entire organizations. Organization-wide antistigma awareness programs are a prominent example of the latter []. The Targeted hierarchy level (D17) describes which employees are addressed by formal role, with many EMHPs specifically targeting managers or executives, who are all subsumed under C17.2. The Target group by profession/function (D18) indicates whether an EMHP is tailored to specific professions or functions. The Provider of solution (D19) identifies who develops or delivers an EMHP. The Monetary cost coverage by employer (D20) specifies whether and to what extent the employer covers the monetary costs of an EMHP. The Recognition as work time by employer (D21) indicates whether participation in an EMHP is counted as work time. This dimension was added based on one expert’s view suggesting that this strongly influences use. For both D20 and D21, the defining characteristics are shaped by the employer offering the EMHP rather than the program itself. Nonetheless, both dimensions were included because experts and literature highlight their relevance for use [], and many EMHPs predefine a single characteristic by design.
Application and Evaluation of the Taxonomy
The taxonomy was evaluated through the focus group with 5 experts, which generated valuable qualitative insights from the discussion and quantitative empirical data from the interrater analysis of the classifications of the 3 established German EMHPs: the holistic digital mental health platform “Likeminded,” the mindfulness mobile app “7Mind,” and the “Coaching & Counseling” service from the “Fuerstenberg Institut.”
At the beginning of the focus group session, the experts reflected on the taxonomy and confirmed that it provides an appropriate overview of relevant EMHP dimensions and a meaningful level of detail for analysis. The reflection further indicated that the balance between comprehensiveness and conciseness was well achieved. It also showed that users of the taxonomy need to familiarize themselves with the dimension descriptions to ensure a consistent understanding. The discussion of the first classification further demonstrated that reliable use of the taxonomy requires both a solid understanding of its dimensions and sufficient knowledge of the programs being classified.
The interrater analysis yielded a high overall proportion of observed agreement of 85%, interpreted according to Graham et al [], and indicated a substantial strength of agreement with a κ of 66%, interpreted following Landis and Koch []. Across dimensions, the proportion of observed agreement ranged from 64% to 100% and κ ranged from 20% to 100%. The results were statistically significant, with P values ranging from P=.004 to P<.001.
Based on the qualitative reflections and the successful classification of the 3 EMHPs with high overall agreement measures, we concluded that the taxonomy was concise, robust, comprehensive, extendible, and explanatory, which reconfirmed that the defined subjective ending conditions were met []. The successful classifications also demonstrated that the taxonomy can be applied to describe, classify, and analyze EMHPs, fulfilling the predefined evaluation goals []. Additional details on the evaluation results, including the 3 classifications and a table with the key statistical measures of the interrater analysis per dimension, are provided ().
Discussion
Principal Findings
No taxonomy is ever definitive [] or can comprehensively capture all possible dimensions and characteristics due to the inherent complexity and evolving nature of EMHPs. Nonetheless, our proposed taxonomy provides a robust and comprehensive framework for holistically classifying the existing and emerging landscape of EMHPs, while remaining generally extendible, which is an important aspect of a useful taxonomy []. To achieve this, we carefully considered trade-offs in the inclusion of dimensions and characteristics, especially between comprehensiveness, robustness, and conciseness []. The high overall proportion of observed agreement and the substantial interrater reliability achieved during evaluation [,] corroborate the robustness of our taxonomy.
Variation in the proportion of observed agreement and κ across dimensions can be partly attributed to the number of available characteristics and whether they are mutually exclusive. This is exemplified by the dimension Targeted mental health issue (D2), which yielded the lowest proportion of observed agreement, with 64%, and the lowest κ, with 20%, and has the highest number of characteristics, that is, 7, which are not mutually exclusive. While this dimension did not lead to a fundamental discussion among focus group experts, the results indicated that experts have very subjective views on which mental health issues are addressed by a program. When multiple characteristics can be selected, classification outcomes are more likely to diverge, especially when users have varying levels of familiarity with the EMPH being assessed. Accordingly, user knowledge of an EMHP is critical for producing reliable classifications. Users should thoroughly familiarize themselves with a program before applying the taxonomy to ensure accurate and consistent results. In parallel, EMHP providers should clearly communicate the intended scope and design of their programs to support stakeholder understanding.
To ensure the comprehensiveness of our taxonomy, we included all relevant dimensions without exceeding a reasonable number. In doing so, we referred to other published taxonomies with relatively many dimensions, for example, Denecke and May [], Scheider et al [], and Weking et al [] with 18, 18, and 22, respectively. We deliberately grounded our taxonomy in existing research by incorporating relevant frameworks, including the DMHI taxonomy of Gagnon et al [], the game-based DMHI categories by Lukka and Palva [], and the ICD-11 by the World Health Organization [].
Compared with other existing taxonomies, our taxonomy offers a comprehensive structure specifically designed to classify EMHPs and stands out in 2 key ways. First, with the exception of the taxonomies by Thomas et al [] with 3 dimensions and David et al [] and LaMontagne et al [] with 1 dimension each, ours is to the best of our knowledge the only taxonomy explicitly developed for EMHPs rather than for general or other mental health programs. Second, while these other 3 taxonomies comprise 1-3 dimensions, our taxonomy is the only one to capture a broader and more detailed range of EMHP dimensions relevant to both academics and practitioners. This does not diminish the value and purpose of the existing taxonomies, many of which are intentionally focused on specific program scopes, dimensions, or both. The selection of an appropriate taxonomy ultimately depends on the user’s objective; more targeted taxonomies may be preferable when examining a specific aspect of EMHPs or general mental health programs. However, we argue that our taxonomy encompasses most of the dimensions found in other frameworks—particularly those with only 1 or 2 dimensions—as we systematically reviewed and incorporated all relevant taxonomies and frameworks identified during the first iteration of our taxonomy development process. To demonstrate the unique value proposition of our taxonomy, we compared it with other taxonomies with more than 2 dimensions in terms of scope and value proposition (). In this comparison, we also included taxonomies published after concluding but before publishing our study. We did not compare taxonomies with 1 or 2 dimensions in more detail, as these do, by definition, not represent comprehensive taxonomies. Notably, most of the taxonomies we identified and reviewed have been published within the past 5 years.
| Study | Purpose | Program scope | Focus on EMHPs | Number of dimensions | Key dimensions | Value proposition |
| This study | ||||||
| EMHP taxonomy | Providing a comprehensive taxonomy to holistically classify EMHPs | EMHPs | Yes | 21 |
| Comprehensive taxonomy on EMHPs covering multiple dimensions across two metadimensions: (1) General mental health program relevant, and (2) EMHP specific, thereby consolidating various dimensions from existing taxonomies |
| Scoping review 1: search | ||||||
| Burger et al (2020) [] | Providing an overview of the system landscape of electronic mental health interventions for depression to differentiate programs by system type | Electronic mental health interventions for depression | No | 9 |
| Overview covering dimensions describing digital mental health programs across relevant criteria and also presenting the evaluation methods used |
| Clay et al (2020) [] | Providing a framework to identify and categorize core components of mental health stigma interventions in LMICs | Mental health stigma reduction interventions in LMICs | No | 13 |
| Comprehensive framework covering digital and nondigital mental health programs in LMICs identified in scientific studies |
| Gagnon et al (2022) [] | Providing a framework to classify DMHIs | DMHIs | No | 4 |
| Targeted framework classifying DMHIs focusing on technology and delivery method |
| Lukka and Palva (2023) [] | Providing a framework to develop game-based DMHIs | Game-based DMHIs | No | 4 |
| Framework supporting the development of game-based DMHIs, focusing on combining health care delivery and entertainment |
| Pineda et al (2023) [] | Providing an updated taxonomy to categorize literature on and different types of DMHIs for treatment and prevention | DMHIs | No | 6 | The taxonomy presents 6 parameters, that is, dimensions, of DMHIs, which are not labeled; the first dimension presents 4 types of DMHIs:
| Updated taxonomy categorizing the literature on DMHIs for treatment and prevention |
| Scoping review 1: snowballing | ||||||
| Chan et al (2015) [] | Providing input on a possible framework to evaluate mobile mental health apps | Mobile mental health apps | No | 3 | All 3 dimensions with 4-5 subdimensions;
| Proposed components of a framework for finding and evaluating mobile mental health apps that can be used by patients and providers |
| Relevant new taxonomies published after conclusion of this study | ||||||
| Bradley et al (2025) [] | Providing a classification system to support users in deciding on a suitable DMHI | DMHIs | No | 6 |
| Classification system as decision aid empowering users to make an informed choice for a suitable DMHI based on preference |
| Hopkin et al (2025) [] | Providing a framework to categorize DMHTs | DMHTs | No | 8 |
| Framework designed for various stakeholders for categorizing DMHTs and identifying key characteristics of DMHTs |
| Thomas et al (2024) [] | Providing a taxonomy to organize and distinguish workplace mental health offerings | Workplace mental health offerings | Yes | 3 |
| Taxonomy for organizing workplace mental health offerings along 3 dimensions |
aEMHPs: employee mental health programs.
bLMICs: low- and middle-income countries.
cDMHIs: digital mental health interventions.
dDMHTs: digital mental health technologies.
Theoretical and Practical Implications
Our comprehensive taxonomy offers valuable contributions to both research and practice. For researchers, it provides a standardized framework for classifying EMHPs, facilitating metareviews or effectiveness assessments, as in Carolan et al [], and for analyzing program limitations, such as the role of human guidance in digital EMHPs [].
Practitioners also benefit from its structured approach. Providers can identify market gaps or refine their offerings based on EMHP archetypes, for example, derived from the 4 types of DMHIs proposed by Muñoz et al []. Developers may use the taxonomy to design more targeted and effective programs [], while employers can apply it to guide decisions about which EMHPs to offer. Key considerations—such as whether mental health support is offered internally or through an external provider, and the associated cost [,]—can be examined along the taxonomy’s individual dimensions. Employers can also use the taxonomy to align their EMHP selection with the characteristics of their workforce. For example, some professions are dominated by women or men, some organizations employ highly educated professionals, and others have predominantly young employees. Existing research offers insights into how sociodemographic employee groups differ in their preferences for EMHP features [,]. As an example, employers can use the taxonomy to design and conduct internal surveys to assess their employees’ EMHP needs and preferences.
Given their potential to promote mental well-being and contribute to a mentally healthier workforce—and by extension, a healthier society—employers should be encouraged to offer EMHPs, regardless of national legislative requirements. The taxonomy is intended to support more informed and accessible decision-making for employers, while also serving as a resource for policymakers to develop targeted support mechanisms and recommendations for EMHP implementation.
Future Research
The aim of our taxonomy was to contribute to both research and the implementation of EMHPs across all types of employers, including small- and medium-sized enterprises, large corporations, and other employer types such as public organizations. Accordingly, ensuring universal applicability was a key objective, positioning the taxonomy as a potential new standard. Beyond its immediate use, the taxonomy also serves as an appropriate starting point for future research and targeted adaptations for specific application contexts.
One possibility for adaptation involves tailoring the taxonomy to specific geographic or cultural settings. Our findings indicate that the prevalence of mental health issues and the therapeutic approaches used vary across cultures. Moreover, the classification of EMHPs is influenced by cultural context. For example, the dimension Qualification of human guide/facilitator may depend on national regulatory frameworks: while some countries enforce strict certification requirements for mental health professionals, others apply more flexible standards and require lower levels of formal training [,]. Given the well-documented importance and effectiveness of cultural adaptation in mental health program development and implementation [-], we conclude that adapting taxonomies to cultural contexts is both relevant and advisable. Another possibility for adaptation is the refinement of the taxonomy to capture the role of digital technologies in EMHPs in more detail. As digital or hybrid EMHPs become increasingly prevalent [-], additional dimensions could be introduced to reflect the technologies used, such as AI-based systems. With the growing integration of AI-based technology in mental health care [,], it may be valuable to explicitly capture whether and how AI is used within EMHPs, potentially offering higher granularity.
We also see potential for the taxonomy to support future research aimed at identifying EMHP archetypes. While our evaluation revealed notable differences among the classified programs, further studies classifying a larger number of EMHPs, for example, approximately 30 objects [], are needed to uncover consistent patterns and derive robust EMHP archetypes. Exploring the typology of digital EMHPs may be particularly relevant given the rapid emergence and evolution of new digital programs.
Limitations
Despite the thorough taxonomy development process and adherence to established research standards, this study has some typical limitations. First, the taxonomy is based on available literature and subjective expert input, requiring a balance between comprehensiveness and conciseness. As with any taxonomy, one could argue that certain dimensions or characteristics are missing or that some included elements may be less relevant. To mitigate this, we consulted a geographically diverse group of experts, ensuring broad representation and minimizing bias.
Second, although the fourth iteration included experts from 3 distinct groups and 7 countries across 3 continents, 5 of the 17 experts were from Germany. This may have introduced a geographic bias in the validation process, potentially making the taxonomy slightly more applicable for German or European EMHPs. For example, the characteristics included under Targeted mental health issue may reflect regional priorities. A taxonomy designed for other regions of the world might have included a partially different set of mental health issues, such as grief and loss, suicidal ideation, and neurodivergence in North America or anger management in parts of Asia. However, we intentionally chose not to account for country-specific systematic or institutional particularities in the development of our taxonomy. Instead, we relied on global literature and input from geographically diverse experts to determine the most relevant characteristics. We therefore remain confident in the taxonomy’s universal applicability.
Third, although we conducted thorough scoping reviews, it is possible that some relevant publications were missed or that new taxonomies emerged after our research was completed, as was the case with Thomas et al []. To enhance overall transparency, we provide a positionality statement on our research ().
Conclusions
This research contributes to establishing a new common standard for the holistic classification of EMHPs. To the best of our knowledge, the proposed taxonomy represents the first comprehensive and in-depth conceptual framework for systematically investigating the evolving landscape of EMHPs at a universal level. As such, the taxonomy offers value to both researchers and practitioners by fostering transparency and providing a shared foundation for analysis. Future research can build on this taxonomy to improve comparability across studies and support the identification of EMHP archetypes through analyses and comparisons of classifications. In practice, program developers and employers may use the taxonomy as a decision-making tool to guide program design, selection, and implementation, while policymakers may leverage it for setting up support mechanisms for EMHP implementation.
Funding
No external financial support or grants were received from any public, commercial, or not-for-profit entities for the research, authorship, or publication of this article.
Data Availability
Data and materials of this research project, including literature record overviews and participant samples, are made available through the provided multimedia appendices. Further specific data of this research project can be shared upon reasonable request submitted to the corresponding author.
Authors' Contributions
BS and LF provided the conceptualization, design, and methodology of the study. RH, MZ, and SM contributed to the methodology of the study. BS conducted the scoping reviews; analyzed the identified literature records; planned, prepared, and conducted the qualitative interviews; transcribed and analyzed the interview transcripts; created the initial and the final taxonomy; planned, prepared, and conducted the focus group; and conducted the qualitative and the interrater analysis. RH analyzed the identified literature records and the interview transcripts. LF contributed to preparing and conducting the focus group and the qualitative and the interrater analysis. All authors reviewed the initial and the final taxonomy. BS prepared the first draft of the manuscript. All authors reviewed the manuscript. BS edited the manuscript and prepared the final version. All authors approved the final version of the manuscript. LF supervised the research project.
Conflicts of Interest
None declared.
Multimedia Appendix 1
Screening process and final set of literature records of the first iteration.
DOCX File, 107 KBMultimedia Appendix 2
Overview of final set of literature records of the first iteration.
DOCX File, 69 KBMultimedia Appendix 3
Screening process and final set of literature records of the second iteration.
DOCX File, 106 KBMultimedia Appendix 4
Overview of final set of literature records of the second iteration.
DOCX File, 83 KBMultimedia Appendix 5
Relevant part of the interview guide for interviews of the third iteration.
DOCX File, 59 KBMultimedia Appendix 6
Sample of interview participants (employees) of interviews of the third iteration (N=15).
DOCX File, 61 KBMultimedia Appendix 8
Sample of interview participants (experts) of interviews of the fourth iteration (N=17).
DOCX File, 60 KBMultimedia Appendix 9
Results of classification of “Likeminded” platform, “7Mind” app, and “Coaching & Counseling” service of “Fuerstenberg Institut” based on the new employee mental health program taxonomy, and methods and results of the interrater analysis.
DOCX File, 2377 KBChecklist 1
The 22-item PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses Extension for Scoping Reviews) checklist for the first iteration.
DOCX File, 68 KBChecklist 2
The 22-item PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews) checklist for the second iteration.
DOCX File, 66 KBChecklist 3
The 32-item COREQ (Consolidated Criteria for Reporting Qualitative Research) checklist for interviews of the third iteration.
DOCX File, 67 KBChecklist 4
The 32-item COREQ (Consolidated Criteria for Reporting Qualitative Research) checklist for interviews of the fourth iteration.
DOCX File, 66 KBChecklist 5
The 32-item COREQ (Consolidated Criteria for Reporting Qualitative Research) checklist for the focus group.
DOCX File, 66 KBChecklist 6
The 35-item ACCORD (Accurate Consensus Reporting Document) checklist for the focus group.
DOCX File, 76 KBReferences
- Patel V, Saxena S, Lund C, et al. Transforming mental health systems globally: principles and policy recommendations. Lancet. Aug 19, 2023;402(10402):656-666. [CrossRef] [Medline]
- de Oliveira C, Saka M, Bone L, Jacobs R. The role of mental health on workplace productivity: a critical review of the literature. Appl Health Econ Health Policy. Mar 2023;21(2):167-193. [CrossRef] [Medline]
- Attridge M. A global perspective on promoting workplace mental health and the role of employee assistance programs. Am J Health Promot. May 2019;33(4):622-629. [CrossRef] [Medline]
- Strudwick J, Gayed A, Deady M, et al. Workplace mental health screening: a systematic review and meta-analysis. Occup Environ Med. Aug 2023;80(8):469-484. [CrossRef] [Medline]
- Kelloway EK, Dimoff JK, Gilbert S. Mental health in the workplace. Annu Rev Organ Psychol Organ Behav. Jan 23, 2023;10(1):363-387. [CrossRef]
- Raggi A, Bernard RM, Toppo C, et al. The EMPOWER occupational e-mental health intervention implementation checklist to foster e-mental health interventions in the workplace: development study. J Med Internet Res. Mar 15, 2024;26:e48504. [CrossRef] [Medline]
- Sevov B, Huettemann R, Zinner M, Meister S, Fehring L. Employee preference and use of employee mental health programs: mixed methods study. JMIR Hum Factors. May 5, 2025;12:e65750. [CrossRef] [Medline]
- Jeannotte AM, Hutchinson DM, Kellerman GR. The time to change for mental health and wellbeing via virtual professional coaching: longitudinal observational study. J Med Internet Res. May 13, 2021;23(7):e27774. [CrossRef] [Medline]
- Joseph B, Walker A, Fuller-Tyszkiewicz M. Evaluating the effectiveness of employee assistance programmes: a systematic review. Eur J Work Organ Psychol. Jan 2, 2018;27(1):1-15. [CrossRef]
- Burger F, Neerincx MA, Brinkman WP. Technological state of the art of electronic mental health interventions for major depressive disorder: systematic literature review. J Med Internet Res. Jan 20, 2020;22(1):e12599. [CrossRef] [Medline]
- Thomas BJ, Follmer KB, Meglich P. Giving organization stakeholders better help: a taxonomy for making sense of workplace mental health offerings. Group Organ Manag. 2024;50(5-6):1446-1489. [CrossRef]
- Armaou M, Konstantinidis S, Blake H. The effectiveness of digital interventions for psychological well-being in the workplace: a systematic review protocol. Int J Environ Res Public Health. 2020;17(1):255. [CrossRef]
- Economides M, Bolton H, Male R, Cavanagh K. Feasibility and preliminary efficacy of web-based and mobile interventions for common mental health problems in working adults: multi-arm randomized pilot trial. JMIR Form Res. Mar 3, 2022;6(3):e34032. [CrossRef] [Medline]
- Roche A, Kostadinov V, Cameron J, Pidd K, McEntee A, Duraisingam V. The development and characteristics of Employee Assistance Programs around the globe. J Workplace Behav Health. Oct 2, 2018;33(3-4):168-186. [CrossRef]
- Attridge M. The current state of employee assistance programs in the United States: a research-based commentary. Int J Sci Res Publ. 2023;13(8):74-91. [CrossRef]
- Krisher L, Boeldt DL, Sigmon CAN, Rimel SE, Newman LS. Pragmatic approach to the assessment and use of digital mental health interventions for health workers. Am J Public Health. Feb 2024;114(S2):171-179. [CrossRef] [Medline]
- Axén I, Björk Brämberg E, Vaez M, Lundin A, Bergström G. Interventions for common mental disorders in the occupational health service: a systematic review with a narrative synthesis. Int Arch Occup Environ Health. Oct 2020;93(7):823-838. [CrossRef] [Medline]
- Bouzikos S, Afsharian A, Dollard M, Brecht O. Contextualising the effectiveness of an employee assistance program intervention on psychological health: the role of corporate climate. Int J Environ Res Public Health. Apr 21, 2022;19(9):5067. [CrossRef] [Medline]
- Smail-Crevier R, Powers G, Noel C, Wang J. Health-related internet usage and design feature preference for e-mental health programs among men and women. J Med Internet Res. Mar 18, 2019;21(3):e11224. [CrossRef] [Medline]
- Carolan S, Harris PR, Cavanagh K. Improving employee well-being and effectiveness: systematic review and meta-analysis of web-based psychological interventions delivered in the workplace. J Med Internet Res. Jul 26, 2017;19(7):e271. [CrossRef] [Medline]
- Phillips EA, Gordeev VS, Schreyögg J. Effectiveness of occupational e-mental health interventions: a systematic review and meta-analysis of randomized controlled trials. Scand J Work Environ Health. Nov 1, 2019;45(6):560-576. [CrossRef] [Medline]
- Muñoz RF, Chavira DA, Himle JA, et al. Digital apothecaries: a vision for making health care interventions accessible worldwide. Mhealth. 2018;4:18. [CrossRef] [Medline]
- Liverpool S, Mota CP, Sales CMD, et al. Engaging children and young people in digital mental health interventions: systematic review of modes of delivery, facilitators, and barriers. J Med Internet Res. 2020;22(6):e16317. [CrossRef] [Medline]
- Gagnon MP, Sasseville M, Leblanc A. Classification of digital mental health interventions: a rapid review and framework proposal. Stud Health Technol Inform. May 25, 2022;294:629-633. [CrossRef] [Medline]
- Pineda BS, Mejia R, Qin Y, Martinez J, Delgadillo LG, Muñoz RF. Updated taxonomy of digital mental health interventions: a conceptual framework. Mhealth. 2023;9(28):1-17. [CrossRef] [Medline]
- Lukka L, Palva JM. The development of game-based digital mental health interventions: bridging the paradigms of health care and entertainment. JMIR Serious Games. Sep 4, 2023;11:e42173. [CrossRef] [Medline]
- Ferrari M, Sabetti J, McIlwaine SV, et al. Gaming my way to recovery: a systematic scoping review of digital game interventions for young people’s mental health treatment and promotion. Front Digit Health. 2022;4:814248. [CrossRef] [Medline]
- Bradley G, Rehackova L, Devereaux K, et al. Classifying the features of digital mental health interventions to inform the development of a patient decision aid. PLOS Digit Health. Mar 2025;4(3):e0000752. [CrossRef] [Medline]
- Hopkin G, Coole H, Edelmann F, et al. Toward a new conceptual framework for digital mental health technologies: scoping review. JMIR Ment Health. Feb 19, 2025;12:e63484. [CrossRef] [Medline]
- David E, DePierro JM, Marin DB, Sharma V, Charney DS, Katz CL. COVID-19 pandemic support programs for healthcare workers and implications for occupational mental health: a narrative review. Psychiatr Q. Mar 2022;93(1):227-247. [CrossRef] [Medline]
- LaMontagne AD, Martin A, Page KM, et al. Workplace mental health: developing an integrated intervention approach. BMC Psychiatry. May 9, 2014;14:131. [CrossRef] [Medline]
- Nickerson RC, Varshney U, Muntermann J. A method for taxonomy development and its application in information systems. Eur J Inf Syst. May 2013;22(3):336-359. [CrossRef]
- Kundisch D, Muntermann J, Oberländer AM, et al. An update for taxonomy designers. Bus Inf Syst Eng. Aug 2022;64(4):421-439. [CrossRef]
- Tricco AC, Lillie E, Zarin W, et al. PRISMA extension for Scoping Reviews (PRISMA-ScR): checklist and explanation. Ann Intern Med. Oct 2, 2018;169(7):467-473. [CrossRef] [Medline]
- Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol. Jan 2006;3(2):77-101. [CrossRef]
- Tong A, Sainsbury P, Craig J. Consolidated criteria for reporting qualitative research (COREQ): a 32-item checklist for interviews and focus groups. Int J Qual Health Care. 2007;19(6):349-357. [CrossRef]
- Szopinski D, Schoormann T, Kundisch D. Because your taxonomy is worth it: towards a framework for taxonomy evaluation. 2019. Presented at: Proceedings of the European Conference on Information Systems (ECIS); Jun 8-14, 2019. URL: https://aisel.aisnet.org/ecis2019_rp/104/ [Accessed 2024-12-07]
- Fleiss JL. Measuring nominal scale agreement among many raters. Psychol Bull. 1971;76(5):378-382. [CrossRef]
- Gisev N, Bell JS, Chen TF. Interrater agreement and interrater reliability: key concepts, approaches, and applications. Res Social Adm Pharm. 2013;9(3):330-338. [CrossRef] [Medline]
- Cohen J. A coefficient of agreement for nominal scales. Educ Psychol Meas. Apr 1960;20(1):37-46. [CrossRef]
- Gattrell WT, Logullo P, van Zuuren EJ, et al. ACCORD (Accurate Consensus Reporting Document): a reporting guideline for consensus methods in biomedicine developed via a modified Delphi. PLOS Med. Jan 2024;21(1):e1004326. [CrossRef] [Medline]
- Meyermann A, Porzelt M. Hinweise zur anonymisierung von qualitativen daten. In: Forschungsdatenzentrum (FDZ) Bildung Am DIPF (Deutsches Institut Für Internationale Pädagogische Forschung) [Guidelines for Anonymizing Qualitative Data]. 1st ed. 2014. URL: https://www.pedocs.de/volltexte/2022/21968/pdf/fdb-informiert_1_Meyermann_ua_Hinweise_zur_Anonymisierung_von_qualitativen_Daten_2014_v1-1_A.pdf [Accessed 2024-07-12]
- Johnson A, Gibson A. Sustainability in Engineering Design. 1st ed. Elsevier; 2014. [CrossRef] ISBN: 9780080993690
- Möller F, Stachon M, Azkan C, Schoormann T, Otto B. Designing business model taxonomies—synthesis and guidance from information systems research. Electron Markets. Jun 2022;32(2):701-726. [CrossRef]
- Scheutzow J, Attoe C, Harwood J. Acceptability of web-based mental health interventions in the workplace: systematic review. JMIR Ment Health. May 11, 2022;9(5):e34655. [CrossRef] [Medline]
- International classification of diseases 11th revision (ICD-11). World Health Organization. URL: https://icd.who.int/en [Accessed 2024-07-12]
- Carolan S, de Visser RO. Employees’ perspectives on the facilitators and barriers to engaging with digital mental health interventions in the workplace: qualitative study. JMIR Ment Health. Jan 19, 2018;5(1):e8. [CrossRef] [Medline]
- Wan Mohd Yunus WMA, Musiat P, Brown JSL. Systematic review of universal and targeted workplace interventions for depression. Occup Environ Med. Jan 2018;75(1):66-75. [CrossRef] [Medline]
- Szeto ACH, Dobson KS. Reducing the stigma of mental disorders at work: a review of current workplace anti-stigma intervention programs. Appl Prev Psychol. Jun 2010;14(1-4):41-56. [CrossRef]
- Dewa CS, Hoch JS. Barriers to mental health service use among workers with depression and work productivity. J Occup Environ Med. Jul 2015;57(7):726-731. [CrossRef] [Medline]
- Graham M, Milanowski A, Miller J. Measuring and promoting inter-rater agreement of teacher and principal performance ratings. 2012. URL: https://files.eric.ed.gov/fulltext/ED532068.pdf [Accessed 2025-06-20]
- Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. Mar 1977;33(1):159-174. [CrossRef] [Medline]
- Denecke K, May R. Developing a technical-oriented taxonomy to define archetypes of conversational agents in health care: literature review and cluster analysis. J Med Internet Res. Jan 30, 2023;25:e41583. [CrossRef] [Medline]
- Scheider S, Lauf F, Geller S, Möller F, Otto B. Exploring design elements of personal data markets. Electron Markets. Dec 2023;33(1):28. [CrossRef]
- Weking J, Mandalenakis M, Hein A, Hermes S, Böhm M, Krcmar H. The impact of blockchain technology on business models—a taxonomy and archetypal patterns. Electron Markets. Jun 2020;30(2):285-305. [CrossRef]
- Clay J, Eaton J, Gronholm PC, Semrau M, Votruba N. Core components of mental health stigma reduction interventions in low- and middle-income countries: a systematic review. Epidemiol Psychiatr Sci. Sep 4, 2020;29:e164. [CrossRef] [Medline]
- Chan S, Torous J, Hinton L, Yellowlees P. Towards a framework for evaluating mobile mental health apps. Telemed J E Health. Dec 2015;21(12):1038-1041. [CrossRef] [Medline]
- Nunes AP, Richmond MK, Pampel FC, Wood RC. The effect of employee assistance services on reductions in employee absenteeism. J Bus Psychol. Dec 2018;33(6):699-709. [CrossRef]
- Baessler F, Zafar A, Gargot T, et al. Psychiatry training in 42 European countries: a comparative analysis. Eur Neuropsychopharmacol. May 2021;46:68-82. [CrossRef] [Medline]
- Asian Federation of Psychiatric Associations. The bulletin of the AFPA: the Summer 2016 Issue. Bull AFPA. 2016;3(2). URL: https://www.afpa.asia/pdf/AFPA_Bulletin_2016s.pdf [Accessed 2024-07-12]
- Garabiles MR, Harper Shehadeh M, Hall BJ. Cultural adaptation of a scalable World Health Organization e-mental health program for overseas Filipino workers. JMIR Form Res. Mar 29, 2019;3(1):e11600. [CrossRef] [Medline]
- Chowdhary N, Jotheeswaran AT, Nadkarni A, et al. The methods and outcomes of cultural adaptations of psychological treatments for depressive disorders: a systematic review. Psychol Med. Apr 2014;44(6):1131-1146. [CrossRef] [Medline]
- Sit HF, Ling R, Lam AIF, Chen W, Latkin CA, Hall BJ. The cultural adaptation of step-by-step: an intervention to address depression among Chinese young adults. Front Psychiatry. 2020;11:650. [CrossRef] [Medline]
- Cross S, Bell I, Nicholas J, et al. Use of AI in mental health care: community and mental health professionals survey. JMIR Ment Health. Oct 11, 2024;11:e60589. [CrossRef] [Medline]
- Olawade DB, Wada OZ, Odetayo A, David-Olawade AC, Asaolu F, Eberhardt J. Enhancing mental health with artificial intelligence: current trends and future prospects. J Med Surg Public Health. Aug 2024;3:100099. [CrossRef]
Abbreviations
| ACCORD: Accurate Consensus Reporting Document |
| COREQ: Consolidated Criteria for Reporting Qualitative Research |
| DMHI: digital mental health intervention |
| DMHT: digital mental health technology |
| EMHP: employee mental health program |
| ICD-11: International Classification of Diseases, Eleventh Revision |
| KOL: key opinion leader |
| PRISMA-ScR: Preferred Reporting Items for Systematic Reviews and Meta-Analyses Extension for Scoping Reviews |
Edited by Naomi Cahill; submitted 20.Oct.2024; peer-reviewed by Chiara Curatoli, Chung-Yen Chen, Gerrit Hirschfeld, Ilinca Serbanescu; accepted 31.Oct.2025; published 18.Dec.2025.
Copyright© Benedict Sevov, Robin Huettemann, Maximillian Zinner, Sven Meister, Leonard Fehring. Originally published in the Interactive Journal of Medical Research (https://www.i-jmr.org/), 18.Dec.2025.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Interactive Journal of Medical Research, is properly cited. The complete bibliographic information, a link to the original publication on https://www.i-jmr.org/, as well as this copyright and license information must be included.

