Skip to main content

Becoming our young people’s case managers: caregivers’ experiences, needs, and ideas for improving opioid use treatments for young people using opioids

Abstract

Background

Evidence continues to show that young people, ages 15-24, remain at significant risk of harms from non-medical opioid use and opioid use disorder (OUD), with experts calling for widespread implementation of developmentally-appropriate interventions. These recommendations include the involvement of caregivers in the prevention, early intervention, and treatment of young people using opioids. However, little research has investigated caregivers’ experiences supporting young people, leaving critical gaps in understanding this role. The aim of this study is to explore caregivers’ experiences accessing opioid use treatments with young people and their needs and ideas for improving such treatments.

Methods

This study reports qualitative findings from Phase 1 of the Improving Treatment Together project, a multi-phase, multi-site community-based participatory study broadly aimed at co-designing opioid use treatments to improve the experiences and outcomes of young people using non-medical opioids. During Phase 1, a total of 27 caregivers (parents, guardians) participated in full-day workshops that were conducted in three communities in British Columbia, Canada. Following human-centred co-design methods, caregivers engaged in small and large group discussions of their experiences, needs, and ideas for improving opioid use treatments for young people. Discussions were audio-recorded, transcribed verbatim, and thematically analysed.

Results

Across communities, caregivers’ main experiences were defined as ‘becoming our young people’s case managers’ and ‘enduring a never-ending rollercoaster’. To improve these experiences, two needs themes were identified – expanding organizational and system-level capacity and wider-spread understanding of opioid use as a health issue. Caregivers brainstormed a total of 378 individual ideas to meet these needs, several of which spanned multiple needs themes.

Conclusions

Caregivers’ experiences, needs, and ideas reveal critical opportunities for improving the quality of interventions for opioid use among young people. This study represents a substantial contribution to the design and implementation of developmentally-appropriate and family-centred interventions for young people using opioids.

Background

It is well known that earlier initiation of any non-medical substance use is associated with progression to substance use disorders (SUDs) later in life and other related harms (e.g., co-occurring mental illnesses, injury, loss of social capital) [1,2,3,4]. These patterns are affected by a complex interaction between age-related factors (e.g., childhood adversity, family environment) and broader social and environmental contexts, such as substance use norms, and drug availability, which also evolve over time [5,6,7,8]. This is particularly worrisome considering the ongoing North American drug toxicity crisis, where highly contaminated opioid supplies have contributed to historically high mortality rates in young people (ages 15-24) [9,10,11]. In the United States (US), opioid-related mortality among young people has increased more than 3-fold from 1999 to 2018 [9, 10], with recent evidence suggesting an increased involvement of stimulants and other drugs in these rates over time [10]. In 2018, for instance, opioid-only mortality rates in young people were 0.19 per 100,000 individuals, while polysubstance-involved rates were 0.22 per 100,000 [10]. Although comparable national studies among young people are limited in the Canadian context, young people have accounted for approximately 20% of the total 24,626 opioid-related overdose deaths since 2016, when the crisis was declared a public health emergency [11]. Additionally, a recent population-based Canadian study reported an opioid-related crude mortality rate of 4.7 per 1000 person-years among young people receiving opioid agonist treatment (OAT) between 1996 to 2018 [12].

These data indicate that young people are a priority population in interventions for opioid use and opioid use disorder (OUD). However, research shows that young people receive inadequate assessment, diagnosis, and treatment for non-medical opioid use and OUD [13,14,15,16], leaving them at significant risk of harms, including fatal and non-fatal overdoses. To address this gap, experts have outlined evidence-based guidelines for developmentally-appropriate interventions [13, 17,18,19,20]. Briefly, these principles include early identification and intervention; a comprehensive approach to treatment (e.g., harm reduction, mental health, caregiver involvement, primary care) that aligns with young people’s individual goals; service environments that preserve young people’s autonomy and connection to community; continuous care and engagement, especially during times of elevated risk (e.g., relapse); and ongoing quality improvement efforts [13, 18].

Across guidelines, caregiver (e.g., parents, family members, guardians, family of choice) involvement is recommended to promote young people’s treatment engagement and outcomes [13, 18]. This recommendation is based on the protective effects that positive caregiver relationships have on young people’s substance use initiation and progression [21] and the effectiveness of family-based interventions (e.g., parent education, family counseling) in the prevention, early intervention, and treatment of young people’s substance use [21, 22]. Nevertheless, few studies have investigated the role of caregivers in opioid use treatment and services for young people [23]. In a recent review, Kaur et al. [23] identified two main foci in this scant literature, 1) ethical considerations and confidentiality when involving family members in young people’s opioid use treatment (n = 3 studies), and 2) the benefits of family involvement (n = 5 studies), including reduced rates of opioid use [24] and adherence to psychotherapeutic [25] and pharmacological treatments [26, 27].

Despite the valuable role and perspective that caregivers bring to improving developmentally-appropriate interventions for young people, very little research has explored their experiences in this role or ideas for such interventions. In one closely related study done prior to the current opioid-related drug toxicity crisis, Guarino et al. [28] conducted focus groups with parents to explore their perceptions of the effectiveness of methadone maintenance treatment for young people. Their findings showed that parents appreciated this treatment for its management of young people’s withdrawal symptoms and the opportunity to build new parenting strategies through the parent support groups. In a more recent study, caregivers discussed their limited understanding of the chronic and relapsing nature of OUD and their emotional exhaustion as factors influencing their ability to support their young people over time [29].

The present study adds to this limited body of research by further describing caregivers’ experiences accessing opioid treatment services with their young people across three communities in British Columbia (BC), a province that has faced some of the highest overdose death rates in Canada [11]. This work also adds original evidence regarding caregivers’ needs and ideas for improving the delivery of opioid use treatments for young people and families affected by non-medical opioid use. Our guiding research question was: What are caregivers’ experiences, needs, and ideas for improving opioid use treatments for young people? This research identifies opportunities and strategies for improving the quality of opioid use treatments and services for young people and responds to critical gaps in young people’s access to developmentally-appropriate and family-centred opioid treatment services.

Methods

Design, setting, participants

The Improving Treatment Together (ITT) Project is a multi-phase community-based participatory research (CBPR) project [30] that integrates human-centred co-design processes [31, 32], with the broader goal of producing actionable evidence leading to youth-centred opioid use treatments [33]. This paper focuses on qualitative data collected in Phase 1 of the project and follows consolidated criteria for qualitative research [34]. This phase involved a series of community-based workshops that were conducted between November 2019 and February 2020. At the time of project planning (2018), the project’s partners collaboratively identified three communities that were geographically diverse (i.e., spread across the province’s designated healthcare regions), varied in population size, and facing high regional rates of fatal opioid-related drug toxicity events, relative to the provincial rate (31.1 per 100,000) [35]. The three selected communities were Prince George, Victoria, and Vancouver, in BC, Canada. Briefly, Prince George is a smaller city (2016 population: 74,003) located in the Northern Health region and where fatal opioid-related mortality rates were 52.7 per 100,000. Victoria (2016 population: 85,795) is the provincial capital, located in the Island Health region of the province, and had 43.1 fatal opioid-related deaths per 100,000. Lastly, Vancouver is one of BC’s largest urban population centres (2016 population: 631,490), located in the Vancouver Coastal Health region, and where fatal opioid-related mortality rates were 57.1 per 100,000 [35].

To be eligible, participants were: (a) caregivers (i.e., biological parent, adopted parent, step-parent, guardian) of a young person between the ages of 16-24 who had current or past (within last 12 months) non-medical opioid use (e.g., heroin, fentanyl) and had accessed opioid use treatments; (b) able to speak and write in English; and (c) willing and able to provide fully informed consent to participate. To reach this sample, we relied on advertisements in collaborating community-based services for young people and families navigating substance use and snowball sampling. Interested participants then contacted the study team to verify the self-reported eligibility criteria.

Procedures and data collection

Upon reviewing and signing the informed consent form, participants were asked to voluntarily complete the self-reported demographic questionnaire. Participants then engaged in a full-day workshop that was structured around the core elements of human-centred co-design [36]. These elements aimed to: (a) understand a caregiver’s experiences accessing opioid use treatments with their young person (empathy session); (b) identify and prioritize needs for improving opioid treatment service for young people (needs session); and (c) brainstorm solutions to address their selected needs (ideation session). These core elements were separated into structured workshop sessions.

During each session, participants self-selected into small discussion groups and were guided through broad open-ended questions, akin to focus group methods. In the first session, participants were prompted to share their experiences while accessing opioid use treatments with their young person. This session was guided by the open-ended questions, “what are you thinking, feeling, hearing, saying, seeing, and doing during these point of care interactions?”. After building a common understanding of each caregiver’s experiences, the next session focused on discussing and prioritizing needs, opportunities, and preferences for opioid use treatments for young people. In the ideation session, participants individually brainstormed solutions to the prioritized needs through broad open-ended questions (e.g., “how might we … reduce waiting times?”).

Each small group included 3-5 participants and two trained facilitators. Large group discussions were also used for wider reflection and clarification of similarities and differences between the small groups. The small and large group discussions for each session ranged from 30 to 90 minutes and all discussions were audio-recorded. Facilitators also took field notes and used white boards and worksheets to support data collection throughout each session. A community-based family peer-support team member was present at each workshop to provide on-site support and referrals, if needed. Participants were provided with catering, an honorarium for their time to participate, and reimbursement for travel-related expenses.

Analysis

The primary source of data for the present analysis was the audio-recorded small and large group discussions, which were transcribed verbatim. Separate small (n = 25) and large group (n = 9) transcripts were created for each of the three discussion sessions (empathy, needs, ideas) and for each small discussion group. White board images (n = 25) were also used to support theme development. Field notes and worksheets were reviewed as part of the data quality check. The number of distinct data sources analysed from each community is shown in Table 1. All data sources were imported into NVivo [37] for analysis.

Table 1 Number of qualitative data sources used in the analysis from aross the three communities

Data from the experiences and needs session were thematically analysed following an inductive approach using Braun and Clarke’s six steps [38] by the first author (KM), who has extensive qualitative research experience. These steps began with repeated readings of the transcripts and supporting documentation. Next, initial coding was done by a data-driven approach (i.e., verbatim codes) and proceeded sequentially through each session of the workshop within each community. Initial codes from across all communities were then collated and sorted to search for potential semantic themes. Team meetings were held to review and discuss the relationships between codes and candidate themes (i.e., sub-themes, main overarching themes). Next, candidate themes and thematic diagrams from the empathy and needs sessions were discussed with four caregivers from the original workshops. These discussions informed theme definitions and names and strengthened the fit, interpretation, and connections of themes. In the final step, producing the report, the themes and selected extracts were presented back to the four caregivers for further feedback and refinement.

For the analysis of individual ideas collected during the ideation session, a blended theoretical and data-driven approach was selected. This approach was deemed most appropriate given the structured format of the workshops, where participants brainstormed as many ideas as possible to the identified needs. Additionally, the individual ideas were quite brief statements, which precluded a more in-depth analysis. After verbatim coding of individual ideas, the ideas were collated and sorted according to their fit with the final defined needs themes. As there were similarities between individual ideas coded under each needs theme, the ideas were then clustered into ideas themes using a data-driven approach.

Results

Participant characteristics

A total of 27 caregivers participated in the Phase 1 co-design workshops; 6 caregivers participated in the Prince George workshop, 8 in Vancouver, and 13 in Victoria. For further context, Table 2 displays participants’ socio-demographic characteristics and background data of their young people’s opioid use and treatment history. Participants primarily identified as woman (76%), Caucasian/White (75%), and having college/university degrees (57%). Participants first learned of their young person’s non-medical opioid use when the young person was an average of 17 years of age (standard deviation [SD] = 3.56). Forty-three percent of caregivers reported their young person’s daily use of opioids, 40% reported daily concurrent use of other non-medical substances (not including alcohol or cannabis), and 61% reported that their young person was currently using non-medical opioids. Individual counseling (e.g., cognitive behavioural therapy) was the most frequent opioid use treatment accessed by young people (86%), followed by case management (58%), and addictions medicine (57%). Thirty-eight percent of caregivers reported that their young person had received OAT (e.g., buprenorphine, methadone). Of note, 81% of caregivers reported that their young person had accessed more than one type of substance use treatment, with the mean number of different treatments being 3.7 (SD = 1.4).

Table 2 Characteristics of caregivers (n = 27) in three communities in British Columbia

The thematic analysis identified two main experiences themes and two main needs themes. These themes and their respective sub-themes are presented in Fig. 1. Given the flow of the workshop, there was a natural connection between the main experiences and needs themes, which is also illustrated in Fig. 1. The remaining sections summarize each of the main themes in greater detail, with single quotes identifying theme names and double quotes representing direct quotes from participants.

Fig. 1
figure 1

Caregivers’ experiences and needs for improving opioid use treatments for young people

Caregivers’ experiences accessing opioid use treatments with young people

Becoming our young person’s case managers

As participants supported their young person to access and keep connected to opioid use treatments, they shared the salient experience of ‘becoming our young person’s case managers’. This theme was contextualized by participants’ unique journeys as they first learned about their young person’s opioid use and realized that they needed help from service providers. For most participants, this was a gradual process as they initially thought their young person’s substance use was “normal teenage behaviour” (Caregiver in Victoria) and realized help was needed as they developed further knowledge of opioid use, OUD, and related harms. As one participant shared, most wished this realization had occurred much sooner:

“I remember the moment where I realized it was time to ask for help, it was way down the road, it would've been so much better to have done so months or even years [earlier], but you know?... I know, at least for me, I didn't know enough to know what I was looking at, I couldn't see what was happening for a very long time. So that was part of the problem … I wish I would've started that years before I did.” (Caregiver in Prince George)

As participants sought help, their experiences were depicted as “scrambling, trying to find answers as fast as I can to somehow rescue them from this” (Caregiver in Victoria). In their efforts to support their young person, participants assumed many roles during this process. This included building their own knowledge of opioid use and related harms, leading the search for services, making daily phone calls to service providers and treatment and detox centres, “connecting the dots for other providers” (Caregiver in Victoria), and keeping connected to their young person while waiting for treatments. As one caregiver explained:

“I think we’re given a job with the tools that are technically out there but without the power to access them [opioid use treatments] and it’s, it’s like spokes in a wheel, technically it’s all supposed to work together, but, but they don’t, they don’t necessarily all connect. So, we, we are really the only hub and yet we can’t access or um, [we have] all of the responsibility and none of the power.” (Caregiver in Victoria)

Ultimately, participants explained that “we become our own case managers” (Caregiver in Victoria), which involved navigating many different spokes or systems that were not connected (primarily education, healthcare, and justice). Across these systems, participants recounted facing multiple barriers. These barriers clustered around accessibility issues, such as limited capacity for enrolment to services (e.g., not enough detox beds, OAT prescribers), narrow service delivery hours (i.e., weekdays from 9 to 5), and geographical variation in service options (e.g., services concentrated to a downtown core, limited OAT options in the north of the province). These issues increased the waiting time for services, disrupted treatment continuity between programs, and resulted in missed windows of opportunity where young people wanted treatment:

“What I’ve noticed a lot from my experience, um, when you’re using [opioids], and you don’t want help that’s when they’ll [service providers] tell the parents, like ‘oh you just have to wait until they want help. You can’t really do anything until they are willing to accept it’. But then when he [son] wanted help, that’s when it’s ‘oh you’re not stable enough, oh there’s a wait list, oh you can’t come here, you can’t do this, you can’t do this’. And it’s like they keep telling the parents, at least from my perspective um, you need to wait until they are actually willing to accept help, but then when they’re willing to accept help, they don’t get it, or they don’t get it fast enough. And then, they start to feel like there’s no point and then they start using again … it’s like you’re waiting for them to want help and then they want help, they don’t get it.” (Caregiver in Victoria)

As this quote showed, participants attributed some of these accessibility issues to systems that were “reactive rather than proactive” (Caregiver in Prince George). This left caregivers and young people with few timely options during those critical windows, and few supports to address the “reasons why they started using [opioids] in the first place” (Caregiver in Prince George), such as trauma, pain, and co-occurring mental health symptoms.

Barriers to treatment access and continuity were also rooted in age-based treatment policies (e.g., British Columbia’s Infant Act), as many organizations use young people’s biological age (commonly 19 or 24) to define the transition between child/youth and adult healthcare systems [39]. These age-based transitions meant that young people had to “start all over just because they turned 19” (Caregiver in Vancouver), disrupting service continuity and trusted service provider relationships. These policies also affected the extent to which caregivers could be involved in young people’s treatment engagement, when appropriate and preferred:

“[For] someone who’s over the age of 19, you know, having services that involve the family would make a big difference, right? There’s this expectation now that he’s the age that he can navigate this all on his own, right? Um, you know, for like – like psychiatry appointments and his programs and making sure his forms are filled out … but a lot of it I still manage … so having that ability to connect right with his service providers as his circle of care, instead of expecting him to be able to manage that, would make a huge difference. Yeah, it’s like 18 all the support and 19, you’re on your own right? And it just, it doesn’t make sense? At 45 I think I can manage most of it, but I can’t imagine in your early 20s, you know, [with] concurring instances of mental health and addiction, and treatment, you know?” (Caregiver in Prince George)

Enduring a never-ending rollercoaster

The second experiences theme (Fig. 1) was rooted in participants’ drive to keep their young people safe and alive. As this caregiver describes, this led to “horrific” situations:

"You slowly ease yourself into it because it's a nightmare, it's so horrific that it blows my mind, you know? There's times we walked into the room, and he's blue, he's not breathing, his heart's not going, you know we're doing CPR [cardiopulmonary resuscitation] and I’m injecting him [with naloxone] and I’m just trying to hold it together while I’m trying to revive my son. And it's like, I can't live like this, and yet, I have to. So, we actually kicked him out years ago … um, but then as it got towards the fall and winter and stuff, his usage got so much, I had to ask myself the question, you know, am I willing to receive that phone call that says ‘sorry sir your son's dead’? And I couldn't, I was, I had to take him home, the whole firm hand thing? I just threw that out the window. I had to keep him alive." (Caregiver in Victoria)

As this participant’s experience depicts, this never-ending rollercoaster was emotionally straining as it evoked constant fear, helplessness, hopelessness, and frustration. Participants also experienced self-blame, shame, and isolation due to judgment, stigma, and lack of understanding of opioid use. As this caregiver explained:

“And then we have people that you think you can talk to, and they say, ‘oh well, that’s her choice’. It’s so frustrating because it’s like … but don’t you understand – even people who have had it in their family, they say that, and it’s just like… it takes over your whole life, it’s like air. They don’t get it, they don’t understand … And it’s just very frustrating … you want the whole family to be there supporting her and trying to, you know, do everything we can. But every time you think you take a step forward, other people are just tearing her down.” (Caregiver in Vancouver)

To maintain their strength through their roles as case managers, participants emphasized the importance of connecting with other families with lived/living opioid use experience:

“I am not as ashamed, or embarrassed, or as stigmatized anymore … I have found some good support groups that I've gone to. One was a biweekly parent meeting. I've gone to SMART Family and Friends … Personal counselling, that's been helpful. So, I think it's just been a process, but it's been a process with a lot of peer support.” (Caregiver in Vancouver)

Caregivers’ needs for improving opioid use treatments for young people

Figure 1 also shows the two main needs themes, which are further described in the following sections.

Expand organizational and system-level capacity

Building on their main experience of ‘becoming our young person’s case managers’, participants emphasized the need for expanded organizational capacity among specialized service providers and treatment programs so that young people can get timely access to services during windows of opportunity. Participants also described that organizations needed to adapt their policies and procedures to reflect young people’s diverse histories (e.g., root causes, concurrent mental illnesses), current circumstances, and long-term goals (e.g., arts, mentorship, vocational programs):

Participant 3: Um, I think with youth, you kind of get more opportunity to really make an impression, especially if you’re a brand new service that they’ve never accessed before, and if they don't connect with you that's kind of probably the end of it. Um, and if they're not met very warmly, like if, if you're told ‘oh come back in an hour’, or um, ‘we don't do that anymore’ or ‘you're in the wrong place’. They’re not going to go back …

Participant 1: And just in a timely way... Just like expanding hours.

Participant 2: Yeah, it needs to be responsive in a way that meets the need at the time, not a couple of days from now.

Participant 3: Four days isn’t fast.

Participant 4: … And, I think an opportunity could be that adaptation of expectations when young people are accessing treatment or services, right? Like we talked about this a little bit on the break, you know that expectation of abstinence, right? Is that realistic? Probably not. We know, and research shows that isn't the expectation, right? So, then you take away, you know, the substance they were using to get by, plus also the coffee and the cigarettes and then stick them in a really unfamiliar place with unfamiliar structures, that's really unrealistic right? (Caregivers in Prince George)

Participants also discussed the need for a more cohesive system, with emphasis on strengthening the consistency of policies and operating procedures (e.g., intakes, caregiver involvement, expectations of abstinence) among different systems, organizations, and professionals. Participants also identified the need for increased competency in substance use treatment among service providers throughout the healthcare system, and not just in specialized settings. Similarly, caregivers reflected on the need for better communication and information sharing between different service providers and systems and having “somebody that’s familiar with the police … the medical system and what they have to offer … I mean there’s so many different systems and you have to kind of learn all of them” (Caregiver in Victoria). As this quote suggests, these needs were closely connected to the difficulties participants experienced navigating different systems (e.g., healthcare and police; child/youth and adult systems).

Wider-spread understanding of opioid use as a health issue

The second theme reflected an underlying need for “less stigma in our community” (Caregiver in Victoria) and increased recognition that opioid use (and substance use and mental health generally) is a health or medical issue, rather than a criminal one. As shown in this exchange between caregivers in Prince George, participants discussed that this recognition could lead to increased opportunities for intervention and less stigma:

Participant 2: We would treat a physical illness much differently than we would treat a mental [health] challenge, but they can overlap, and they can fall in the same model. And yeah, we don't look at it that way …

Participant 3: I have redefined it in my mind, I feel like my son has something that's sort of like cancer and if he doesn't get the right treatment, he might die. And that's how I see it. And I know he's doing the best that he can. But, the rest of us could be doing a little bit better, because like you say, if he did have cancer, man, we'd be [using] a different approach and no one would be saying you have to stop doing this. You know? …

Participant 1: This is a medical disorder … They need proper care.

Participant 3: … I think the medical discourse is more acceptable so people can get behind that and stop judging people because it’s medical. I’m not sure, I don’t know, right? It is psychological too, it comes from pain, it comes from trauma, there’s other things involved … I think talking about it medically is useful because it gets us away from the blaming the person and the stigma … I think we have an opportunity here to change the culture.

This need reflected a deeper understanding of substance use as a health issue on both individual and societal levels and, thus, was discussed in relation to multiple groups, including caregivers and family members, schools and educators, and the wider public. Among individual caregivers, this theme was connected to the sub-theme ‘realizing we need help’ and needing more knowledge, caregiving skills, and whole family support to better care for their young person. In school settings, participants discussed the need for earlier introduction of evidence-based curriculum on mental health and substance use. Participants also stressed that this curriculum be taught “from a science point of view” (Caregiver in Vancouver) and that school policies be less punitive (e.g., remove expulsion for using substances) so that young people can maintain their connections to schools, improve their understanding of the risks and harms associated with opioid use, and experience less stigma.

Ideas for improving opioid treatment services for young people

Across the three workshops, a total of 378 individual ideas for improving opioid use treatments were identified by caregivers. Table 3 presents the ideas themes and select representative individual ideas that were identified within each of the needs themes. For the first main needs theme, ‘expand organizational and systems-level capacity’, the sub-theme ‘continuous and cohesive care’ had the highest number of individual ideas. Within this sub-theme, the most frequent ideas centred around solutions to maintain consistency in service providers for young people across their service journey. For instance, individually assigned case managers or advocates who would be with young people over time, supporting treatment access, follow-up, and transitions. For the needs sub-theme, ‘flexible and comprehensive care’, peer connections across the journey (e.g., peer mentoring programs) were frequently identified as solutions to better meet young people’s diverse needs over time. For the needs sub-theme, ‘more timely access to care’, the most frequent ideas centred around increasing the number of available beds or spaces for young people in detoxification, treatment, and stabilization programs/centres. For the needs sub-theme, ‘service provider competency’, participants identified training in active listening, non-judgment, and cultural safety as key solutions.

Table 3 Caregivers’ ideas for improving opioid use treatments for young people by needs themes

For the second main needs theme, ‘wider-spread understanding of opioid use as a health issue’, the sub-theme ‘caregivers’ knowledge and tools’ had the highest number of individual ideas coded. Among these, two key ideas included programs that can connect parents with other caregivers who have similar experiences and handbooks or guides. With both of these ideas, there was emphasis on these ideas allowing for knowledge and resources to be shared, while simultaneously building a community of support. For the ‘school curriculum and policies’ needs sub-theme, the most frequently identified ideas included the development and implementation of peer-based substance use programs in schools for students and staff as well as increasing mental health and substance use training for school professionals. Lastly, there were few specific ideas identified for the needs sub-theme ‘public acceptance’, with public awareness campaigns being most actionable.

Of note, several similar ideas themes were identified from across the needs sub-themes, suggesting their potential importance to addressing multiple caregiver needs. Peer-based services for youth (e.g., instant access to peer-based services) and caregivers (e.g., programs that connect parents with others with similar experiences) were solutions that were identified for four of the seven needs sub-themes. Similarly, assigned addictions care teams, system navigators, and liaisons were also conceptually similar ideas that spanned multiple needs. Finally, integrated mental health and substance use services and one-stop shops were also overlapping ideas across the needs themes for ‘flexible and comprehensive care’ and ‘continuous and cohesive care’.

Discussion

This study reports caregivers’ experiences, needs, and ideas for improving opioid use treatments for young people based on data collected during Phase 1 of the multi-phase and multi-site Improving Treatment Together (ITT) project. This research responds to critical health services-, advocacy-, and policy-related gaps by identifying targeted youth- and family-centred solutions that evolved directly from caregivers’ experiences and needs.

Caregivers experiences

Across the three communities, participants’ main experiences were defined as ‘becoming our young person’s case manager’, which involved navigating multiple roles and systems while ‘enduring a never-ending rollercoaster’. These experiences can be further contextualized in the findings from the socio-demographic survey. At the time of the workshops, 61% of caregivers reported that their young person was currently using non-medical opioids, and during periods of regular opioid use most young people were using weekly or daily and concurrently using other substances (other than alcohol and cannabis). Caregivers also reported that their young person accessed an average of 3.7 different types of treatments, primarily counseling and case management, with 38% reporting OAT. These findings follow recent large-scale studies of young people’s patterns of opioid and polysubstance use [10, 40, 41] and treatment utilization, where young people primarily receive psychotherapeutic interventions [13, 15]. These data also support understanding of the experiences themes, as caregivers’ described navigating multiple systems while trying to keep their young people safe amidst the current drug policy crisis of highly contaminated opioid supplies [9,10,11].

The in-depth exploration of caregivers’ experiences also revealed that they endured significant burdens in the caregiver role. In particular, they described having “all of the responsibility” (Caregiver in Victoria) but limited decision-making power and knowledge to effectively navigate multiple siloed systems. These findings complement a recent study where caregivers emphasized tensions between maintaining their supportive caregiving roles while respecting young people’s autonomy [29]. Our findings also support a growing body of research that is concerned with understanding the burdens associated with SUD-related caregiving roles [42,43,44]. For example, a recent study of OUD-caregivers (primarily a parent, child, or spouse) found that caregivers’ income, stress, and stigma were predictors of burden, while their personal mental and physical health were predictors of resilience [44]. These findings are highly relevant to recent recommendations for developmentally-appropriate principles of care for young people who use substances [13]. Of relevance to our study is the common recommendation to include family members as potential sources of support in the assessment and intervention of harmful opioid use among young people [13, 18, 45]. Based on this growing body of research, it is critical that further attention be directed towards how to uphold these recommendations while not overburdening caregivers.

Caregiver needs and solutions

Through our innovative use of human-centred co-design, caregivers in the present study identified several solutions to better meet their prioritized needs. Recurring ideas across communities focused on the development of peer support networks and manuals on how caregivers can best support young people using opioids. As shown by our study and others [44, 46, 47], such solutions could promote caregivers’ knowledge and tools, resilience, and advocacy for more timely and appropriate interventions and policies. Participants also emphasized the need to expand organizational and systems-level capacity so that they could focus on being a parent/guardian instead of “connecting the dots” (Caregiver in Victoria) between service providers. Here, caregivers expressed the need for care to be timely, comprehensive, and continuous. Of note, these needs also strongly overlap with several of the recent developmentally-appropriate principles of care for young people [13, 18]. For instance, these guidelines recommend comprehensive assessment and treatment of young people’s substance use, concurrent mental illnesses, physical health, and psychosocial needs [13, 18]. However, our findings indicate that there remain significant gaps in the delivery of such comprehensive and continuous care, as caregivers described a lack of services addressing the “root causes” (Caregiver in Prince George) of young people’s opioid use, concurrent mental illnesses, and their long-term goals.

To address these gaps in services, caregivers identified system-level solutions, such as integrated mental health and substance use services and one-stop shops. These ideas align with innovative integrated youth service (IYS) hubs (e.g., Foundry in BC, Youth Wellness Hubs Ontario, allcove in California, Jigsaw in Ireland, headspace in Australia), which are increasingly being implemented to address longstanding challenges with the appropriateness and accessibility of youth mental health and substance use service provision and engagement [48]. These hubs aim to provide young people (typically ages 12-24) with rapid access to comprehensive support, including mental health, substance use, primary care, social, and peer support services in integrated, community-based, and youth-friendly settings [48, 49]. Emerging evidence suggests that IYS hubs are highly endorsed by youth [50], caregivers [51] and service providers [52], with further research on their effectiveness in the assessment and treatment of harmful substance use highly anticipated [49].

Innovative IYS hubs may also be uniquely positioned to develop the strategies and resources that caregivers identified for their prioritized need of ‘wider-spread understanding of opioid use as a health issue’. This needs theme targeted distinct groups that frequently interact with young people, including caregivers, schools, and community-based service providers. To meet this need, caregivers’ identified several solutions, such as education for schools and first responders on identification of substance use and best practices. As IYS models are based on principles of youth and family engagement and interprofessional collaboration [48], they are well-positioned to promote developmentally-appropriate strategies and interventions through partnerships with schools, service providers, and policymakers.

Future directions

Based on this set of findings, Phase 2 of the ITT project is currently co-developing health service innovations to meet caregivers’ prioritized needs [33]. This has involved an extensive selection and co-design process. After the Phase 1 workshops, the full set of solutions underwent review by the project’s community, provincial, and national partners. The solutions were appraised against a set of a selection criteria for their impact, feasibility, scalability, and sustainability [33]. Since then, a working group, comprised of caregivers and the project team, has been working collaboratively to co-design selected solutions. Results of the co-design process, final prototypes, implementation, and evaluation are forthcoming.

Limitations

To our knowledge, this is one of the first studies to explore caregivers’ experiences, needs, and solutions for improving young people’s opioid use treatment access and outcomes. However, these findings must be interpreted with consideration of the limited diversity of participants’ characteristics when recruited through community-based organizations offering family support services for youth substance use. Across workshops, we reached a sample of caregivers that primarily self-identified as Caucasian/White and with higher education levels. Thus, our findings may not be applicable to caregivers and young people facing further structural inequities (e.g., racialized communities, low socio-economic status) that affect opioid use and treatment patterns and experiences [53, 54]. Future studies may consider using sampling strategies, such as maximum variation, that will promote greater representation of these underrepresented groups.

There were also important lessons from our application of human-centred co-design to this research study. While this method was valuable at identifying solutions that were grounded in caregivers’ experiences, it is a highly iterative method that brings a unique set of considerations. Of relevance to our data, participants were able to move between different small discussion groups within their community’s workshop as their interests evolved. This made it difficult to maintain unique identifiers across small group discussion sessions and precludes our integration of the thematic findings with participant’s individual characteristics (e.g., caregiver ethnicity, number of times young person accessed treatment) that would further support interpretation. Future researchers considering this approach should apply procedures that enable consistency in participants’ identifiers across all data sources, while still ensuring anonymity.

Conclusions

Our multi-site qualitative findings revealed that caregivers undertake a significant role in young people’s opioid use treatment engagement. This supports recommendations to involve caregivers in the delivery of developmentally-appropriate interventions (where appropriate and preferred). However, caregivers’ experiences and needs revealed critical opportunities for improving these interventions and caregivers’ roles. Caregivers identified several timely, feasible, and impactful solutions to improve these experiences and reduce opioid-related harms in young people. These solutions are critical to service providers and policymakers seeking further innovations in the design and delivery of developmentally-appropriate and family-centred approaches to opioid use and OUD.

Availability of data and materials

The datasets generated and/or analysed during the current study are not publicly available due to potential for identifying participants but are available from the corresponding author on reasonable request.

Abbreviations

OUD:

Opioid use disorder

SUD:

Substance use disorder

ITT:

Improving Treatment Together project

CBPR:

Community-based participatory research

BC:

British Columbia

SD:

Standard deviation

OAT:

Opioid agonist treatment

References

  1. Kessler RC, Berglund P, Demler O, Jin R, Merikangas KR, Walters EE. Lifetime prevalence and age-of-onset distributions of DSM-IV disorders in the National Comorbidity Survey Replication. Arch Gen Psychiatry. 2005;62(6):593–602.

    Article  PubMed  Google Scholar 

  2. Cerdá M, Santaella J, Marshall BD, Kim JH, Martins SS. Nonmedical prescription opioid use in childhood and early adolescence predicts transitions to heroin use in young adulthood: a National Study. J Pediatr. 2015;167(3):605–12.e1-2.

    Article  PubMed  PubMed Central  Google Scholar 

  3. Schepis TS, Hakes JK. Age of initiation, psychopathology, and other substance use are associated with time to use disorder diagnosis in persons using opioids nonmedically. Subst Abus. 2017;38(4):407–13.

    Article  PubMed  PubMed Central  Google Scholar 

  4. Guarino H, Mateu-Gelabert P, Teubl J, Goodbody E. Young adults' opioid use trajectories: from nonmedical prescription opioid use to heroin, drug injection, drug treatment and overdose. Addict Behav. 2018;86:118–23.

    Article  PubMed  PubMed Central  Google Scholar 

  5. Duncan TE, Tildesley E, Duncan SC, Hops H. The consistency of family and peer influences on the development of substance use in adolescence. Addiction. 1995;90(12):1647–60.

    Article  CAS  PubMed  Google Scholar 

  6. Dube SR, Felitti VJ, Dong M, Chapman DP, Giles WH, Anda RF. Childhood abuse, neglect, and household dysfunction and the risk of illicit drug use: the adverse childhood experiences study. Pediatrics. 2003;111(3):564–72.

    Article  PubMed  Google Scholar 

  7. Burns AR, Hussong AM, Solis JM, Curran PJ, McGinley JS, Bauer DJ, et al. Examining cohort effects in developmental trajectories of substance use. Int J Behav Dev. 2017;41(5):621–31.

    Article  PubMed  Google Scholar 

  8. Degenhardt L, Bharat C, Glantz MD, Sampson NA, Al-Hamzawi A, Alonso J, et al. Association of Cohort and Individual Substance use with Risk of transitioning to drug use, drug use disorder, and remission from disorder: findings from the world mental health surveys. JAMA Psychiatry. 2019;76(7):708–20.

    Article  PubMed  PubMed Central  Google Scholar 

  9. Gaither JR, Shabanova V, Leventhal JM. US National Trends in Pediatric Deaths From Prescription and Illicit Opioids, 1999-2016. JAMA Netw Open. 2018;1(8):e186558–e.

    Article  PubMed  PubMed Central  Google Scholar 

  10. Lim JK, Earlywine JJ, Bagley SM, Marshall BDL, Hadland SE. Polysubstance involvement in opioid overdose deaths in adolescents and young adults, 1999-2018. JAMA Pediatr. 2021;175(2):194–6.

    Article  PubMed  Google Scholar 

  11. Special Advisory Committee on the Epidemic of Opioid Overdoses. Opioid and Stimulant-related Harms in Canada. Ottawa: Public Health Agency of Canada; 2021.

    Google Scholar 

  12. Pearce LA, Min JE, Piske M, Zhou H, Homayra F, Slaunwhite A, et al. Opioid agonist treatment and risk of mortality during opioid overdose public health emergency: population based retrospective cohort study. BMJ. 2020;368:772.

    Article  Google Scholar 

  13. Hadland SE, Yule AM, Levy SJ, Hallett E, Silverstein M, Bagley SM. Evidence-based treatment of young adults with substance use disorders. Pediatrics. 2021;147(Suppl 2):S204–s14.

    Article  PubMed  Google Scholar 

  14. Welsh JW, Dennis ML, Funk R, Mataczynski MJ, Godley MD. Trends and age-related disparities in opioid use disorder treatment admissions for adolescents and young adults. J Subst Abus Treat. 2021;132:108584.

    Article  Google Scholar 

  15. Alinsky RH, Zima BT, Rodean J, Matson PA, Larochelle MR, Adger H Jr, et al. Receipt of addiction treatment after opioid overdose among Medicaid-enrolled adolescents and young adults. JAMA Pediatr. 2020;174(3):e195183.

    Article  PubMed  PubMed Central  Google Scholar 

  16. Mintz CM, Presnall NJ, Sahrmann JM, Borodovsky JT, Glaser PEA, Bierut LJ, et al. Age disparities in six-month treatment retention for opioid use disorder. Drug Alcohol Depend. 2020;213:108130.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  17. Kimmel SD, Gaeta JM, Hadland SE, Hallett E, Marshall BDL. Principles of harm reduction for young people who use drugs. Pediatrics. 2021;147(Suppl 2):S240–s8.

    Article  PubMed  Google Scholar 

  18. British Columbia Centre on Substance Use, B.C. Ministry of Health, & B.C. Ministry of Mental Health and Addictions. A Guideline for the Clinical Management of Opioid Use Disorder—Youth Supplement. 2018. Available at: http://www.bccsu.ca/care-guidance-publications/.

  19. Levy S. Youth and the opioid epidemic. Pediatrics. 2019;143(2):e20182752.

    Article  PubMed  Google Scholar 

  20. American Academy of Pediatrics. Medication-assisted treatment of adolescents with opioid use disorders. Pediatrics. 2016;138(3):e20161893.

  21. Rowe CL. Family therapy for drug abuse: review and updates 2003–2010. J Marital Fam Ther. 2012;38(1):59–81.

    Article  PubMed  Google Scholar 

  22. Hogue A, Liddle HA. Family-based treatment for adolescent substance abuse: controlled trials and new horizons in services research. J Fam Ther. 2009;31(2):126–54.

    Article  PubMed  PubMed Central  Google Scholar 

  23. Kaur L, Tadros E, Patton R. The role of family in youth opioid misuse: a literature review. Fam J. 2019;27(4):429–42.

    Article  Google Scholar 

  24. Spoth R, Trudeau L, Shin C, Ralston E, Redmond C, Greenberg M, et al. Longitudinal effects of universal preventive intervention on prescription drug misuse: three randomized controlled trials with late adolescents and young adults. Am J Public Health. 2013;103(4):665–72.

    Article  PubMed  PubMed Central  Google Scholar 

  25. Pugatch M, Knight JR, McGuiness P, Sherritt L, Levy S. A group therapy program for opioid-dependent adolescents and their parents. Subst Abus. 2014;35(4):435–41.

    Article  PubMed  Google Scholar 

  26. Vo HT, Burgower R, Rozenberg I, Fishman M. Home-based delivery of XR-NTX in youth with opioid addiction. J Subst Abus Treat. 2018;85:84–9.

    Article  Google Scholar 

  27. Fishman M, Wenzel K, Vo H, Wildberger J, Burgower R. A pilot randomized controlled trial of assertive treatment including family involvement and home delivery of medication for young adults with opioid use disorder. Addiction. 2021;116(3):548–57.

    Article  PubMed  Google Scholar 

  28. Guarino HM, Marsch LA, Campbell WS 3rd, Gargano SP, Haller DL, Solhkhah R. Methadone maintenance treatment for youth: experiences of clients, staff, and parents. Subst Use Misuse. 2009;44(14):1979–89.

    Article  PubMed  Google Scholar 

  29. Ludwig A, Monico LB, Lertch E, Schwartz RP, Fishman M, Mitchell SG. Until there’s nothing left: caregiver resource provision to youth with opioid use disorders. Subst Abus. 2021;42(4):1–8.

  30. Minkler M, Wallerstein N. In: Minkler M, Wallerstein N, editors. Community-based participatory research for health :from process to outcomes. 2nd ed. San Francisco, CA: Jossey-Bass; 2008. p. 508.

    Google Scholar 

  31. Chen E, Leos C, Kowitt SD, Moracco KE. Enhancing community-based participatory research through human-centered design strategies. Health Promot Pract. 2020;21(1):37–48.

    Article  PubMed  Google Scholar 

  32. Chen E, Neta G, Roberts MC. Complementary approaches to problem solving in healthcare and public health: implementation science and human-centered design. Transl Behav Med. 2020;11(5):1115–21.

  33. Marchand K, Tallon C, Katan C, Fairbank J, Fogarty O, Pellatt KM, et al. Improving treatment together: a protocol for a multi-phase, community-based participatory, and co-design project to improve youth opioid treatment service experiences in British Columbia. Addict Sci Clin Pract. 2021;16(1):53.

    Article  PubMed  PubMed Central  Google Scholar 

  34. Tong A, Sainsbury P, Craig J. Consolidated criteria for reporting qualitative research (COREQ): a 32-item checklist for interviews and focus groups. Int J Qual Health Care. 2007;19(6):349–57.

    Article  PubMed  Google Scholar 

  35. BC Coroners Service. Illicit drug toxicity deaths in BC January 1, 2011 – January 31, 2021 BC: Ministry of Public Safety and Solicitor General; 2021. [Available from: https://www2.gov.bc.ca/assets/gov/birth-adoption-death-marriage-and-divorce/deaths/coroners-service/statistical/illicit-drug.pdf

  36. Bate P, Robert G. Experience-based design: from redesigning the system around the patient to co-designing services with the patient. Qual Saf Health Care. 2006;15(5):307–10.

    Article  PubMed  PubMed Central  Google Scholar 

  37. QSR International Pty Ltd. NVivo (Version 12). Australia 2018.

  38. Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol. 2006;3(2):77–101.

    Article  Google Scholar 

  39. British Columbia Infants Act. (1996). [Available from: https://www.bclaws.gov.bc.ca/civix/document/id/complete/statreg/96223_01].

  40. Zuckermann AME, Williams GC, Battista K, Jiang Y, de Groh M, Leatherdale ST. Prevalence and correlates of youth poly-substance use in the COMPASS study. Addict Behav. 2020;107:106400.

    Article  PubMed  Google Scholar 

  41. Sverdlichenko I, Hawke LD, Henderson J. Understanding the service needs of youth with opioid use: a descriptive study of demographics and co-occurring substance use and mental health concerns. J Subst Abus Treat. 2021;132:108592.

  42. Cicek E, Demirel B, Ozturk HI, Kayhan F, Cicek IE, Eren I. Burden of care and quality of life in relatives of opioid dependent male subjects. Psychiatr Danub. 2015;27(3):273–7.

    PubMed  Google Scholar 

  43. Kelly JF, Fallah-Sohy N, Cristello J, Bergman B. Coping with the enduring unpredictability of opioid addiction: an investigation of a novel family-focused peer-support organization. J Subst Abus Treat. 2017;77:193–200.

    Article  Google Scholar 

  44. Tyo MB, McCurry MK, Horowitz JA, Elliott K. Predictors of burden and resilience in family caregivers of individuals with opioid use disorder. J Addict Nurs. 2021. Online ahead of print.

  45. Bagley SM, Hadland SE, Commentary on Fishman, et al. Youth and family-centered care for young adults with opioid use disorder. Addiction. 2021;116(3):558–9.

    Article  PubMed  Google Scholar 

  46. Morris H, Hyshka E, Schulz P, Jenkins E, Haines-Saah RJ. "It's a bit of a double-edged sword": motivation and personal impact of bereaved Mothers' advocacy for drug policy reform. Qual Health Res. 2021;31(10):1812–22.

    Article  PubMed  PubMed Central  Google Scholar 

  47. Jenkins E, Slemon A, Morris H, Hyshka E, Schulz P, Haines-Saah RJ. Bereaved mothers’ engagement in drug policy reform: a multisite qualitative analysis. Int J Drug Policy. 2021;91:103011.

    Article  PubMed  Google Scholar 

  48. Settipani CA, Hawke LD, Cleverley K, Chaim G, Cheung A, Mehra K, et al. Key attributes of integrated community-based youth service hubs for mental health: a scoping review. Int J Ment Heal Syst. 2019;13:52.

    Article  Google Scholar 

  49. Hetrick SE, Bailey AP, Smith KE, Malla A, Mathias S, Singh SP, et al. Integrated (one-stop shop) youth health care: best available evidence and future directions. Med J Aust. 2017;207(10):S5–s18.

    PubMed  Google Scholar 

  50. Henderson J, Hawke LD, Iyer SN, Hayes E, Darnay K, Mathias S, et al. Youth perspectives on integrated youth services: a discrete choice conjoint experiment. Can J Psychiatr. 2021:7067437211044717. Online ahead of print.

  51. Hawke LD, Thabane L, Wilkins L, Mathias S, Iyer S, Henderson J. Don't forget the caregivers! A discrete choice experiment examining caregiver views of integrated youth services. Patient. 2021;14(6):791–802.

    Article  PubMed  PubMed Central  Google Scholar 

  52. Hawke LD, Thabane L, Iyer SN, Jaouich A, Reaume-Zimmer P, Henderson J. Service providers endorse integrated services model for youth with mental health and substance use challenges: findings from a discrete choice experiment. BMC Health Serv Res. 2021;21(1):1035.

    Article  PubMed  PubMed Central  Google Scholar 

  53. Pro G, Zaller N. Interaction effects in the association between methadone maintenance therapy and experiences of racial discrimination in U.S. healthcare settings. PLoS One. 2020;15(2):e0228755–e.

    Article  PubMed  PubMed Central  Google Scholar 

  54. Jalali MS, Botticelli M, Hwang RC, Koh HK, McHugh RK. The opioid crisis: a contextual, social-ecological framework. Health Res Policy Syst. 2020;18(1):87.

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

The Improving Treatment Together Project is grateful to be taking place on the traditional lands of many different Indigenous Nations and Peoples across what is now called British Columbia. We are also incredibly grateful to the participants who shared their expertise, experiences, wisdom, and time during the Phase 1 workshops. We also acknowledge the community-based partners at Foundry Prince George, Foundry Vancouver Granville, and Foundry Victoria for the ongoing support provided throughout this project. We also acknowledge the caregivers who took the time to provide their feedback on the findings and the final version of the manuscript.

Funding

The Improving Treatment Together Project has been made possible through a financial contribution from Health Canada. The views herein do not necessarily represent the views of Health Canada. Author Kirsten Marchand is supported by a Michael Smith Foundation for Health Research/Centre for Health Evaluation & Outcome Sciences Research Trainee award and author Skye Barbic by a Scholar grant funded by the Michael Smith Foundation for Health Research.

Author information

Authors and Affiliations

Authors

Contributions

Authors CT, CK, JF, SM, and SB made substantial contributions to the conception and design of the Improving Treatment Together Project. Authors CK, CT, CB, and OF made substantial contributions to the collection of Phase 1 workshop data. Authors KM, RT, and CB made substantial contributions to the analysis. All authors made intellectual contributions to the manuscript and approved the final version to be published.

Corresponding author

Correspondence to Kirsten Marchand.

Ethics declarations

Ethics approval and consent to participate

The project received harmonized ethics review and approval from the University of British Columbia/Providence Health Care Behavioural Research Ethics Board (Study ID: H19-02077). All participants provided fully informed consent to participate prior to any research procedures taking place.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Marchand, K., Turuba, R., Katan, C. et al. Becoming our young people’s case managers: caregivers’ experiences, needs, and ideas for improving opioid use treatments for young people using opioids. Subst Abuse Treat Prev Policy 17, 34 (2022). https://0-doi-org.brum.beds.ac.uk/10.1186/s13011-022-00466-2

Download citation

  • Accepted:

  • Published:

  • DOI: https://0-doi-org.brum.beds.ac.uk/10.1186/s13011-022-00466-2

Keywords