BMJ Open
Care-experienced cHildren and young people’s Interventions to improve Mental health and wEll-being outcomes: Systematic review (CHIMES) protocol
DOI: 10.1136/bmjopen-2020-042815, Volume: 11, Issue: 1
Article Type: other, Article History


The mental health and well-being of children and young people who have been in care (ie, care-experienced) are a priority. There are a range of interventions aimed at addressing these outcomes, but the international evidence-base remains ambiguous. There is a paucity of methodologically robust systematic reviews of intervention effectiveness, with few considering the contextual conditions under which evaluations were conducted. This is important in understanding the potential transferability of the evidence-base across contexts. The present systematic review will adopt a complex systems perspective to synthesise evidence reporting evaluations of mental health and well-being interventions for care-experienced children and young people. It will address impact, equity, cost-effectiveness, context, implementation and acceptability. Stakeholder consultation will prioritise a programme theory, and associated intervention, that may progress to further development and evaluation in the UK.

Methods and analysis

We will search 16 bibliographic databases from 1990 to June 2020. Supplementary searching will include citation tracking, author recommendation, and identification of evidence clusters relevant to included evaluations. The eligible population is children and young people (aged ≤25 years) with experience of being in care. Outcomes are (1) mental, behavioural or neurodevelopmental disorders; (2) subjective well-being; (3) self-harm; suicidal ideation; suicide. Study quality will be appraised with methodologically appropriate tools. We will construct a taxonomy of programme theories and intervention types. Thematic synthesis will be used for qualitative data reporting context, implementation and acceptability. If appropriate, meta-analysis will be conducted with outcome and economic data. Convergent synthesis will be used to integrate syntheses of qualitative and quantitative data.

Ethics and dissemination

We have a comprehensive strategy for engagement with care-experienced children and young people, carers and social care professionals. Dissemination will include academic and non-academic publications and conference presentations. Ethical approval from Cardiff University’s School of Social Sciences REC will be obtained if necessary.

PROSPERO registration number


Evans, Boffey, MacDonald, Noyes, Melendez-Torres, Morgan, Trubey, Robling, Willis, and Wooders: Care-experienced cHildren and young people’s Interventions to improve Mental health and wEll-being outcomes: Systematic review (CHIMES) protocol
Strengths and limitations of this study
  • This review will offer one of the first methodologically robust syntheses of evidence reporting evaluations of mental health and well-being interventions for care-experienced children and young people.
  • In taking a complex systems approach, the review will provide insights into the potential transferability of interventions and the replicability of effects across contexts.
  • From this review, the study team aim to identify a potential programme theory (and associated intervention) that can progress to further development and evaluation in the UK context.
  • The review will support policy-makers and practitioners in decision-making about how to support the mental health and well-being of children and young people who have been in care.
  • The review is limited by only including studies published in higher resource countries.



The mental health and well-being of children and young people who have been in care (ie, care-experienced) is a growing public health and social care concern. Internationally, almost 50% of individuals involved in the child welfare system have a diagnosable mental health condition.1 Meanwhile in the UK, they are nearly five times as likely to have at least one psychiatric diagnosis compared with the general population.2 Care-experienced individuals are at an elevated risk of poor subjective well-being3 and are more than four times as likely to attempt suicide.3 Adverse mental health outcomes incur significant health and social care costs, often due to the associated risk of placement instability and breakdown.5 6 Evidence from the UK reports that insecure and unstable care placements cost £22 415 more per child per annum (across health, social care and criminal justice) than stable care pathways.7

There is a clear need to improve mental health provision for those who experience care, with NICE guidance stating that the UK evidence base does not adequately serve this population.8 Equally, while the Department for Education and Department of Health and Social Care’s joint statutory guidance has mandated that local authorities ensure timely and adequate services,9 there are reported incidents of failure to identify need, overly stringent eligibility thresholds, and withholding of care where there is not a stable placement.10 A comprehensive synthesis is required to identify evidence-based interventions in order to develop recommendations to enhance policy and practice.

Internationally there is a large evidence base for interventions,11–22 although in the UK it remains emergent. Current interventions focus on preventative approaches that operate across socioecological domains, including community level change (eg, Flying Start),23 functioning within the care placement,24 25 the theoretical orientation of social care teams (eg, adoption of a trauma informed model),26 and the social and emotional competencies of the individual child or young person.27 Meanwhile, treatment has tended to focus on both the type and availability of therapeutic approaches, such as counselling or access to mental health services.28

Despite the size of the extant literature, there are limitations that need to be attended to, notably in regard to existing systematic reviews. First, the most inclusive syntheses lack rigorous methodologies. One of the most recent and relevant literature reviews recognised that it is not exhaustive.11 Second, reviews tend to focus on a limited number of intervention types (eg, treatment foster care),12 populations (eg, foster care),12 14 18 27 28 or outcomes (eg, externalising behaviours).18 19 This makes it difficult to know if a particular intervention can work effectively with different populations across multiple outcomes in order to reduce the number of approaches needing to be resourced within a system. Third, reviews often include only rudimentary treatment of context and process data. Understanding the complex system in which interventions operate is imperative. International variations in social care and healthcare systems may constrain the transferability of evidence and the extent to which we can ‘borrow strength’ from the original evaluation.29 For example, Multidimensional Treatment Foster Care (MTFC) is shown to not be effective in Sweden, despite demonstrating effects in the USA, as it is essentially equal to usual care.30

The present mixed method systematic review will use a robust methodology to draw together the evidence-base for interventions aimed at improving the mental health and well-being of care-experienced children and young people, including those currently in care and those who have previously been in care. Adopting a complex systems perspective,31 32 we will synthesise evidence of impact, equity and cost effectiveness, while also focusing on understanding how intervention effects are contingent on the context in which they are evaluated. In collaboration with stakeholders (young people, carers and social care professionals), the resulting synthesis will be used to identify, where possible, an overarching programme theory (or theories) that may inform the development or adaptation of an intervention to progress to further evaluation within the UK context.

Review aims and questions

The study aims to systematically review and synthesise international evidence on interventions to improve the mental health and well-being of care-experienced children and young people. We will address the following research questions:

RQ1: What are the types, theories and outcomes tested in mental health and well-being interventions for care-experienced children and young people?

RQ2: What are the effects (including inequities and harms) and economic effects of interventions?

RQ3: How do contextual characteristics shape implementation factors, and what are key enablers and inhibitors of implementation?

RQ4: What is the acceptability of interventions to key stakeholders?

RQ5: Can and how might intervention types, theories, components, and outcomes be related in an overarching system-based programme theory?

On the completion of the initial phases of the systematic review (RQ1–5), the study will undertake a second phase of research and address a further research question:

RQ6: Drawing on the findings from RQ1–5, what do stakeholders think is the most effective, feasible and acceptable intervention in the UK that could progress to further outcome or implementation evaluation?


Protocol and registration

The protocol is registered with PROSPERO and reported in accordance with the Preferred Reporting Items for Systematic reviews and Meta-Analyses Protocols (PRISMA-P) guidelines.33 The review will be published in accord with the PRISMA guidelines,34 with qualitative synthesis being structured by the ENTREQ reporting standards35 and the mixed methods process evaluation synthesis following the principles prescribed by Cochrane.36

Eligibility criteria

The eligibility parameters are reported in accordance with the PICOS framework and presented in the logic model (online supplemental A).



Population: children and young people aged 25 years olds. Where the target population extends beyond the age of 25 years old (eg, 18–30 years old), subgroup data must be provided for participants aged 25 years olds. Currently placed in care or previous care experience. Period of time in care is not restricted. Care can include in-home care (ie, voluntary transfer of parental responsibility to statutory services) and out-of-home care (eg, foster care, residential care, or formal kinship care). No restriction on baseline mental health conditions or uptake of pharmacological treatment. The following are excluded: general population; children in need; individuals at the edge of care; care without specified statutory involvement (eg, informal kinship care); adoption; and refugees. Any population may be targeted as intervention participants (eg, carer, birth family, teacher or social worker) but outcomes must be reported at the level of the child or young person.

Intervention: any attempt to disrupt existing system practices. They may be monocomponent or multicomponent and operate across any of the following socioecological domains: individual; interpersonal; organisational; community; and policy/legal. Interventions may focus on promotion/prevention or the management/treatment of symptomology. There are no a priori criteria for implementation (ie, delivery setting, delivery mode, delivery agent). The following are excluded: pharmacological interventions, either as a single component approach or multicomponent intervention (eg, combined with psychosocial activities).

Comparator: treatment as usual; other active treatment; no specified treatment.

Outcomes: three domains of primary outcomes: (1) mental, behavioural or neurodevelopmental disorders as specified by ICD-11; (2) Subjective well-being (eudaimonia and hedonia); (3) self-harm; suicidal ideation; suicide. Measures may use dichotomous, categorical or continuous variables. Outcomes may be ascertained through clinical assessment, self-report or report by another informant (eg, teacher).

Study design: programme theory: describe intended theory, logic model or mechanisms of effect. May include mediation analysis (RQ1); outcome evaluation: (individual/cluster) randomised controlled trials and quasiexperimental study designs. We exclude post measurement only or pre–post measurement in intervention group only (RQ1; RQ2); process evaluation: all qualitative and quantitative study designs (RQ1; RQ3; RQ4). Included studies must empirically report on relevant contextual influences, implementation or acceptability; economic evaluation: must relate costs to benefits and can report: cost-minimisation, cost-effectiveness, cost utility or cost–benefit analysis. May be model based or trial based. Decision-analytic models capturing intervention impacts on mental health and well-being will be eligible (RQ2). Relationship between study designs: to be included programme theory papers must have an associated empirical outcome evaluation. Process evaluations and economic evaluations do not necessarily have to be linked to an empirical outcome evaluation, as they provide wider contextual insight into how interventions interact with complex system characteristics.

Information sources

The following electronic bibliographic databases will be searched: ASSIA, British Education Index, Child Development & Adolescent Studies, CINAHL, Embase, ERIC, Cochrane Database of Clinical Controlled Trials (CENTRAL), HMIC, IBSS, Medline (Medline in Process and Medline ePub), PsycINFO, Scopus, Social Policy & Practice, Social Services Abstracts, Sociological Abstracts and Web of Science (Social Sciences Citation Index, Conference Proceedings Citation Index—Social Science & Humanities, Emerging Sources Citation Index). Supplementary searching techniques will include citation tracking of included studies, contacting international experts, searching trial registers and consulting websites of key social and healthcare organisations. Searches will be conducted for ‘clusters’ of reports related to included studies to develop descriptions of programme theories and further progress understanding of context.37 38 Inclusion will be restricted from 1990, which marked the ratification of the UN Convention on the Rights of the Child.39 This prescribed comprehensive social and healthcare provision for children internationally and started the proliferation of intervention in this area. To maximise applicability of evidence to the UK, studies from low-income and middle-income countries will be excluded. All languages will be included in searches.

Search strategy

We developed a provisional search strategy in Ovid Medline (online supplemental B). It will be adapted to the functionality of each database on study commencement.



Data management and study selection

Data will be exported to endnote for deduplication and then to EPPI Reviewer Web for screening. In the first instance reference titles will be screened on the basis of title to identity clearly irrelevant retrievals (eg, pharmacological treatments), with these exclusions being verified by a second reviewer. Titles and abstracts of remaining studies will be screened independently and in duplicate. The inclusion criteria proforma will be piloted and calibrated by two reviewers screening the same 100 title and abstracts, with disagreement being resolved through consensus or recourse to a third reviewer. Full texts will be retrieved and appraised for study inclusion. Conflicts will be resolved through discussion or recourse to a third reviewer. A record of the selection process will be retained in adherence with the PRISMA flow diagram.

Data collection

Once the final number of included studies is confirmed, we will chart clusters of studies, constructing a visual knowledge map similar to that recommended within scoping reviews.40 41 This process will support decision-making about the depth of data extraction at the next stage (eg, sampling may be conducted for qualitative studies) and extent of synthesis to be undertaken (eg, meta-analysis may be conducted where there are multiple studies). The cHildren and young people’s Interventions to improve Mental health and wEll-being outcomes: Systematic review (CHIMES) review has a study advisory group that will be consulted at this stage to confirm the extraction and synthesis.

Standardised data extraction forms will be developed and calibrated with a subset of studies for input to EPPI Reviewer Web. Two versions of extraction forms may be developed based on the mapping of the data. The first will be for studies included in the review but not included in more in-depth synthesis, and the second for studies subjected to more in-depth synthesis. For primary qualitative studies a subset of data will be coded in vivo to develop a preliminary coding tree with a priori codes, but which can be amended to incorporate emergent codes. On confirmation of the extraction forms and coding tree, two reviewers will independently extract and code data from 10% of studies, with the remainder being extracted by one reviewer and verified by a second.

Data items

For all studies data will be extracted on: study characteristics, participant demographics; setting; study design and methods; intervention theory of change and intervention characteristics. For outcome evaluations data will be extracted for: measurements, sequence generation, allocation concealment, blinding, data completeness, baseline differences and adjustment for difference, control of confounding, and outcomes at follow-up at both population and subgroup level. Data items from process evaluations will be the implementation theory, implementation strategy and implementation agents. Quantifiable assessments of implementation will be reach, receipt, and fidelity. Contextual characteristics will be classified according to the context and implementation of complex interventions (CICI) framework: geographical; epidemiological; legal; socioeconomic; sociocultural; ethical; and political.42 Acceptability data across stakeholders will be extracted. Economic evaluation data items will be intervention and comparator costs, perspective, structural and empirical inputs, time horizon, and cost-effectiveness. Health utility data will also be extracted. Where there is incomplete data the author will be asked for additional information and where this is not retrieved the data will be reported as missing and included in the risk of bias assessment.

Risk of bias (individual studies)

Study data will be appraised with a methodologically appropriate tool. Programme theory will be appraised using a tailored appraisal tool developed by members of the research team.43 Domains of assessment will be: clarity of constructs; clarity of relationships between constructs; testability; parsimony and generalisability.

Outcome evaluations will be assessed with the relevant tool prescribed by the Cochrane Handbook for Systematic Reviews of Interventions.44 In the case of randomised controlled trials, risk of bias will be identified across seven domains: sequence generation; allocation concealment; blinding of participants, personnel and outcome assessments; completeness of outcome data; selective reporting of outcomes; other sources of bias. Each domain will be rated as high risk, low risk or unclear risk.

Qualitative data within process evaluations will be appraised using a tool developed in previous systematic reviews.45 46 It will address two key domains: reliability and trustworthiness (sampling rigour; data collection rigour; analysis rigour; data supporting analysis); and usefulness (breadth/depth of findings; privileges participant perspectives). Two global assessments of overall reliability/trustworthiness and overall usefulness will then be made. Domains are rated as high, medium or low.

Economic data will be appraised with the Drummond checklist.47 It will assess if there are appropriate descriptions of comparators; identification and valuation of costs and consequences; discounting; and analysis of uncertainty. We will also consider the governance and ethical conduct of studies.48 All quality appraisal will be undertaken independently and in duplicate, with disagreement being resolved through discussion or recourse to a third reviewer.

Synthesis of results

Programme theory, context, implementation and acceptability (RQ1; RQ4; RQ5)

We will construct a single taxonomy describing intervention types, theories and outcomes. It will be used to understand if there are different or dominant theories according to different types of interventions and/or outcomes.43 Context and implementation will be classified according to the CICI framework.42 Implementation will also comprise data on quantifiable assessments of implementation, including: reach; receipt; and fidelity. Acceptability will draw on the understanding, as outlined by Medical Research Council (MRC) guidance on process evaluations.49 It will include simplistic measures of satisfaction to more complex, often qualitative considerations of the experience of engaging with the intervention. Acceptability will be explored for participants, delivery agents and service funders.

Analysis will adhere to the five phases of framework synthesis50–53: (1) familiarisation with included studies; (2) develop a thematic framework based on the parameters of the review. This will be refined and calibrated with a subset of data; (3) index the remaining corpus of data. New themes, and associated codes, may be generated in vivo through the process of constant comparison across studies and against the framework; (4) charting the data into a framework matrix summarising data by category from each transcript; (5) mapping and interpreting data to create the typology of interventions and to explain associations between themes to help understand how and why interventions may or may not be effective. The synthesis may be presented graphically and narratively.

Intervention outcome effects, equities and economic effects (RQ2)

The taxonomy describing intervention types, theories and outcomes will inform and structure the analyses undertaken as part of the quantitative synthesis. Depending on intervention heterogeneity we will consider meta-analysing effect estimates from outcome evaluations. In preparation for meta-analysis, we will extract effect estimates from studies that will be classified into outcome domains. Where appropriate outcomes will be converted to ORs using logistic transformation for pooling. Estimates from cluster randomised trials will be checked for unit of analysis issues, and where necessary, an inflation factor will be applied to the SE of effect estimates. Where intracluster correlation coefficients (ICC) are not available and effect estimates have not been adjusted for clustering, we will impute an ICC using the average of estimates for specific outcomes from ‘most similar’ intervention evaluations.

We will undertake robust variance estimation meta-analyses according to intervention type, outcome and timepoint, considering up to 6 months from baseline as short term, 6 months to 2 years as mid term, and beyond 2 years as long term. Robust variance estimation meta-analysis is a method that permits the inclusion of more than one effect estimate per study in a meta-analysis; this is in contrast to standard meta-analysis models that assume independence between individual effect estimates. It is common in meta-analysis of psychosocial interventions for outcome evaluations to present multiple relevant effect estimates per outcome (eg, multiple estimates of child behavioural problems). This method will permit use of all relevant information from included studies. Within each meta-analysis, we will examine heterogeneity using a combination of Cochran’s Q, tau-squared and I2. Where heterogeneity is substantial (I2 >50%), we will scrutinise included studies to hypothesise and explore the reasons for this.

Equity effects will be categorised according to PROGRESS-Plus.54 Data will be reported in adherence to the PRISMA E-2012 extension.55 We will use harvest plots to assess equity effects and metaregression to test whether characteristics of study populations are associated with effectiveness. Intervention harms will be treated in accordance with the PRISMA harms extension.56

Economic evaluations will be summarised. Summarised data will include measures of costs, cost-effectiveness, indirect resource use, and whether a trial-based or model-based analysis was conducted. If there is sufficient homogeneity in measures across studies, these will be synthesised via meta-analysis. Measures of costs, cost-effectiveness and indirect resource use will be adjusted in line with inflation and currency to provide a contextually relevant estimate of costs in the current UK context.

Synthesis of qualitative and quantitative syntheses

The review will adhere to a convergent synthesis design.57 58 This will entail the separate synthesis and reporting of qualitative and quantitative data in methodologically relevant but complementary manner, before integrating them in a further synthesis (figure 1). At this stage, the synthesis of context, implementation and acceptability will be integrated with outcome data to explain intervention effectiveness and potential inequities. To support this, we will use a narrative summary and a 2×2 matrix that will map context, implementation, acceptability, participant values and costs against the included intervention theories/types.59 The matrix can demonstrate where an intervention may have (in)sufficiently accommodated factors that led to its (in)effectiveness, and what factors need to be better attended to moving forward. We will additionally develop a logic model(s) of a potentially effective programme theory or theories that is a best fit with the evidence base.

Children and young people’s interventions to improve mental health and well-being outcomes: systematic review results-based convergent synthesis design.
Figure 1
Children and young people’s interventions to improve mental health and well-being outcomes: systematic review results-based convergent synthesis design.

To support harmonisation and integration of syntheses across the review, we have formulated research questions that are complementary and contingent, where achieving a comprehensive answer to one question is dependent on the answers to other questions. When conducting the review, we will: (1) have the same members of the research team work on both the synthesis of qualitative and quantitative data; (2) screen all study types simultaneously and by the same members of the research team, storing data in EPPI Reviewer to ensure easy sharing of study data across syntheses; and (3) use method specific appraisal tools that have been combined in previous reviews due to providing epistemological flexibility or consonance. We will consider appraising the certainty of evidence generated through the different reviews with the compatible tools of GRADE60 and GRADE CERQual.61

Programme theory modelling, stakeholder consultation and intervention prioritisation

From the review findings, we will aim to identify an overarching programme theory (or compatible programme theories across socioecological domains), and associated interventions, which can address multiple outcomes across a number of populations (RQ5). These will be diagrammatically depicted with the use of system-based logic models and an accompanying narrative summary.62 Using the review logic model as a departure point, we will integrate review data to clarify and expand on key intervention domains: theory (theories of change); setting; population; context; implementation; and outcomes. The logic mode (s) then will illustrate the relationship between the underpinning theories of change, intervention effectiveness and important modifying factors that impact on implementation and acceptability.

Stakeholder consultations will be held to prioritise the theories and interventions that might be most feasible and acceptable within the UK context and which may progress to further evaluation (RQ6) (see patient and public involvement section for stakeholder description). There are three phases of assessment as part of this prioritisation process (figure 2):

Phase 1 intervention identification

Intervention prioritisation for development, adaptation and evaluation in UK context.
Figure 2
Intervention prioritisation for development, adaptation and evaluation in UK context.

Stakeholders will assess and rank candidate programme theories, and associated interventions, against the following progression criteria: (1) acceptability; (2) feasibility (particularly in UK context); and (3) perceived effectiveness. At the end of this phase, there should be a potential programme theory and possible intervention components. Where no candidate theories meet the progression criteria, or an overarching theory is identified but there are no intervention components (eg, no intervention embodies all of the interacting aspects of the theory), we will consider that de novo intervention development is required.

Phase 2 intervention development and adaptation

If a programme theory is identified, and has an associated intervention, stakeholders will assess if adaptation is required for the UK context (if evaluated elsewhere). This will be done by mapping similarities in contexts using a simplified version of the CICI framework.42 If contexts are considered dissimilar, stakeholders will consider the types of adaptations that may be required. MRC-NIHR funded guidance on adaptation will support this discussion.63 64 65 If a de novo intervention is deemed necessary, we will ask stakeholders to undertake preliminary consultation on what an intervention might look like, considering what contextual factors need to be accommodated in order to make it acceptable, feasible and effective.

Phase 3 intervention evaluation

This phase will consider the appropriate research design for progressing the intervention. We will use the MRC’s guidance on developing and evaluating complex interventions to define the phase of evaluation.66 To support decision-making in the case where it is appropriate to evaluate an existing intervention (adapted or non-adapted), we will use the ‘borrowing strength’ framework to assess if any outcome data from the original context is applicable within the UK context.29 The framework dictates that if contexts are largely congruent or adaptations are minimal, then an implementation study may be warranted. Where contexts are significantly dissimilar or substantial adaptation has been undertaken, more extensive feasibility and outcome evaluation will be required. It is likely that decision-making at this phase will be predominantly conducted by the research team. On completion of the three prioritisation phases, we anticipate having a clearly identified research agenda to progress beyond the review.

Ethics and dissemination


Cardiff University’s School of Social Sciences Research Ethics Committee will provide ethical approval for the stakeholder consultation if required.

Patient and public involvement

The review includes a comprehensive programme of PPI. Engagement with children and young people will be facilitated through Children’s Social Care Research and Development Centre (CASCADE) Voices, a collaboration between Voices from Care Cymru and the CASCADE at Cardiff University. CASCADE Voices comprises a research advisory group of care-experienced young people. We will consult with them at study commencement to refine and confirm the scope and focus of the review, notably the key subgroups to be analysed and the contextual influences on implementation.

To support the prioritisation of interventions moving forward, we will hold afurther consultation with CASCADE Voices. A social care practitioner workshop will be hosted with the ExChange Wales Network. The network, hosted by CASCADE, brings together social care sector stakeholders to share experiences and expertise. Further consultation opportunities will be sought with the UKRI funded Transdisciplinary Research for the Improvement of Young Mental Public Health (TRIUMPH) Network. The CHIMES study principal investigator (RE) coleads the networks’ programme on the mental health of key groups, which includes care-experienced young people.


Outputs from the study will be (1) NIHR-PHR monograph; (2) academic publications reporting the results; and (3) a briefing report for policy and practitioners. Presentations will be delivered at academic, policy and practice workshops and conferences, both nationally and internationally. Networks and research infrastructures will be utilised to disseminate findings, notably TRIUMPH and the What Works Centre for Children’s Social Care. The latter organisation was funded by the Department for Education and supported by Cardiff University, with the aim of improving outcomes for children in care. It has a focus on evidence synthesis, providing a depository of evidence summaries on their website for social care professionals. Further dissemination activities will be identified in collaboration with PPI stakeholders throughout the course of the study. Moving forward, sharing of knowledge on which interventions are likely to work means that finite public resources can be expended on approaches that can best ensure the positive mental health and well-being of care-experienced children and young people, while encouraging disinvestment from ineffective and potentially harmful approaches.


Twitter:: @1RhiannonEvans, @fosteringnet; @tfn_Wales, @janenoyes, @WillisWellbeing, @fosteringnet, tfn_Wales
Contributors:: RE secured funding for the study. RE, SM, HEM, JN, MR, GJM-T, RT and SW contributed to the design of the systematic review. SW and HEM developed the search strategy. MB and CW advised on the PPI engagement and stakeholder consultation strategy. REE drafted the protocol. All authors read and approved the final manuscript. RE is the guarantor of the review.
Funding:: This work was supported by the NIHR-PHR grant number NIHR129113. This work was supported by The (DECIPHer) funded by Welsh Government through Health and Care Research Wales. Centre for Development, Evaluation, Complexity and Implementation in Public Health Improvement. The Centre for Trials Research receives funding from Health and Care Research Wales and Cancer Research UK.
Competing interests:: None declared.
Patient consent for publication:: Not required.
Provenance and peer review:: Not commissioned; externally peer reviewed.
Supplemental material:: This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.


Bronsard G, Alessandrini M, Fond G, et al The prevalence of mental disorders among children and adolescents in the child welfare system: a systematic review and meta-analysis. Medicine 2016;95:e2622-e. doi: 10.1097/MD.0000000000002622

Ford T, Vostanis P, Meltzer H, et al Psychiatric disorder among British children looked after by local authorities: comparison with children living in private households. British Journal of Psychiatry 2007;190:31925. doi: 10.1192/bjp.bp.106.025023

Long SJ, Evans RE, Fletcher A, et al Comparison of substance use, subjective well-being and interpersonal relationships among young people in foster care and private households: a cross sectional analysis of the school health research network survey in Wales. BMJ Open 2017;7:e014198. doi: 10.1136/bmjopen-2016-014198

Evans R, White J, Turley R, et al Comparison of suicidal ideation, suicide attempt and suicide in children and young people in care and non-care populations: systematic review and meta-analysis of prevalence. Child Youth Serv Rev 2017;82:1229. doi: 10.1016/j.childyouth.2017.09.020

James S Why do foster care placements disrupt? an investigation of reasons for placement change in foster care. Soc Serv Rev 2004;78:60127. doi: 10.1086/424546

Rubin DM, Alessandrini EA, Feudtner C, et al Placement stability and mental health costs for children in foster care. Pediatrics 2004;113:133641. doi: 10.1542/peds.113.5.1336

Curtis L, Burns A Unit costs of health and social care 2017. Canterbury: Personal Social Services Research Unit, University of Kent, 2017.

NICE Looked-after children and young people. Public health guideline [PH28]. London: National Institute for Health and Care Excellence, 2010.

Department for Education Promoting the health and well-being of looked-after children. statutory guidance for local authorities, clinical commissioning groups and NHS England. London: Department for Education, 2015.


House of Commons Education Committee Mental health and well-being of looked-after children. fourth report of session 2015–16. London: House of Commons Education Committee, 2016.


Luke N, Sinclair I, Woolgar M What works in preventing and treating poor mental health in looked after children. London: NSPCC, 2014.


Turner W, Macdonald G Treatment foster care for improving outcomes in children and young people: a systematic review. Res Soc Work Pract 2011;21:50127. doi: 10.1177/1049731511400434


Everson-Hock ES, Jones R, Guillaume L, et al The effectiveness of training and support for carers and other professionals on the physical and emotional health and well-being of looked-after children and young people: a systematic review. Child Care Health Dev 2012;38:16274. doi: 10.1111/j.1365-2214.2011.01247.x


Hambrick EP, Oppenheim-Weller S, N'zi AM, et al Mental health interventions for children in foster care: a systematic review. Child Youth Serv Rev 2016;70:6577. doi: 10.1016/j.childyouth.2016.09.002


Everson-Hock ES, Jones R, Guillaume L, et al Supporting the transition of looked-after young people to independent living: a systematic review of interventions and adult outcomes. Child Care Health Dev 2011;37:76779. doi: 10.1111/j.1365-2214.2011.01287.x


Kerr L, Cossar J Attachment interventions with foster and adoptive parents: a systematic review. Child Abuse Review 2014;23:42639. doi: 10.1002/car.2313


O'Higgins A, Ott EM, Shea MW What is the impact of placement type on educational and health outcomes of unaccompanied refugee minors? A systematic review of the evidence. Clin Child Fam Psychol Rev 2018;21:35465. doi: 10.1007/s10567-018-0256-7


Marsh D A systematic review and meta-analysis of randomized clinical trials of evidence-based practices through measured change of behavior for children in foster care 2017.


Solomon DT, Niec LN, Schoonover CE The impact of foster parent training on parenting skills and child disruptive behavior. Child Maltreat 2017;22:313. doi: 10.1177/1077559516679514


Sullivan AL, Simonson GR A systematic review of school-based social-emotional interventions for refugee and war-traumatized youth. Rev Educ Res 2016;86:50330. doi: 10.3102/0034654315609419


Macdonald G, Turner W, Cochrane Developmental, Psychosocial and Learning Problems Group Treatment foster care for improving outcomes in children and young people. Cochrane Database Syst Rev 2008;19:Cd005649 doi: 10.1002/14651858.CD005649.pub2


Dickson K, Sutcliffe K, Gough D Improving the emotional and behavioural health of looked-after children and young people (LACYP): research review 2. London: Centre for Excellence and Outcomes in Children and Young People’s Services (C4EO), 2009.


Hutchings J, Griffith N, Bywater T, et al Evaluating the Incredible years toddler parenting programme with parents of toddlers in disadvantaged (flying start) areas of Wales. Child Care Health Dev 2017;43:10413. doi: 10.1111/cch.12415


Sinclair I, Parry E, Biehal N, et al Multi-Dimensional treatment foster care in England: differential effects by level of initial antisocial behaviour. Eur Child Adolesc Psychiatry 2016;25:84352. doi: 10.1007/s00787-015-0799-9


Briskman J, Castle J, Blackeby K Randomised controlled trial of the fostering changes programme. London: National Academy for Parenting Research/London: King’s College/Department of Education, 2012.


Lang JM, Campbell K, Shanley P, et al Building capacity for Trauma-Informed care in the child welfare system: initial results of a statewide implementation. Child Maltreat 2016;21:11324. doi: 10.1177/1077559516635273


Taussig HN, Culhane SE Impact of a mentoring and skills group program on mental health outcomes for maltreated children in foster care. Arch Pediatr Adolesc Med 2010;164:73946. doi: 10.1001/archpediatrics.2010.124


Bellamy JL, Gopalan G, Traube DE A national study of the impact of outpatient mental health services for children in long-term foster care. Clin Child Psychol Psychiatry 2010;15:46779. doi: 10.1177/1359104510377720


Aarons GA, Sklar M, Mustanski B, et al "Scaling-out" evidence-based interventions to new populations or new health care delivery systems. Implement Sci 2017;12:111. doi: 10.1186/s13012-017-0640-6


Westermark PK, Hansson K, Olsson M Multidimensional treatment foster care (MTFC): results from an independent replication. J Fam Ther 2011;33:2041. doi: 10.1111/j.1467-6427.2010.00515.x


Petticrew M, Knai C, Thomas J, et al Implications of a complexity perspective for systematic reviews and guideline development in health decision making. BMJ Glob Health 2019;4:e000899. doi: 10.1136/bmjgh-2018-000899


Booth A, Moore G, Flemming K, et al Taking account of context in systematic reviews and guidelines considering a complexity perspective. BMJ Glob Health 2019;4:e000840. doi: 10.1136/bmjgh-2018-000840


Moher D, Shamseer L, Clarke M, et al Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Syst Rev 2015;4:1. doi: 10.1186/2046-4053-4-1


Moher D, Liberati A, Tetzlaff J, et al Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med 2009;6:e1000097. doi: 10.1371/journal.pmed.1000097


Tong A, Flemming K, McInnes E, et al Enhancing transparency in reporting the synthesis of qualitative research: ENTREQ. BMC Med Res Methodol 2012;12:181. doi: 10.1186/1471-2288-12-181


Flemming K, Booth A, Hannes K, et al Cochrane qualitative and implementation methods group guidance series-paper 6: reporting guidelines for qualitative, implementation, and process evaluation evidence syntheses. J Clin Epidemiol 2018;97:7985. doi: 10.1016/j.jclinepi.2017.10.022


Harris JL, Booth A, Cargo M, et al Cochrane qualitative and implementation methods group guidance series-paper 2: methods for question formulation, searching, and protocol development for qualitative evidence synthesis. J Clin Epidemiol 2018;97:3948. doi: 10.1016/j.jclinepi.2017.10.023


Booth A, Harris J, Croot E, et al Towards a methodology for cluster searching to provide conceptual and contextual "richness" for systematic reviews of complex interventions: case study (CLUSTER). BMC Med Res Methodol 2013;13:118. doi: 10.1186/1471-2288-13-118


UNICEF The United nations convention on the rights of the child. London: UNICEF, 1989.


Arksey H, O'Malley L Scoping studies: towards a methodological framework. Int J Soc Res Methodol 2005;8:1932. doi: 10.1080/1364557032000119616


Levac D, Colquhoun H, O'Brien KK Scoping studies: advancing the methodology. Implement Sci 2010;5:69. doi: 10.1186/1748-5908-5-69


Pfadenhauer LM, Gerhardus A, Mozygemba K, et al Making sense of complexity in context and implementation: the context and implementation of complex interventions (CICI) framework. Implement Sci 2017;12:21. doi: 10.1186/s13012-017-0552-5


Bonell C, Hinds K, Dickson K, et al What is positive youth development and how might it reduce substance use and violence? A systematic review and synthesis of theoretical literature. BMC Public Health 2015;16:135 doi: 10.1186/s12889-016-2817-3


Higgins JP, Green S Cochrane Handbook for systematic reviews of interventions. John Wiley & Sons, 2011.


Rees R, Oliver K, Woodman J, et al The views of young children in the UK about obesity, body size, shape and weight: a systematic review. BMC Public Health 2011;11:188. doi: 10.1186/1471-2458-11-188


Shepherd J, Harden A, Rees R, et al Young people and healthy eating: a systematic review of research on barriers and facilitators. Health Educ Res 2006;21:23957. doi: 10.1093/her/cyh060


Drummond MF, Sculpher MJ, Claxton K Methods for the economic evaluation of health care programmes. USA: Oxford University Press, 2015.


Vergnes J-N, Marchal-Sixou C, Nabet C, et al Ethics in systematic reviews. J Med Ethics 2010;36:7714. doi: 10.1136/jme.2010.039941


Moore G, Audrey S, Barker M Process evaluation of complex interventions. UK medical Research Council (MRC) guidance 2014:1133.


Oliver SR, Rees RW, Clarke-Jones L, et al A multidimensional conceptual framework for analysing public involvement in health services research. Health Expect 2008;11:7284. doi: 10.1111/j.1369-7625.2007.00476.x


Brunton G, Oliver S, Oliver S A synthesis of research addressing children’s, young people’s and parents’ views of walking and cycling for transport. London: Eppi Centre, 2006.


Barnett-Page E, Thomas J Methods for the synthesis of qualitative research: a critical review. BMC Med Res Methodol 2009;9:59. doi: 10.1186/1471-2288-9-59


Gale NK, Heath G, Cameron E, et al Using the framework method for the analysis of qualitative data in multi-disciplinary health research. BMC Med Res Methodol 2013;13:117. doi: 10.1186/1471-2288-13-117


O'Neill J, Tabish H, Welch V, et al Applying an equity lens to interventions: using progress ensures consideration of socially stratifying factors to illuminate inequities in health. J Clin Epidemiol 2014;67:5664. doi: 10.1016/j.jclinepi.2013.08.005


Welch V, Petticrew M, Petkovic J, et al Extending the PRISMA statement to equity-focused systematic reviews (PRISMA-E 2012): explanation and elaboration. J Clin Epidemiol 2016;70:6889. doi: 10.1016/j.jclinepi.2015.09.001


Zorzela L, Loke YK, Ioannidis JP, et al PRISMA harms checklist: improving harms reporting in systematic reviews. BMJ 2016;352:i157. doi: 10.1136/bmj.i157


Noyes J, Booth A, Moore G, et al Synthesising quantitative and qualitative evidence to inform guidelines on complex interventions: clarifying the purposes, designs and outlining some methods. BMJ Glob Health 2019;4:e000893. doi: 10.1136/bmjgh-2018-000893


Hong QN, Pluye P, Bujold M, et al Convergent and sequential synthesis designs: implications for conducting and reporting systematic reviews of qualitative and quantitative evidence. Syst Rev 2017;6:61. doi: 10.1186/s13643-017-0454-2


Munabi-Babigumira S, Glenton C, Lewin S, et al Factors that influence the provision of intrapartum and postnatal care by skilled birth attendants in low- and middle-income countries: a qualitative evidence synthesis. Cochrane Database Syst Rev 2017;9 doi: 10.1002/14651858.CD011558.pub2


Balshem H, Helfand M, Schünemann HJ, et al Grade guidelines: 3. rating the quality of evidence. J Clin Epidemiol 2011;64:4016. doi: 10.1016/j.jclinepi.2010.07.015


Lewin S, Booth A, Glenton C, et al Applying GRADE-CERQual to qualitative evidence synthesis findings: introduction to the series. Implement Sci 2018;13:2. doi: 10.1186/s13012-017-0688-3


Rehfuess EA, Booth A, Brereton L, et al Towards a taxonomy of logic models in systematic reviews and health technology assessments: a priori, staged, and iterative approaches. Res Synth Methods 2018;9:1324. doi: 10.1002/jrsm.1254


Evans RE, Moore G, Movsisyan A, et al How can we adapt complex population health interventions for new contexts? progressing debates and research priorities. J Epidemiol Community Health 2021;75:405. doi: 10.1136/jech-2020-214468


Moore G, Campbell M, Copeland L, Craig P, Movsisyan A, Hoddinott P, Littlecott H, O’Cathain A, Pfadenhauer L, Rehfuess E, Segrott J, Hawe P, Kee F, Couturiaux D, Hallingberg B, Evans R Adaptation of interventions for implementation and/or re-evaluation in new contexts: the adapt study guidance (v1.0); 2020


Evans RE, Craig P, Hoddinott P, et al When and how do 'effective' interventions need to be adapted and/or re-evaluated in new contexts? The need for guidance. J Epidemiol Community Health 2019;73:4812. doi: 10.1136/jech-2018-210840


Craig P, Dieppe P, Macintyre S, et al Developing and evaluating complex interventions: the new medical Research Council guidance. BMJ 2008;337:a1655a. doi: 10.1136/bmj.a1655
Supplementary materials
  • bmjopen-2020-042815.reviewer_comments.pdf     save_alt  
  • bmjopen-2020-042815.draft_revisions.pdf     save_alt is an open access article distributed in accordance with the Creative Commons Attribution 4.0 Unported (CC BY 4.0) license, which permits others to copy, redistribute, remix, transform and build upon this work for any purpose, provided the original work is properly cited, a link to the licence is given, and indication of whether changes were made. See: cHildren and young people’s Interventions to improve Mental health and wEll-being outcomes: Systematic review (CHIMES) protocol&author=Rhiannon Evans,Maria Boffey,Sarah MacDonald,Jane Noyes,G.J. Melendez-Torres,Helen E Morgan,Rob Trubey,Michael Robling,Simone Willis,Charlotte Wooders,&keyword=public health,mental health,child & adolescent psychiatry,child protection,&subject=Mental Health,1506,1712,