Moderators and Predictors of the Clinical Outcome After Hospitalization
Child and Adolescent Mental Health Service
Peer-review

Moderators and Predictors of the Clinical Outcome After Hospitalization

Original Article
Issue
2023/05
DOI:
https://doi.org/10.4414/sanp.2023.1156262838
Swiss Arch Neurol Psychiatr Psychother. 2023;174(05):144-149

Published on 18.10.2023

Morgane Terrena; Sébastien Urbena; Marta Ruiz Cairoa; Hélène De Rocquignya; Swen Courossea; Cecilia Bisiob; Vivien Caspanib; Céline Legouxb; Géraldine Petragliab; Boris Guignetb; Kerstin Jessica Plessena; Laurent Holzera,c
a Division of Child and Adolescent Psychiatry, Department of Psychiatry, Lausanne University Hospital, Lausanne, Switzerland
b Child and Adolescent Psychiatric Service, Hospital of Valais, Sierre, Switzerland
c Child and Adolescent Psychiatric Sector, Freiburg Mental Health Network, Fribourg, Switzerland

Abstract

Objective: This study aims at determining the influence of several predictors and moderators of the clinical outcome following a hospitalization in a child and adolescent mental health service (CAMHS).
Method: The sample included 297 patients aged from 12 to 18 years. Patients and clinicians used the Health of the Nation Outcome Scales for Children and Adolescents (HoNOSCA) to rate clinical outcomes (i.e., symptoms and psychosocial difficulties).
Results: Hierarchical regression analyses revealed that patient alliance (p=0.003), social functioning (p<0.001), and parental cooperation (p=0.008) were significant predictors of the clinical outcome. Moreover, gender (associated with pretreatment symptom severity; p= 0.019), parental cooperation (p=0.036) and stressful life events (SLE; associated with social functioning; p=0.003) moderated the clinical outcomes significantly. Higher patient alliance was related to lower symptoms and less psychosocial difficulties at discharge. In boys, lower parental cooperation and higher pretreatment symptoms severity were related to more symptoms and psychosocial difficulties at discharge. Finally, in youths exposed to several SLEs, social functioning had no influence on symptoms and psychosocial difficulties at discharge.
Conclusions: This study identified patient alliance, gender and SLEs as explaining factors of the clinical outcomes following the hospitalization in a CAMHS. Theses results could help clinicians to improve treatment strategies by allowing personalized care.
Keywords: HoNOSCA; adolescent; treatment outcomes; inpatient; mental health service; stressful life events; gender

Introduction

Clinical practice grounded in evidence-based medicine (EVB) is meant to obtain valid and reliable measures of outcomes of therapeutic intervention and to understand the underlying mechanisms leading to clinical benefits. The practice of EVB means drawing consciously, explicitly, and judiciously from the best available external clinical evidence, from systematic research and integrating individual clinical expertise [1]. It allows clinicians to deliver the most efficient care known to date, while striving to respect their patients in their individuality. These considerations take on their full meaning especially when applied to children’s and adolescent’s mental health problems. More than 50% of lifetime psychiatric disorders have an onset in adolescence [2], but only a minority of adolescents have access to appropriate psychic care [3].
This study focuses on inpatient units (IPUs), which represent one type of care in child and adolescent mental health service (CAMHS). Stays in IPUs can be indicated for assessment and stabilization of disabling and acute psychiatric symptoms when outpatient settings can no longer contain the situation [4-6]. Although IPUs are known to be effective on the majority of young people [4, 7, 8], there are only a few studies measuring the outcome after hospitalization in CAMHS (9) and it remains unclear which patient will benefit the most from hospitalization. To improve clinical outcomes and to better target personalized therapeutic interventions, it is crucial to understand the mechanisms behind behavior changes by examining predictors and moderators [10, 11].
Moderating factors specify the condition improving or reducing the effectiveness of the treatment [12]. For instance, boys (gender as moderator) have better treatment outcomes. In general, moderators refer to precursor of predictors and outcomes. In contrast, predicting factors are not differentially linked to treatment outcomes [13]. For example, significant pretreatment severity is related to better outcomes regardless of gender.
Studies of adolescent samples are rare. Some intrapersonal factors (stressful life events, gender, severity of treatment) or interpersonal factor (social functioning) have been identified as predictors and moderators of both outpatient and inpatient treatment outcomes [14-17].
Mixed results have been observed regarding pretreatment symptom severity as a predictor in previous studies. A review of the literature [18] on inpatient and outpatient clinics for children and adolescents revealed that higher pretreatment depression severity was a predictor of poorer outcome for depression but not for anxiety. On the contrary, higher pretreatment symptom severity from various mental disorders was associated with greater improvement in clinical outcomes after inpatient treatment [10, 19, 20]. These discrepancies may be attributable to differences in study designs and sample characteristics.
A higher social functioning in youths is an important part of recovery and predicts better clinical outcomes after outpatient treatment among children and adolescents suffering from psychotic [21, 22] or mood [23] disorders. Likewise, a better premorbid family functioning predicted a better outcome after inpatient treatment [16, 24].
According to a literature review [25], a strong therapeutic alliance with an adolescent after inpatient and outpatient treatment is a modest but consistent factor predicting a better clinical outcome. More parental cooperation during the inpatient stay (i.e., family support and functioning and parents’ involvement in treatment) translates into better treatment outcomes for youths with mental health problems [16, 19, 24, 26, 27]. A recent study based on an adolescent psychiatric outpatient sample showed, that therapeutic alliance between patient and clinician is associated with a subsequent reduction in symptoms regardless of prior symptoms and pretreatment severity [28]. A study based on a sample of drug-using patients highlighted the existence of moderating effects of clinician-patient and clinician-parent alliances on the outcome of outpatient treatment. Indeed, the alliance with the parents was a moderator on the clinician-patient alliance related to the treatment outcome. Moreover, a better alliance with the patient predicted a decrease in symptoms at the end of the treatment and this was even more significant when the alliance with the parents was stronger [29].
Another literature review showed, that little is known about hospitalization against the will of children and adolescents as a predictor of treatment outcomes [30].
Stress from cumulative adverse childhood experiences is known to be a risk factor for developing psychological disorders in adolescence [31, 32]. In addition to the most well-known categories of stressful life events (SLEs), such as domestic violence, mental illness, incarceration of loved ones, and sexual, psychological or physical abuse [33], recent studies point out that other stressors, such as an unfavorable social environment [34], divorce, or exposure to a high number of SLEs [35], also promote the development of psychological disorders in adolescence.
To the best of our knowledge, no prior studies have examined the moderating effect of gender and SLEs on the treatment outcome following hospitalization in IPU. Most outpatient studies did not observe any moderating effects of gender on treatment outcomes [18]. One study related to assertive community treatment [36] found that pretreatment severity had a greater influence on treatment outcome in youths confronted with many SLEs. Within the context of depression, outpatient studies reported that youths with a history of trauma had a lower twelve-week treatment response compared to those without trauma [37-39]. One study based on a child psychiatric outpatient sample found that quality of life was predicted by the presence of prior stressful life events and that this association was stronger for boys than for girls [40].
The aim of this study was to examine the weight of predictors and moderators of treatment outcome related to IPU for adolescents from a multiple informant perspective (i.e., clinicians and patients) in order to improve clinical care.
We assumed, that gender and SLE moderate the effect of predictors on treatment outcome. The impact of predictors on the outcome could differ between boys and girls. Among youths exposed to several SLEs, it was discovered that predictors known in the literature to be related to better treatment outcomes could have less impact. In this study, symptoms and psychosocial difficulties (i.e., clinical outcome) were assessed using the Health of the Nation Outcome Scales for Children and Adolescents (HoNOSCA) [41-43].

Methods

Inpatient Stay

Data was collected from two adolescent IPUs in Switzerland (Lausanne and Sierre), between April 2016 and May 2018. Both IPUs consisted of ten beds. Participants were hospitalized either voluntarily (69.3%) or against their will (30.7%). The average length of stay was 24.59 days (standard deviation [SD]=19.8). Both units are primarily crisis resolution units for patients with psychiatric disorders. They consist of a multidisciplinary team and include a focus on networking with families, justice, schools, social services, and outpatient care units. Patients had two or three individual interviews and one family interview per week.

Sample

All patients attending the two IPUs were likely to participate in the study given that the HoNOSCA rating was part of the standard admission procedure. A total of 331 patients were admitted to the two units and data was collected for 297 patients aged 12 to 18 years (M=15.29 years, SD=1.34). Out of those, 58% were girls and 42% were boys. Also, 34 patients were not included due to the following exclusion criteria: (1) an inpatient stay less than seven days or (2) the inability to complete questionnaires because of insufficient language skills or mental retardation. Diagnosis was made according to the International Statistical Classification of Diseases and Related Health Problems 10th Revision (ICD-10) [44]. The distribution of diagnoses within our sample is presented in table 1. Of note is that only a minority of adolescents (13.8%) did not report any SLEs.

Procedure

Every patient received oral and written information about the study at admission. After 24 hours, patients and their legal guardians (if younger than 14) decided whether to give their written consent to participate. The study procedure was approved by the Ethics Committee on Research Involving Humans from the Canton Vaud (#2015-00215).
The clinician in charge of the patient completed the HoNOSCA questionnaire (rating symptoms and psychosocial difficulties) at admission and at discharge, as well as noting sociodemographic information. Additionally, patients completed the HoNOSCA questionnaire at admission and at discharge.

Measures

Clinical Outcome

The HoNOSCA is a sensitive and valid measure of change for children and adolescents attending CAMHS [45, 46], covering a wide range of psychiatric symptoms and psychosocial difficulties independent of the diagnosis. Its psychometric properties and reliability are well established [45, 47, 48], especially in the context of IPUs [41-43]. The instrument is brief and easy to use by the clinician [49]. Of note, HoNOSCA offers one form for clinicians (HoNOSCA-CR) [48] as well as a self-report form for patients (HoNOSCA-SR) [41].
The clinicians were trained psychiatrists and psychologists. They used the French version of HoNOSCA-CR, which showed appropriate psychometric properties [50]. It is composed of 15 items scored on a five-point severity scale. For this study, only the first 13 items, which focus on patients' physical, social, and psychological difficulties, were considered. This allowed for better comparison of the results with the French version of HoNOSCA-SR for patients [42], which is composed by the same 13 items also rated on a five-point severity scale.
We computed the total HoNOSCA score by averaging responses on the 13 items. Higher scores meant more symptoms and psychosocial difficulties. The test was performed at admission and at discharge to diminish the bias generated by missing data. We considered multiple informant scores (patients and clinicians) in the regression analyses by averaging the scores of both type of raters (ρ=.165, p=.016). A multiple informant perspective improves the predictive value of clinical results [51]. Furthermore, this perspective provides complete information on the patient's progress as opposed to a single assessment [27].

Moderators

Moderators were assessed by the clinicians.
Patients’ gender was registered in the sociodemographic information at admission.
SLE refers to abnormal psychosocial situations according to the axis V of the ICD-10. During the anamneses, the following list of items was used to assess SLEs:
  • Absence of distortion or maladjustment of the psychosocial environment.
  • Abnormal intrafamilial relationship (e.g., lack of warmth in the parent-child relationship, discord between the adults).
  •  Mental disorder, deviance or handicap in the child's immediate environment, such as psychic disorders or behaviora deviance of a parent.
  • Inadequate or distorted intrafamilial communication.
  • Abnormal child-rearing patterns (e.g., parental overprotection, insufficient attention and supervision).
  • Abnormal immediate environment (e.g., institutional upbringing, abnormal parental situation).
  • Acute life events.
  • Social stressors (e.g., persecution, discrimination, migration, or social displacement).
  • Chronic interpersonal stress related to school or work environment.
  • Stressful events or situations resulting from the child's own disorder or disability.
Each item is rated “1” if present. The assessment was supervised by a senior physician during the case review. Because a cumulative effect of SLE was associated with behavioral problems [42], the SLE score refers to the addition of the present items.

Predictors

The type of admission at hospital was obtained by clinicians and indicated as either “voluntary” or “involuntary,” meaning a hospitalization against the will of the patients, allowing the hospitalization of patients who do not adhere to a treatment while presenting symptoms deemed threatening to themselves or others and whose ability to discern is suppressed.
Pretreatment symptom severity was evaluated at admission using the French version of the Clinical Global Impression-Severity of Illness Scale (CGI-S) [53]. The CGI-S is a well-established, valid and sensitive rating instrument [54] that is known for its sensitivity to change, reliability, and brevity in completion [55-57]. The CGI-S describes patients’ state as an overall impression and is assessed by the clinician using a single score to evaluate the severity of psychopathology relative to other patients with the same disease. The CGI-S score ranges from 1 to 7. A higher score correspond to a higher pretreatment symptom severity.
Social functioning was assessed at admission by the clinician using the French version of the Global Assessment of Psychosocial Disability Scale (GAPD-S). GAPD-S constitutes the sixth axis of the ICD-10 multiaxial presentation [58]. GAPD-S is a reliable and easy-to-use scale [59, 60]. It assesses functional disability during the disorder and three months prior to the assessment. The scale ranges from 0 to 8. A higher score corresponds to less social functioning.
The clinician assessed the cooperation of parents during the patients’ hospitalization and at discharge. A single score was used ranging from 1 (minimal) to 5 (excellent). Similarly, the clinician assessed patients’ cooperation and achievement of treatment objectives, using single scores also ranging from 1 (minimal) to 5 (excellent). The patients’ cooperation score and achievement of treatment objectives score were strongly correlated (ρ=.572, p <.001). Therefore, we computed a mean score between these two items to operationalize the patients’ alliance. These items were rated by clinicians who were specifically trained and supervised by senior practitioners. Moreover, there were only a few evaluators, thus reducing inter-evaluator differences.

Statistical Analysis

Since data distributions were not matching a Gaussian distribution, non-parametric tests (i.e., Wilcoxon) were used to assess admission-discharge differences. Spearman correlation coefficients between moderators, predictors, and the total HoNOSCA score were computed. We present the correlational analyses in a supplementary file (table S1, see supplementary file). The associations between gender, SLE, social functioning, voluntary admission, pretreatment symptoms severity, parental cooperation, patient alliance and the total HoNOSCA score were evaluated using linear regression models with backward elimination procedure. Backward elimination is a repetitive variable selection procedure. Starting with a model containing all variables the variable with the smallest coefficient is subsequently removed over each step. Here we present only the final solutions including the most relevant factors. Moreover, models were adjusted for age, duration of hospitalization, and for the provenance of the data (Lausanne and Sierre). Additionally, the moderating effects of gender and SLE for each predictor variable were added to the model by centering the data and multiplying them (e.g., gender x social functioning; gender x voluntary admission; gender x pretreatment symptoms severity; gender x parental cooperation; gender x patient alliance; SLE x social functioning; SLE x voluntary admission; SLE x pretreatment symptoms severity; SLE x parental cooperation; SLE x patient alliance). The examination of collinearity (i.e., variance inflation factor and tolerance) and distributions of residuals revealed no problems. Statistical significance was set, by convention, at p <.05.

Results

Admission vs Discharge

HoNOSCA scores from both perspectives were smaller at discharge than at admission suggesting less symptomatology in patients at the end of their hospitalization (table 2).

Regression Analysis

Table 3 sums up the results of the regression analysis.
Anmerkung
The regression analysis computed on the total HoNOSCA score explained a significant part of the variance (F[6, 223]=13.51, p< .001, R2=.272). Patient alliance (p=0.003), social functioning (p<0.001), and parental cooperation (p=0.008) referred to a significant predictor of the total HoNOSCA score at discharge. Moreover, the moderating effect of gender on a) pretreatment symptoms severity (p=0.019) and on b) parental cooperation (p=0.036) were related to the total HoNOSCA score at discharge. Pretreatment symptom severity and parental cooperation were related to the total HoNOSCA score at discharge more often in boys compared to girls. In addition, there was a moderating effect of SLE on social functioning (p=0.003) (i.e., less influence of social functioning in adolescents with many SLEs) on the total HoNOSCA score at discharge. Figure 1 illustrates the moderation effects (gender x pretreatment symptoms severity; gender x parental cooperation; SLE x social functioning) on the total HoNOSCA score at discharge.
Figure 1: Moderation effects of gender on total HoNSOCA score at discharge and of stressful life events (SLE) on total HoNSOCA score at discharge (gender x pretreatment symptoms severity; gender x parental cooperation; SLE x social functioning).
Total HoNOSCA is the average of the HoNOSCA score completed by the patient and the HoNOSCA score completed by the clinician.
HoNOSCA: Health of the Nation Outcome Scales for Children and Adolescents.

Discussion

The aim of this study was to fill an important gap in the literature by determining predictors (i.e., pretreatment symptom severity, social functioning, alliance with the patient, cooperation with parents, the type of admission in hospital) and moderators (i.e., gender and SLEs) of the clinical outcome in adolescents after hospitalization in IPUs. The results indicated a significant alleviation of symptoms and psychosocial difficulties from both perspectives (i.e., patients and clinicians). This is consistent with previous studies based both on clinician [6, 10, 20, 43] and on patient reports [20, 61]. The results support the notion that IPU-treatment in CAMHS is effective for many adolescents.
Correlation analyses showed that involuntary admission to IPUs was associated with more symptoms and psychosocial difficulties at discharge. Although this result was not confirmed by the regression analysis, it should be considered in involuntary admitted admission by paying special attention, for instance, to therapeutic alliance with the patient as well as cooperation with the parents. Moreover, we observed (when controlling for other factors) that higher patient alliance was related to less symptoms and psychosocial difficulties at discharge, which is in line with previous studies [25].
The main finding of the current study was the identification of gender and SLE as important moderators of symptoms and psychosocial difficulties at discharge. We observed that boys with a higher pretreatment symptom severity or lower parental cooperation had more symptoms and psychosocial difficulties at discharge. Moreover, in adolescents with many SLEs, social functioning had low influence on the treatment outcome.

Moderating Effect of Gender and SLE

Our results showed that pretreatment symptom severity, measured by CGI-S, had a greater influence in boys compared to girls in predicting the clinical outcomes after an inpatient stay. We hypothesize that recognizing mental health problems is more difficult for boys than for girls [62]. This could lead to a lower demand for help and less acceptance of care, indicating a less effective treatment outcome, which could explain why pretreatment symptoms severity was associated with more symptoms and psychosocial difficulties in boys.
Parental cooperation was observed as an important factor affecting the treatment outcome, which is consistent with previous studies [16, 19, 24, 26, 27]. However, our findings indicate that parental cooperation has a greater influence on the clinical outcome in boys. Therefore, we can hypothesize that if parents present a lack of cooperation with the clinicians, their children will adhere less to the treatment. Consequently, these findings point to the need for gender-sensitive treatment [63]. Considering that boys generally present more externalized symptoms than girls [64], this could interfere more with the treatment leading to lower clinical outcomes. The role of co-parenting [65] and parenting style [66] in the development and persistence of externalized symptoms is well known. One study shows that reciprocal, coercive parent-child interactions are pertinent in the development and maintenance of externalized disorders [67]. Parent-child relationships degrade [68] leading to a lower investment of parents in their children and thus to less parental cooperation during hospitalizations. This hypothesis is reinforced by the therapeutic success of parenting programs (leading to parents’ cooperation) in the reduction of externalized symptoms [69].
Our results revealed that when adolescents were confronted with several SLEs, social functioning did not influence treatment outcome. The developmental effects of trauma (i.e., development of insecure attachment and greater difficulties in interpersonal relationships) are more likely to occur when the victimization is repetitive and continuous [70]. Childhood trauma has been linked to several psychiatric disorders [71] by altering the capacity for emotional regulation [72]. Young people with many SLEs have experienced adverse relationships [73] limiting their trust in others and the quality of social interactions. We could hypothesize that their history of difficult relationships reduces their ability to consider social links as a support to them resulting in a lower impact of the level of social functioning on the treatment outcomes compared to less traumatized youths.

Clinical Implications

Our results allow the identification of patients with specific characteristics who could be targeted with more specific, effective and personalized treatment improving treatment their outcomes. The two main characteristics that should be considered are gender and SLE.
With male patients, it would be necessary to have a special focus on the development of the therapeutic alliance between the youth, their family, and the inpatient staff. For instance, psychoeducation could allow for better collaborative work between patients, their families, and caregivers. Collaborative work enables patients to make informed decisions concerning their care, which reinforces the patient’s confidence and motivation [74].
Regarding the importance of SLE, the consequences of trauma could be better targeted by an adjusted treatment. An example of such a treatment could be mindfulness-based therapies that improve the healing of trauma-caused problems in adults [75] and young people [76, 77]. Mindfulness could allow patients to better regulate their emotional reactivity by increasing their tolerance to unpleasant emotional experiences leading to better social adaptation.
Mentalization-based therapy (MBT) or dialectical behavior therapy (DBT) should also be mentioned as effective therapeutic approaches to reduce externalized symptoms [78, 79] and self-harm [80, 81] in young patients. By teaching young patients new coping strategies, MBT or DBT can help improve their emotion-regulation skills promoting a decrease in self-harm behaviors and improving the quality of their social interactions leading to a decrease in aggressive behaviors.

Strengths and Limitations

The design of our study offers specific and interesting strengths: (1) it includes hospitalized youths in a crisis context for whom increased and individualized attention and vigilance is needed; (2) it considers multiple informant perspectives; (3) it includes patients from two sites and from a large sample; (4) it explores a large number of factors known as predictors and moderators in previous literature; (5) the assessment of the clinical outcome is based on clinically relevant instruments (i.e., HoNOSCA).
However, some limitations should be mentioned. First, this study took place in a naturalistic environment with a risk of methodological bias due to the lack of a control group. However, studies in naturalistic conditions consider the particularities of patients [82], have good external validity [83] and are often effective [84]. Therefore, our results are closer to the clinical reality and easier to generalize in the context of IPUs. Second, the distribution of diagnoses in our results did not allow us to specify the impact of predictors or moderators on the outcome according to a specific diagnosis. In addition, we focused on the retained principal diagnosis using the ICD-10 general diagnosis groups (F1.x to F9.x). A more precise diagnosis categorization and consideration of secondary diagnoses should be used in future studies to refine these findings. Third, some constructs (e.g., SLE, patient alliance, parental cooperation) were not assessed using standard measures and were based on clinical objectification. Although there were only a few clinicians and they were trained and supervised in the assessment, some subjectivity remains. Further studies could use specific scores for these assessments, such as the Working Alliance Inventory [85] for alliance assessment and the Adverse Childhood Experience score for SLE assessment. This seems especially important as the definition of SLE evolves alongside the advances in psychiatric research [86]. In addition, the interactive effects of the parent-clinician alliance and the patient-clinician alliance could be considered to better define the impact of systemic work on the treatment outcome.

Conclusion

This study confirmed a significant decrease in a wide range of symptoms and psychosocial difficulties from admission to discharge in IPUs for adolescents. Moreover, our results identified patients’ alliance, gender (associated with pretreatment symptom severity or parental cooperation) and SLE (associated with social functioning) as explaining factors of the clinical outcome after an inpatient stay in an IPU. The presence of these moderators should prompt clinicians to adjust their treatment approach and therapeutic plans to increase the likelihood of patients recovering following hospitalization in CAMHS and more specifically in IPUs. As an example, personalized treatments could be offered to patients based on the presence or absence of one or more moderators.
We express our acknowledgement to all patients and clinicians of the Lausanne and Sierre Psychiatric Inpatient Units for adolescents who participated in this study, and in particular Laurence Cardinaux, Nevena Dimitrova, José Estrada, Vanessa Baier, Yannick Heim and Elodie Zysset. We also are grateful to Jennifer Glaus for her proofreading.
No financial support and no other potential conflict of interest relevant to this article was reported.
MT: Conceptualization, data acquisition, statistical analysis, writing (original draft, review & editing), visualization. SU: Conceptualization, statistical analysis, writing (review & editing). MRC: Conceptualization, data acquisition, writing (review & editing). HDR: Data acquisition. SC: Data acquisition. CB: Data acquisition. VC: Data acquisition. CL: Data acquisition. GP: Data acquisition. KJP: Supervision, review & editing. LH: Supervision, project administration, conceptualization, review & editing.
All authors reviewed and accepted the final version of the manuscript.
The original contributions presented in the study are included in the article. Further inquiries can be directed to the corresponding authors.
Morgane Terren
Division of Child and Adolescent Psychiatry
Department of Psychiatry
Lausanne University Hospital
Avenue d'Echallens 9
CH-1004 Lausanne
morgane.terren[at]chuv.ch
1 Sackett DL, Rosenberg WM, Gray JA, Haynes RB, Richardson WS. Evidence based medicine: what it is and what it isn’t. BMJ. 1996 Jan;312(7023):71-2.

2 Kessler RC, Amminger GP, Aguilar-Gaxiola S, Alonso J, Lee S, Ustün TB. Age of onset of mental disorders: a review of recent literature. Curr Opin Psychiatry. 2007 Jul;20(4):359-64.

3 Bonsack C, Holzer L, Stancu I, Baier V, Samitca M, Charbon Y, et al. Equipes de psychiatrie mobiles pour les trois âges de la vie: l’expérience lausannoise Psychiatric mobile teams for the three ages of live: The Lausanne experience. Rev Med Suisse. 2008 Sep;4(174):1960-2, 1964-6, 1968-9. French.

4 Hayes C, Simmons M, Simons C, Hopwood M. Evaluating effectiveness in adolescent mental health inpatient units: A systematic review. Int J Ment Health Nurs. 2018 Apr;27(2):498-513.

5 Tharayil PR, Sigrid J, Morgan R, Freeman K. Examining Outcomes of Acute Psychiatric Hospitalization among Children. Soc Work Ment Health. 2012;10(3):205-32.

6 Mathai J, Bourne A. Patients who do well and who do less well in an inpatient adolescent unit. Australas Psychiatry. 2009 Aug;17(4):283-6.

7 Pfeiffer SI, Strzelecki SC. Inpatient psychiatric treatment of children and adolescents: a review of outcome studies. J Am Acad Child Adolesc Psychiatry. 1990 Nov;29(6):847-53.

8 Blanz B, Schmidt MH. Preconditions and outcome of inpatient treatment in child and adolescent psychiatry. J Child Psychol Psychiatry. 2000 Sep;41(6):703-12.

9 Hayes C, Simmons M, Simons C, Hopwood M. Evaluating effectiveness in adolescent mental health inpatient units: A systematic review. Int J Ment Health Nurs. 2018 Apr;27(2):498-513.

10 Hanssen-Bauer K, Heyerdahl S, Hatling T, Jensen G, Olstad PM, Stangeland T, et al. Admissions to acute adolescent psychiatric units: a prospective study of clinical severity and outcome. Int J Ment Health Syst. 2011 Jan;5(1):1.

11 Kronström K, Ellilä H, Kuosmanen L, Kaljonen A, Sourander A. Changes in the clinical features of child and adolescent psychiatric inpatients: a nationwide time-trend study from Finland. Nord J Psychiatry. 2016 Aug;70(6):436-41.

12 Kraemer HC, Wilson GT, Fairburn CG, Agras WS. Mediators and moderators of treatment effects in randomized clinical trials. Arch Gen Psychiatry. 2002 Oct;59(10):877-83.

13 Shelleby EC, Shaw DS. Outcomes of parenting interventions for child conduct problems: a review of differential effectiveness. Child Psychiatry Hum Dev. 2014 Oct;45(5):628-45.

14 Lau AS, Weisz JR. Reported maltreatment among clinic-referred children: implications for presenting problems, treatment attrition, and long-term outcomes. J Am Acad Child Adolesc Psychiatry. 2003 Nov;42(11):1327-34.

15 Shelleby EC, Kolko DJ. Predictors, Moderators, and Treatment Parameters of Community and Clinic-Based Treatment for Child Disruptive Behavior Disorders. J Child Fam Stud. 2015 Mar;24(3):734-48.

16 Green J, Jacobs B, Beecham J, Dunn G, Kroll L, Tobias C, et al. Inpatient treatment in child and adolescent psychiatry  a prospective study of health gain and costs. J Child Psychol Psychiatry. 2007 Dec;48(12):1259-67.

17 Grant KE, Compas BE, Thurm AE, McMahon SD, Gipson PY, Campbell AJ, et al. Stressors and child and adolescent psychopathology: evidence of moderating and mediating effects. Clin Psychol Rev. 2006 May;26(3):257-83.

18 Nilsen TS, Eisemann M, Kvernmo S. Predictors and moderators of outcome in child and adolescent anxiety and depression: a systematic review of psychological treatment studies. Eur Child Adolesc Psychiatry. 2013 Feb;22(2):69-87.

19 Garralda M, Rose G, Dawson R. Measuring outcomes in a child psychiatry inpatient unit. J Child Serv. 2008;3(3):6-16.

20 Yuan JM. HoNOSCA in an adolescent psychiatric inpatient unit: an exploration of outcome measures. Psychiatr Danub. 2015 Sep;27 Suppl 1:S357-63.

21 Meng H, Schimmelmann BG, Mohler B, Lambert M, Branik E, Koch E, et al. Pretreatment social functioning predicts 1-year outcome in early onset psychosis. Acta Psychiatr Scand. 2006 Oct;114(4):249-56.

22 Díaz-Caneja CM, Pina-Camacho L, Rodríguez-Quiroga A, Fraguas D, Parellada M, Arango C. Predictors of outcome in early-onset psychosis: a systematic review. NPJ Schizophr. 2015 Mar;1:14005.

23 Emslie GJ, Mayes TL, Laptook RS, Batt M. Predictors of response to treatment in children and adolescents with mood disorders. Psychiatr Clin North Am. 2003 Jun;26(2):435-56.

24 Green J, Kroll L, Imrie D, Frances FM, Begum K, Harrison L, et al. Health gain and outcome predictors during inpatient and related day treatment in child and adolescent psychiatry. J Am Acad Child Adolesc Psychiatry. 2001 Mar;40(3):325-32.

25 Shirk SR, Karver M. Prediction of treatment outcome from relationship variables in child and adolescent therapy: a meta-analytic review. J Consult Clin Psychol. 2003 Jun;71(3):452-64.

26 Indig D, Gear C, York A. The role of inpatient care for children and adolescents with moderate-to-severe mental disorders: an Evidence Check rapid review brokered by the Sax Institute for the NSW Ministry of Health, 2017.

27 Gavidia-Payne S, Littlefield L, Hallgren M, Jenkins P, Coventry N. Outcome evaluation of a statewide child inpatient mental health unit. Aust N Z J Psychiatry. 2003 Apr;37(2):204-11.

28 Cirasola A, Midgley N, Fonagy P, Martin P, Impact Consortium. The alliance-outcome association in the treatment of adolescent depression. Psychotherapy (Chic). 2021 Mar;58(1):95-108.

29 Shelef K, Diamond GM, Diamond GS, Liddle HA. Adolescent and parent alliance and treatment outcome in multidimensional family therapy. J Consult Clin Psychol. 2005 Aug;73(4):689-98.

30 Priebe S, Katsakou C, Yeeles K, Amos T, Morriss R, Wang D, et al. Predictors of clinical and social outcomes following involuntary hospital admission: a prospective observational study. Eur Arch Psychiatry Clin Neurosci. 2011 Aug;261(5):377-86.

31 MacLochlainn J, Mallett J, Kirby K, McFadden P. Stressful Events and Adolescent Psychopathology: A Person-Centred Approach to Expanding Adverse Childhood Experience Categories. J Child Adolesc Trauma. 2021 Jul;15(2):327-40.

32 Chapman DP, Dube SR, Anda RF. Adverse Childhood Events as Risk Factors for Negative Mental Health Outcomes. Psychiatric Annals. 2007 May;37(5):359-64.

33 Felitti VJ, Anda RF, Nordenberg D, Williamson DF, Spitz AM, Edwards V, et al. REPRINT OF: Relationship of Childhood Abuse and Household Dysfunction to Many of the Leading Causes of Death in Adults: The Adverse Childhood Experiences (ACE) Study. Am J Prev Med. 2019 Jun;56(6):774-86.

34 Marryat L, Frank J. Factors associated with adverse childhood experiences in Scottish children: a prospective cohort study. BMJ Paediatr Open. 2019 Jan;3(1):e000340.

35 Lew D, Xian H. Identifying Distinct Latent Classes of Adverse Childhood Experiences Among US Children and Their Relationship with Childhood Internalizing Disorders. Child Psychiatry Hum Dev. 2019 Aug;50(4):668-80.

36 Urben S, Baier V, Mantzouranis G, Pigois E, Graap C, Dutoit F, et al. Predictors and moderators of clinical outcomes in adolescents with severe mental disorders after an assertive community treatment. Child Psychiatry Hum Dev. 2015 Dec;46(6):997-1005.

37 Shamseddeen W, Asarnow JR, Clarke G, Vitiello B, Wagner KD, Birmaher B, et al. Impact of physical and sexual abuse on treatment response in the Treatment of Resistant Depression in Adolescent Study (TORDIA). J Am Acad Child Adolesc Psychiatry. 2011 Mar;50(3):293-301.

38 Lewis CC, Simons AD, Nguyen LJ, Murakami JL, Reid MW, Silva SG, et al. Impact of childhood trauma on treatment outcome in the Treatment for Adolescents with Depression Study (TADS). J Am Acad Child Adolesc Psychiatry. 2010 Feb;49(2):132-40.

39 Asarnow JR, Emslie G, Clarke G, Wagner KD, Spirito A, Vitiello B, et al. Treatment of selective serotonin reuptake inhibitor-resistant depression in adolescents: predictors and moderators of treatment response. J Am Acad Child Adolesc Psychiatry. 2009 Mar;48(3):330-9.

40 Bastiaansen D, Ferdinand RF, Koot HM. Predictors of Quality of Life in Children and Adolescents with Psychiatric Disorders. Child Psychiatry Hum Dev. 2020 Feb;51(1):104-13.

41 Gowers S, Levine W, Bailey-Rogers S, Shore A, Burhouse E. Use of a routine, self-report outcome measure (HoNOSCA-SR) in two adolescent mental health services. Health of the Nation Outcome Scale for Children and Adolescents. Br J Psychiatry. 2002 Mar;180.

42 Urben S, Baier V, Mantzouranis G, Schwery J, Mahi C, Courosse S, et al. The French adaptation of the Health of the Nation Outcome Scale for Children and Adolescents Self-Rated Form (F-HoNOSCA-SR): validation and clinical routine use. Psychiatry Res. 2014 Aug;218(1-2):229-35.

43 Harnett PH, Loxton NJ, Sadler T, Hides L, Baldwin A. The Health of the Nation Outcome Scales for Children and Adolescents in an adolescent in-patient sample. Aust N Z J Psychiatry. 2005 Mar;39.

44 World Health Organization  International Statistical Classification of Diseases and Related Health Problems. 10th Revision. Volume 2 Instruction manual. 2010 Edition. Malta: WHO Library Cataloguing in Publication Data; 2010.

45 Garralda ME, Yates P, Higginson I. Child and adolescent mental health service use. HoNOSCA as an outcome measure. Br J Psychiatry. 2000 Jul;177(1):52-8.

46 Pirkis JE, Burgess PM, Kirk PK, Dodson S, Coombs TJ, Williamson MK. A review of the psychometric properties of the Health of the Nation Outcome Scales (HoNOS) family of measures. Health Qual Life Outcomes. 2005 Nov;3(1):76.

47 Gowers SG, Harrington RC, Whitton A, Beevor A, Lelliott P, Jezzard R, et al. Health of the Nation Outcome Scales for Children and Adolescents (HoNOSCA). Glossary for HoNOSCA score sheet. Br J Psychiatry. 1999 May;174(5):428-31.

48 Gowers SG, Harrington RC, Whitton A, Lelliott P, Beevor A, Wing J, et al. Brief scale for measuring the outcomes of emotional and behavioural disorders in children. Health of the Nation Outcome Scales for Children and Adolescents (HoNOSCA). Br J Psychiatry. 1999 May;174(5):413-6.

49 Yates P, Garralda ME, Higginson I. Paddington Complexity Scale and Health of the Nation Outcome Scales for Children and Adolescents. Br J Psychiatry. 1999 May;174(5):417-23.

50 Holzer L, Tchemadjeu IK, Plancherel B, Bolognini M, Rossier V, Chinet L, et al. Adolescent Drug Abuse Diagnosis (ADAD) vs. Health of Nation Outcome Scale for Children and Adolescents (HoNOSCA) in clinical outcome measurement. J Eval Clin Pract. 2006 Oct;12(5):482-90.

51 Clements KM, Murphy JM, Eisen SV, Normand SL. Comparison of self-report and clinician-rated measures of psychiatric symptoms and functioning in predicting 1-year hospital readmission. Adm Policy Ment Health. 2006 Sep;33(5):568-77.

52 Jensen PS, Richters J, Ussery T, Bloedau L, Davis H. Child psychopathology and environmental influences: discrete life events versus ongoing adversity. J Am Acad Child Adolesc Psychiatry. 1991 Mar;30(2):303-9.

53 Guy W. ECDEU Assessment Manual for Psychopharmacology, Revised. US Department of Health, Education, and Welfare Publication (ADM). Rockville (MD): National Institute of Mental Health; 1976. p. 76-338.

54 Busner J, Targum SD. The clinical global impressions scale: applying a research tool in clinical practice. Psychiatry (Edgmont). 2007 Jul;4(7):28-37.

55 Berk M, Ng F, Dodd S, Callaly T, Campbell S, Bernardo M, et al. The validity of the CGI severity and improvement scales as measures of clinical effectiveness suitable for routine clinical use. J Eval Clin Pract. 2008 Dec;14(6):979-83.

56 Kadouri A, Corruble E, Falissard B. The improved Clinical Global Impression Scale (iCGI): development and validation in depression. BMC Psychiatry. 2007 Feb;7:7.

57 Leon AC, Shear MK, Klerman GL, Portera L, Rosenbaum JF, Goldenberg I. A comparison of symptom determinants of patient and clinician global ratings in patients with panic disorder and depression. J Clin Psychopharmacol. 1993 Oct;13(5):327-31.

58 Rutter S; World Health Organization. Global Assessment of Psychosocial Disability. In: World Health Organization. Multiaxial Classification of Child and Adolescent Psychiatric Disorders: The ICD-10 Classification of Mental and Behavioural Disorders in Children and Adolescents. Cambridge: Cambridge University Press, 1996. p. 271-2.

59 Schorre BE, Vandvik IH. Global assessment of psychosocial functioning in child and adolescent psychiatry. A review of three unidimensional scales (CGAS, GAF, GAPD). Eur Child Adolesc Psychiatry. 2004 Oct;13(5):273-86.

60 Dyrborg J, Larsen FW, Nielsen S, Byman J, Nielsen BB, Gautrè-Delay F. The Children’s Global Assessment Scale (CGAS) and Global Assessment of Psychosocial Disability (GAPD) in clinical practice  substance and reliability as judged by intraclass correlations. Eur Child Adolesc Psychiatry. 2000 Sep;9(3):195-201.

61 Urben S, Pihet S, Graap C, Baier V, Dyson C, Courosse S, et al. Clinical Utility of the 2 New Scales of the Health of the Nation Outcome Scales for Children and Adolescents (HoNOSCA): A Naturalistic, Prospective Study in a Psychiatric Unit for Adolescents. J Psychiatr Pract. 2015 May;21(3):232-40.

62 Van Droogenbroeck F, Spruyt B, Keppens G. Gender differences in mental health problems among adolescents and the role of social support: results from the Belgian health interview surveys 2008 and 2013. BMC Psychiatry. 2018 Jan;18(1):6.

63 Hipwell AE, Loeber R. Do we know which interventions are effective for disruptive and delinquent girls? Clin Child Fam Psychol Rev. 2006 Dec;9(3-4):221-55.

64 Hicks BM, Blonigen DM, Kramer MD, Krueger RF, Patrick CJ, Iacono WG, et al. Gender differences and developmental change in externalizing disorders from late adolescence to early adulthood: A longitudinal twin study. J Abnorm Psychol. 2007 Aug;116(3):433-47.

65 Teubert D, Pinquart M. The association between coparenting and child adjustment: A meta-analysis. Parent Sci Pract. 2010;10(4):286-307.

66 Ruiz-Hernández JA, Moral-Zafra E, Llor-Esteban B, Jiménez-Barbero JA. Influence of Parental Styles and Other Psychosocial Variables on the Development of Externalizing Behaviors in Adolescents: A systematic review. Eur J Psychol Appl Legal Context.
2018 Nov;11(1):9-21.

67 McKee L, Colletti C, Rakow A, Jones DJ, Forehand R. Parenting and Child Externalizing Behaviors: Are the Associations Specific or Diffuse? Aggress Violent Behav. 2008;13(3):201-15.

68 Blader JC. Which family factors predict children's externalizing behaviors following discharge from psychiatric inpatient treatment? J Child Psychol Psychiatry. 2006 Nov;47(11):1133-42.

69 Zarakoviti E, Shafran R, Papadimitriou D, Bennett SD. The Efficacy of Parent Training Interventions for Disruptive Behavior Disorders in Treating Untargeted Comorbid Internalizing Symptoms in Children and Adolescents: A Systematic Review. Clin Child Family Psychol Rev. 2021 Sep;24(3):542-52.

70 Finkelhor D. The victimization of children: a developmental perspective. Am J Orthopsychiatry. 1995 Apr;65(2):177-93.

71 Hébert M, Langevin R, Oussaïd E. Cumulative childhood trauma, emotion regulation, dissociation, and behavior problems in school-aged sexual abuse victims. J Affect Disord. 2018 Jan;225:306-12.

72 Goldsmith RE, Chesney SA, Heath NM, Barlow MR. Emotion regulation difficulties mediate associations between betrayal trauma and symptoms of posttraumatic stress, depression, and anxiety. J Trauma Stress. 2013 Jun;26(3):376-84.

73 Belsky J, Steinberg L, Draper P. Childhood experience, interpersonal development, and reproductive strategy: an evolutionary theory of socialization. Child Dev. 1991 Aug;62(4):647-70.

74 Green J. Annotation: the therapeutic alliance  a significant but neglected variable in child mental health treatment studies. J Child Psychol Psychiatry. 2006 May;47(5):425-35.

75 Follette V, Palm KM, Pearson AN. Mindfulness and trauma: implications for treatment. J Ration-Emot Cogn-Behav Ther. 2006;24(1):45-61.

76 Ortiz R, Sibinga EM. The Role of Mindfulness in Reducing the Adverse Effects of Childhood Stress and Trauma. Children (Basel). 2017 Feb;4(3):16.

77 Iacona J, Johnson S. Neurobiology of Trauma and Mindfulness for Children. J Trauma Nurs. 2018 May/Jun;25(3):187-91.

78 Taubner S, Hauschild S, Kasper L, Kaess M, Sobanski E, Gablonski TC, et al. Mentalization-based treatment for adolescents with conduct disorder (MBT-CD): protocol of a feasibility and pilot study. Pilot Feasibility Stud. 2021 Jul;7(1):139.

79 Shelton D, Kesten K, Zhang W, Trestman R. Impact of a Dialectic Behavior Therapy-Corrections Modified (DBT-CM) upon behaviorally challenged incarcerated male adolescents. J Child Adolesc Psychiatr Nurs. 2011 May;24(2):105-13.

80 Rossouw TI, Fonagy P. Mentalization-based treatment for self-harm in adolescents: a randomized controlled trial. J Am Acad Child Adolesc Psychiatry. 2012 Dec;51(12):1304-13.e3.

81 James AC, Taylor A, Winmill L, Alfoadari K. A Preliminary Community Study of Dialectical Behaviour Therapy (DBT) with Adolescent Females Demonstrating Persistent, Deliberate Self-Harm (DSH). Child Adolesc Ment Health. 2008 Sep;13(3):148-52.

82 Leichsenring F. Randomized controlled versus naturalistic studies: a new research agenda. Bull Menninger Clin. 2004;68(2):137-51.

83 Hodgson R, Bushe C, Hunter R. Measurement of long-term outcomes in observational and randomised controlled trials. Br J Psychiatry Suppl. 2007 Aug;50:s78-84.

84 Anglemyer A, Horvath HT, Bero L. Healthcare outcomes assessed with observational study designs compared with those assessed in randomized trials. Cochrane Database Syst Rev. 2014 Apr;2014(4):MR000034.

85 Munder T, Wilmers F, Leonhart R, Linster HW, Barth J. Working Alliance Inventory-Short Revised (WAI-SR): psychometric properties in outpatients and inpatients. Clin Psychol Psychother. 2010 May-Jun;17(3):231-9.

86 Anda RF, Porter LE, Brown DW. Inside the Adverse Childhood Experience Score: Strengths, Limitations, and Misapplications. Am J Prev Med. 2020 Aug;59(2):293-5.