Completed Systematic Reviews Worksheet for Child Health
In children under 5 years, does a health visitor (compared to no health visitor) prevent accidental injury?
Are the results of this systematic review of therapy valid?
Did the review address a clearly focused question?
How likely is it that the search strategy would have missed eligible trials?
Unlikely to have missed eligible published trials.
3.1: Are the inclusion criteria clearly stated?
3.2: Are the inclusion criteria relating to population, intervention and comparison groups and outcome appropriate?
Yes. However, criteria includes both intentional and unintentional injury as outcomes, and there is broad mix of populations and interventions.
How likely is it that the conclusions are valid (ie. Are the included studies good quality randomised controlled trials?)?
Likely. Conclusions not altered by limiting analysis to trials with high quality scores.
If a meta-analysis was performed, were the included studies sufficiently homogeneous to make it appropriate to pool data?
Yes for unintentional injury. Heterogeneity noted in studies of intentional injury.
Are the valid results of this systematic review important?
|Patient's Expected Event Rate (PEER)||0.05||2091||139||104||83||69||59||52||46||412|
|Patient's Expected Event Rate (PEER)||0.05||212||106||71||54||43|
The numbers in the body of the table are the NNTs for the corresponding Odds Ratios at that particular patient's expected event rate (PEER). This table applies both when a good outcome is increased by therapy and when a side-effect is caused by therapy.
Results: For unintentional injuries, pooled odds ratio is < 1 which favours intervention; ie. there are less unintentional injuries in children whose mother was visited at home than in those not visited
Pooled OR = 0.74 with 95% CI of 0.6 to 0.92. As CI does not include 1, result is statistically significant.
Can you apply this valid, important evidence from a systematic review in caring for your patient?
Do these results apply to your patient?
Are my patients so different from those in the review that there are likely to be important differences in treatment effect?
Maybe. Studies mainly involved 'high risk' families.
Is the intervention in the studies in the review sufficiently similar to the treatment that I am considering?
Maybe. Most studies involved non-professional visitors.
Are the outcome measures documented an adequate reflection of the outcomes of importance to my patients?
How great would the potential benefit of therapy actually be for your individual patient?
Method 1: In the table on page 1, find the intersection of the closest odds ratio from the overview and the CER that is closest to your patient's expected event rate if they received the control treatment (PEER).
OR = 0.74
Assume PEER for injuries is only 5%
NNT = 83
Method 2: To calculate the NNT for any OR and PEER:
NNT = [1 - (PEER x (1 - OR))]/[(1 - PEER) x PEER x (1 - OR)]
Your PEER is 0.05, so with OR of 0.74, NNT = 80
- Method 1: In the table on page 1, find the intersection of the closest odds ratio from the overview and the CER that is closest to your patient's expected event rate if they received the control treatment (PEER).
Are your patient's values and preferences satisfied by the regimen and its consequences?
Do your patient and you have a clear assessment of their values and preferences?
Are they met by this regimen and its consequences?
Not entirely. Need information on intensity of visiting and effect and acceptability of professional compared with non-professional visitors.
Should you believe apparent qualitative differences in the efficacy of therapy in some subgroups of patients? Only if you can say "yes" to all of the following:
Do they really make biologic and clinical sense?
yes, unintentional injuries are different from intentional injuries.
Is the qualitative difference both clinically (beneficial for some but useless or harmful for others) and statistically significant?
Was this difference hypothesised before the study began (rather than the product of dredging the data), and has it been confirmed in other, independent studies?
Was this one of just a few subgroup analyses carried out in this study?
Despite the ill-defined intervention (i.e. professional and non-professional visitors) and the crude outcome measures (some parent recall, some hospital attendance, there is a statistically significant result which suggests that home visiting has a real impact on children's unintentional injuries.