Critical appraisal of health articles can be very time consuming. Sometimes you just need to quickly decide on the trustworthiness and value of a paper. Here are some things to consider:
- Relevance - Compare the study to your search framework (such as PICO) - is it similar or transferable?
- Results - Were statistical tests applied and did they indicate the findings were statistically significant?
- Applicability to your research question - Did the researchers contribute to an answer to your original question? Is your study group similar to this or quite different?
- Quality of study – There are many tools out there for a rapid critical appraisal of the study quality. For example, one you could use if you were reviewing controlled clinical trials is the RAMMbo appraisal method (Salisbury, Glasziou, & Del Mar, 2007):
R - Recruitment – were the subjects chosen in the study representative of the target population? Were there enough subjects to make the study valid?
A - Allocation – was the trial randomised?
M - Maintenance – Was the status of the control group and study group maintained throughout the trial? Were they treated the same way apart from the intervention?
M - Measurement (Blinding, Objective measures) – were the outcomes measured objectively and the subjects blinded to the intervention? Was bias eliminated as much as possible?
Another great tool for quick appraisal of health articles is from the Medical Research Council in the UK. Understanding Health Research takes you through a series of questions about a particular article, highlighting the good points and possible problem areas. You can print off a summary at the end of your checklist.
See the next box below for some more detailed appraisal tools in the health sciences.
Salisbury, J., Glasziou, P., & Del Mar, C. (2007). Evidence-based practice workbook: Bridging the gap between health care research and practice (2nd ed.). Oxford: Blackwell/BMJ Books.