A practical guide to scoping reviews: Purpose and process
Welcome and Introduction to the Webinar
Overview of the Webinar
- Julie Brown introduces the Covidence community webinar focused on scoping reviews, outlining its purpose and process.
- Nancy Elsharb and Joel Ronco support Julie in hosting, ensuring a smooth experience for attendees.
Guest Speaker Introduction
- Dr. Danielle Pollock from the University of Adelaide is introduced as an expert in evidence synthesis methodology and lived experience research.
- Danielle's extensive background includes coordinating the JBI scoping review network and supporting high-quality review designs globally.
Housekeeping Notes
Webinar Logistics
- The session will be recorded, with links sent to registrants within 24 hours.
- Attendees are muted but can ask questions via Q&A on Zoom or chat on YouTube.
Introduction to Covidence
What is Covidence?
- Covidence is a not-for-profit organization providing a web-based solution for conducting scoping reviews efficiently.
- The platform supports users through various stages: creating reviews, importing sources, screening, data charting, extraction, and analysis.
Growth in Scoping Reviews
- There has been a tenfold increase in scoping reviews since 2010; over 20,000 were published last year alone.
- The webinar attracted over 8,600 registrations, indicating significant interest in this area of research.
Poll Results on Scoping Review Experience
Participant Engagement
- A poll reveals that 10% have conducted multiple scoping reviews; 28% have done one; 56% are considering it; and 6% are unsure about their need for one.
Key Questions About Scoping Reviews
Common Inquiries Addressed
- Danielle addresses common questions submitted by participants regarding when to conduct a scoping review versus other types of reviews.
Understanding Scoping Reviews
Determining if Your Review Should Be a Scoping Review
- Danielle emphasizes understanding different review types to determine if a scoping review is appropriate for specific research questions.
Misconceptions Clarified
- Many misconceptions exist about what scoping reviews can do compared to systematic or literature reviews.
Purpose Distinction
- Systematic reviews focus on answering clinically meaningful questions while scoping reviews explore broader characteristics or concepts of existing literature.
Tools for Deciding Between Review Types
Decision-Making Framework
- A decision tree helps researchers decide whether a scoping review is suitable based on their intent and type of evidence needed.
Identifying Evidence Gaps
Scoping reviews help identify available evidence types and gaps rather than focusing solely on outcomes like systematic reviews do.
Other Forms of Evidence Synthesis
- Discussion includes mapping reviews and evidence gap maps as alternatives to traditional systematic or scoping approaches.
Visual Representation Benefits
- Evidence gap maps visually present where evidence exists or lacks within specific interventions aiding policy-making decisions.
Key Processes Comparison
Differences Among Review Types
- Key differences between systematic, mapping, overview, and scoping processes hinge upon question specificity—scoping being broader while systematic focuses narrowly.
Resources Available
Tools for Researchers
- Mention of tools like the "right review tool" developed by Andrea Tricco’s team assists researchers in selecting appropriate methodologies based on their needs.
Grey Literature Considerations
Importance of Grey Literature
- Discussion highlights how grey literature should be included in scoping reviews due to its breadth of information beyond peer-reviewed articles.
Searching Strategies
- Emphasis placed on developing transparent search strategies that include grey literature while maintaining rigor throughout the process.
Iterative Search Process Explained
The iterative nature during protocol development allows adjustments before finalizing search strategies across databases including grey literature sources.
Tracking Grey Literature Searches
Examples provided illustrate how researchers can effectively track searches through government websites or general search engines like Google when exploring grey literature resources relevant to their topics.
Planning Protocol Stage Essentials
Researchers must plan thoroughly during protocol development regarding which websites will be searched for grey literature inclusion ensuring reproducibility later down the line.
(Timestamps)
Setting Boundaries During Searches
-[] (Timestamps)
Setting boundaries such as limiting pages viewed during searches helps manage overwhelming results while ensuring thoroughness without excessive time spent screening irrelevant studies.
How to Approach Data Extraction in Scoping Reviews
Understanding the Challenges of Data Extraction
- Data extraction is identified as one of the most challenging aspects of conducting literature reviews, including systematic, narrative, and scoping reviews.
- The speaker emphasizes the importance of managing qualitative or textual evidence during data extraction in scoping reviews.
Principles for Effective Data Extraction
- Focus on extracting only relevant information that directly answers your research questions; avoid collecting excessive data.
- Utilize multiple reviewers for data extraction to minimize bias and ensure accuracy; having a second set of eyes can catch mistakes.
- Develop tailored extraction tools or forms specific to your review needs, as standardized forms may not fit well with scoping reviews.
Organizing Your Extraction Process
- Expect initial outputs from data extraction tools like Covidence to appear chaotic; organization will improve during analysis.
- Ensure all team members are aligned on what constitutes relevant data by developing clear extraction information sheets and conducting piloting sessions.
Managing Qualitative Evidence
- When handling qualitative textual evidence, consider it part of the initial analysis process rather than just a collection task.
- Use simple frequency counts and narrative summaries for qualitative analysis instead of complex methods like meta-analysis which are inappropriate for scoping reviews.
Planning and Presenting Your Findings
- Plan your data extraction and analysis ahead of time within your protocols to maintain clarity throughout the review process.
- Explore various visualization tools (e.g., Datawrapper, Power BI, Tableau) for presenting findings creatively while avoiding excessive tables that could overwhelm readers.
Discussion on Scoping Reviews and Analysis Methods
Extracting and Checking Data
- The discussion begins with the suggestion of having one person extract data while another checks it, acknowledging potential limitations that need to be addressed.
Engagement in the Webinar
- The host expresses appreciation for the audience's enthusiasm and engagement, inviting them to stay for additional questions directed at Danielle.
Qualitative Content vs. Thematic Analysis
- Danielle differentiates between qualitative content analysis and thematic analysis, noting that thematic analysis is primarily based on primary research and emphasizes reflexivity.
- She explains that scoping reviews focus more on categorizing content rather than providing deep interpretations.
Protocol Deviations in Scoping Reviews
- Danielle discusses the importance of adhering to a protocol during scoping reviews, emphasizing that deviations should be carefully considered.
- She stresses transparency when reporting any changes made to the original protocol, suggesting documentation in supplementary tables or methods sections.
Evolving Definitions of Scoping Reviews
- A question arises about whether Arksey and O'Malley's definitions are outdated compared to JBI guidance; Danielle acknowledges both frameworks but highlights JBI's modern updates.
Stakeholder Consultation in Scoping Reviews
Importance of Stakeholder Engagement
- Danielle reflects on stakeholder consultation as an optional phase in scoping reviews, stressing its value if properly facilitated.
- She notes the necessity of ensuring a psychologically safe environment for participants, especially when involving patients or public members.
Levels of Engagement with Stakeholders
- Different levels of engagement range from co-authorship to simple consultations; she encourages early relationship development with stakeholders for better outcomes.
Structuring Research Questions Using PCC Framework
Utilizing PCC Framework
- The PCC (Population, Concept, Context) framework is discussed as essential for structuring research questions within scoping reviews.
- Danielle mentions flexibility within the PCC framework; sometimes only one component may be used which can lead to broader searches but messier extractions.
Evidence Reporting in Scoping Reviews
Equality Among Study Designs
- When reporting evidence from various study designs like RCTs or cohort studies, Danielle believes all designs should be treated equally within scoping review contexts.
Updating Scoping Reviews
Frequency of Updates
- The conversation shifts towards how often scoping reviews should be updated; Danielle suggests considering substantial new evidence as a key factor for updates.
Conclusion and Closing Remarks
Final Thoughts
- The host thanks everyone for their participation and insights shared during the webinar while encouraging attendees to reach out with further questions post-event.