Evidence Map
What is it?
The Evidence Map is a review methodology that allows for the systematic and graphical representation of analyzed evidence from review studies in a specific area or subarea, evaluating the effect of interventions on health outcomes. This map displays selected studies in a structure that relates the evaluated interventions to the measured outcomes, visually highlighting gaps (where there are few or no studies) and concentrations of studies.
BIREME/PAHO/WHO adapted and developed a methodology to create Evidence Maps based on the 3ie Evidence Gap Map model, linking them to the Virtual Health Library (VHL) information sources.
How to use it?
The Evidence Map provides an overview and a graphical synthesis of evidence on therapeutic interventions for specific health problems, organized in a matrix of interventions and outcomes. Its development involves:
- Systematic search of documents in major databases.
- Selection of studies according to inclusion criteria.
- Characterization of the selected studies.
The map is available on an interactive online platform where users can identify existing evidence. In the matrix, circles at the intersections between interventions and outcomes represent identified studies. The circle size indicates the volume of studies, while the color indicates the confidence level (high, moderate, low, critically low) according to the methodological quality of the studies, using the AMSTAR 2 tool.
Hovering over a circle displays a list of studies with links to full texts (if available) or to records in the VHL. It is possible to filter the evidence by type, country focus, intervention effect (positive, negative, etc.), and population.
How to create?
The process of creating an Evidence Map involves several stages: Planning, systematic search, selection, data extraction, data categorization, interactive visualization, and reporting.
These steps ensure that the Evidence Map not only graphically represents the information but also serves as a useful tool for identifying areas that need more research and for avoiding duplication of studies.
For detailed steps, please refer to the instructions provided alongside.
Evidence Map: methodology and application
Planning
Planning Steps to Develop an Evidence Map:
- Defining the Research Question: Use the PCC structure (Population, Concept, Context).
- Forming the Collaborative Group: Gather a team of experts, including researchers, clinicians, and librarians, to collaborate on the map's development.
How to Formulate a Research Question for an Evidence Map (Overview of Systematic Reviews)
For developing an Evidence Map, which is a graphical representation of an overview study of systematic reviews, the research question should be well-structured and clear. Use the PCC structure to formulate your question:
- Population (P): Define the group of individuals to be studied. Example: adults, children, adolescents, elderly.
- Concept (C): Determine the interventions, exposures, or phenomena to be investigated. Example: effectiveness of Medical Cannabis or Strategies for the care of people with non-communicable chronic diseases.
- Context (C): Specify the context or environment in which the research will be applied. Example: effectiveness, efficacy, safety, benefits, etc.
Systematic Search
The bibliographic search for scientific evidence will be conducted in electronic databases with the assistance of librarians, supplemented by manual searches and/or recommendations from project collaborator experts.
- Data Sources: Identification and selection of information sources (databases and journals) to be consulted.
- Search Strategy: Development of electronic search expressions according to the selected databases; conducting manual searches and/or recommendations of reviews not identified in the electronic search; exporting metadata from the bibliographic records retrieved in the bibliographic search (electronic and manual); documentation with a detailed description of all bibliographic searches conducted.
Study Selection
In this stage, data from eligible studies will be extracted from the full-text readings.
The categorization (characterization) of evidence can be divided into data groups:
✔ Study Identification Data
- Data collection spreadsheet
✔ Methodological Quality of Studies - Evaluation Tool:
- AMSTAR2
Data Extraction
- Relevant Information: Collect data such as title, interventions, outcomes, adverse effects, database, identification number, focus country, publication country, study design, review studies, year of publication, and link to the full text.
- Data Management Tool: Use specialized software to organize and manage the extracted data. Suggestion: Rayyan https://www.rayyan.ai/
The available filters in the map depend on the data included in the characterization and defined at the beginning of the map's construction. For example, the filter for the target population of intervention/outcome, if collected, can be an interesting filter.
Quality Assessment
- Evaluation Tool: Use tools such as AMSTAR2 to assess the methodological quality of the included systematic reviews.
- Evaluation Process: Perform the quality assessment independently by two reviewers and resolve any disagreements through consensus or a third reviewer.
Construction of the Map
- Software: Use tools like Tableau Public to generate the Interactive Infographic, allowing dynamic data exploration.
Review and Validation
- Peer Review: Submit the evidence map to a peer review process to validate the accuracy and relevance of the presented data.
- Expert Feedback: Incorporate feedback from experts in the field to enhance the quality and usefulness of the map.
Publication and Dissemination
- Publication Platform: Publish the evidence map on the Virtual Health Library (VHL). https://bvsalud.org/mapa-de-evidencias/
- Dissemination: Promote the map through social media, newsletters, and scientific conferences to reach the scientific community and health professionals.
How to cite:
-
Application of Vancouver/ICMJE Style for Interactive Infographics
Example:
Ghelman R, Montagner P, Schveitzer MC, Portella CFS. Mapa de evidências sobre efetividade da Cannabis Medicinal [Internet]. São Paulo: BIREME/PAHO/WHO; 2021 [accessed on July 26, 2024]. Available at: https://public.tableau.com/app/profile/bireme/viz/cannabis-medicinal-pt/evidence-map.
Citation Data:
- Authority or Responsible Institution: Consórcio Acadêmico Brasileiro de Saúde Integrativa (CABSIN)
- Document Title: "Mapa de evidências sobre efetividade da Cannabis Medicinal"
- Publication Format: Available on the Internet
- Place of Publication: São Paulo
- Collaborators or Publishers: BIREME/PAHO/WHO (Virtual Health Library/Pan American Health Organization/World Health Organization)
- Year of Publication: 2021
- Access Date: July 26, 2024
- URL or Link to the Document: Mapa de evidências sobre efetividade da Cannabis Medicinal
Learn more…
This publication describes the Evidence Map methodology developed by BIREME: link
If you are interested in creating an evidence map based on this methodology, access the free online course available on the Virtual Campus for Public Health: Evidence Map: Methodology Application