In ancient Greece, the great philosopher Socrates paved the way to a new philosophy through maieutics and thus challenged the sophists with the interrogative “What”. Author William Betancourt states that this question opened for Socrates the means and character of reason and led him, slowly but continuously, to a new form of experience.1 Similarly, the first step of evidence-based medicine (EBM) is the formulation of a question, in order to start a learning process from the perspective of problem solving. The formulation of the right research question helps identify the appropriate keywords to perform the second step of EBM, or the search for information, in order to obtain relevant bibliographic resources. The third step is the critical analysis of the collected bibliographic information, and the fourth step is the use of results in clinical practice.2
The PICO strategy was first introduced by the Working Group of Evidence Based Medicine at McMaster University as an EBM tool that enables the construction of a well-focused question capable of resolving the queries raised in an interest’s. PICO is an acronym in which the letter P (Patient) stands for the problem to be solved or investigated in a patient or specific population; I (Intervention) is the intervention proposed for the solution of a question, such as a treatment, a diagnosis or a prognosis; C (Comparison group) is the comparison or intervention group with which it can be contrasted, and O (Outcome) refers to the expected result.2
The keywords yielded by the question may correspond to terms in natural or colloquial language commonly used by health professionals; however, these terms are not recommended for systematic information search because some bibliographic databases use thesauruses to perform data analysis, a process that includes lists of standardized terms, also known as “descriptors”. Once the descriptors that answer the research question are identified, they must be combined with Boolean connectors or logical operators in order to construct the search equation in the bibliographic databases, and thus obtain useful references that support the subject to be studied. It should be noted that Boolean connectors should always be capitalized; the most common are AND for combination, OR for addition, and NOT for exclusion.2
For additional accuracy in the information search process, controlled languages can be used to facilitate a specific bibliographic search; however, some researchers do not use them or are not aware of their existence. Following are the most relevant thesauruses in health sciences:
MeSH (Medical Subject Headings): this thesaurus was developed by the National Library of Medicine and consists of a list of controlled language terms used to describe the topic of Medline articles; it contains nearly 29,000 terms hierarchically organized by categories called trees.3
Emtree (Embase Subject Headings): this is a hierarchically structured and controlled lexicon for biomedicine and life sciences, developed by Elsevier for indexing articles in the Embase database; it includes more than 71,000 terms. In addition, the Embase database provides a default PICO form as a search option, which allows to integrate standard terms from this thesaurus.4
DeCS (Descriptors in Health Sciences): this thesaurus was created by BIREME to help indexing different types of materials, and for the search and retrieval of scientific literature in the information sources available in the Virtual Library in Health (VHL), including LILACS. It was developed from MeSH for searches in three languages; the concepts are hierarchically organized and include 33,558 descriptors and qualifiers, with 29,018 in MeSH and 4,540 exclusively in DeCS.5
In order to develop an appropriate research question, it is important to take into account the objective of EBM, which seeks to accurately define the clinical problem, update the basic concepts, and conduct a critical analysis of data.2 This helps carry out more elaborate searches using thesauruses and filters, which is consistent with the search for specificity suggested by the PICO strategy.6
Another aspect to consider is the level of evidence from published research. The Grading of Recommendations, Assessment, Development and Evaluation (GRADE) proposes a more rigorous method for evidence categorization, both in the classification of evidence level as well as in degree allocation of recommendation for either preventive or therapeutic intervention as well as a diagnostic procedure directly related to the quality of evidence. According to GRADE, evidence can be classified into four categories: high, moderate, low and very low; however, this system provides a series of items that helps increase or reduce the quality level of the evidence initially assigned, as stated by Aguayo-Albasini et al.7 The high and moderate categories include studies in which there is a high to moderate confidence in the coincidence between actual and estimated effects, as in experimental studies such as randomized clinical trials; on the other hand, at the low and very low levels there is a limited or no confidence in the coincidence between actual and estimated effect, as is the case of observational studies, such as cohort studies and cases and controls.7
In consequence, studies with high to moderate levels of evidence are preferable; if such studies are not found, publications in the other two levels should be carefully taken. Specifically in the field of dentistry, the use of these tools become necessary because quality scientific information in this profession is scarce, and clinical experience seems to be the one that provides guidance in different interventions.7
Accordingly, the present study seeks to identify whether the EBM PICO strategy using the MeSH, Emtree and DeCS thesauruses answers a research question in the field of dentistry.
The methodology to develop the PICO strategy in the field of dentistry used the following steps:
Preparation of the research question according to the PICO strategy.
Identification of all possible natural language synonyms to each component of the PICO tool.
Standardization of each natural language term with the respective thesauruses in bibliographic databases.
Adding descriptors to search builders of bibliographic databases, using Boolean connectors.
Selection of articles that answer the question posed, considering the levels of research evidence and recommended studies to be reviewed in a clinical diagnostic scenario.
Critical reading of articles that answer the initial research question.
For a brief explanation of the methodology used, an example is given with the research question posed, using a single term for each component of the PICO mnemonic in natural language as shown below.
In the first step, the following research question was posed: is there a concordance between clinical and imaging diagnoses for detecting a craniomandibular disorder, specifically disc displacement of the temporomandibular joint? This question corresponds to a search question model in a clinical diagnostic context. The study types recommended for this question are diagnostic tests, simple cross-sectional studies, comparative trials and systematic reviews.2
Table 1 shows the natural language terms that were obtained by separating the question according to the PICO mnemonic.
Acronym | ||||
---|---|---|---|---|
Natural language | Patient | Intervention | Comparison | Outcome |
Craniomandibular Disorder | Clinical Diagnosis | Magnetic resonance imaging | Predictive Value |
The terms used are described below:
For the PICO question posed in this study, the patient (P) had a Craniomandibular Disorder or Temporomandibular Dysfunction (TMD), defined by the American Academy of Orofacial Pain (AAOP) as “a generic term encompassing a number of clinical problems affecting mastication muscles, temporomandibular joint (TMJ), associated structures or both.”9
For the diagnostic test, disc position was assessed using findings from Research Diagnostic Criteria in Temporomandibular Disorders (RDC/TMD).10
The comparison was made against the Gold standard from the analysis of magnetic resonance (MR) of the TMJ. This is a specialized examination that uses magnetic fields and radiofrequency electromagnetic waves to observe soft tissues such as those found in the TMJ.11
Positive predictive value is the clinical examination ability to provide a positive result to actual patients by making comparisons against imaging diagnosis, thus avoiding the inclusion of false positives.12 The expected outcome was a positive predictive value between clinical and imaging diagnosis to detect TMJ disc displacement.
In the second step, all possible synonyms were identified in natural language for each component of the PICO mnemonic. In terms of P, the most used synonyms were: craniomandibular dysfunction, temporomandibular dysfunction, temporomandibular disorder, craniocervicomandibular dysfunction. In the I component, the synonyms used were: clinical diagnosis, diagnosis, clinical examination, clinical evaluation. In C, the synonyms were: magnetic resonance, diagnostic imaging, nuclear magnetic resonance, imaging diagnosis; finally, for the O component the synonyms were: predictive value, operational characteristics of the clinical test, and predictive value of the positive test.
To carry out the third step, each natural language term was normalized with the respective thesauruses present in different bibliographic databases: MEDLINE, Embase, Embase PICO search form (which for this study was accessed through the resources subscribed by the Universidad del Valle Library).
The fourth step involved combining the descriptors with Boolean connectors. These connectors allowed to restrict, extend or exclude information using keywords;13 for the PICO mnemonic, they were used as follows for each item:
P: first term OR second term
I: first term OR second term
C: first term OR second term
O: first term OR second term
After searching for each PICO mnemonic item using the OR connector, the Boolean AND connector was used between each semantic field as follows:
(The result of joining the two P terms) AND (The result of joining the two I terms) AND (The result of joining the two C terms) AND (The result of joining the two O terms). This may vary according to the number of terms used for each item, which may be one or more.
In the fifth step, the articles that answered the question were chosen.
Finally, the descriptors for each thesaurus were recorded in a table, including the step- by-step screenshots of the search process.
Below is a description of the search conducted using the PICO strategy in one of the proposed bibliographic databases, so that it can serve as a model for solving research questions in other areas of study.
The MeSH thesaurus in PubMed was accessed in order to identify the terms to be used. In some cases, MeSH may yield terms with names related to each other, so the researcher should look at the MeSH tree to identify hierarchies and refine the search. In the case of “Craniomandibular Disorders” as a patient-related term, it was decided to use the term “temporomandibular” as a keyword in MeSH in order to find more results related to this word, as this disorder is usually known by different names.
The search yielded 21 terms; however, at first glance it could be said that just five terms-temporomandibular joint disorders, temporomandibular joint disc, temporomandibular joint dysfunction syndrome, temporomandibular joint, craniomandibular disorders-were related to the subject of interest, but only the highest-ranking term was used in this exercise. By entering the descriptor, for example, “Temporomandibular Joint Disorders”, one can observe its hierarchy within the MeSH tree, identifying that it comes from the term “Craniomandibular Disorders”, which in turn derives the term “Temporomandibular Joint Dysfunction Syndrome”. The highest-ranking terms show those below them, meaning that if you search for “Craniomandibular Disorders”, the search results will include articles related to “Temporomandibular Joint Disorders” and “Temporomandibular Joint Dysfunction Syndrome” also.
In the case of “Temporomandibular Joint” and “Temporomandibular Joint Disc”, the two terms are part of the “anatomy category” and derive from the descriptor “Joints”, which refers to the anatomical structures that compose the TMJ in a normal state, which does not apply to the present search strategy as it is analyzing an alteration that depends directly on the “Diseases Category”.
The PICO mnemonic development began with the search for the normalized Patient term. It was decided to use the “Craniomandibular Disorders” descriptor, which derives from the “Diseases Category” and is under the “Mandibular Diseases” descriptor (Figure 1).
Once Patient is identified, the term is added to the “PubMed Search Builder”, running the “Search PubMed” option as shown in Figure 2, in order to find all the articles related to the normalized “Craniomandibular Disorders” term.
Once this procedure was completed, the database searched for articles that were indexed under the term “Craniomandibular Disorders” and that had a direct relation to the topic of interest. A total of 16,199 results were found.
When the search was conducted without including normalized terms, the database conducted a mapping of the term in the MeSH field, and then searched for the phrase in all fields, as follows:
“craniomandibular disorders” [MeSH Terms] OR (“craniomandibular” [All Fields] AND ‘“disorders” [All Fields]) OR “craniomandibular disorders” [All Fields]
The terms for the other components of PICO mnemonics were searched in the MeSH thesaurus in the same way. After having normalized the four terms of each item belonging to the PICO, an advanced search was conducted. Each term was added to the “Builder” using the “History” option, hitting the “Search” bottom as shown in Figure 3.
This procedure was followed by the construction of the search equation that answered the question posed according to the terms used. This equation yielded 43 articles.
The same process was later conducted in the EMBASE and LILACS bibliographic databases using the Emtree and DeCS thesauruses respectively. All results were listed in Table 2, with their respective search equations.
The PICO mnemonic yielded 43 results in MEDLINE through PubMed and 14 results in Embase, of which 5 corresponded to the Embase database and 7 to MEDLINE, as Embase integrates the results of the MEDLINE database in its search. In addition, this same search strategy was carried out in the Embase PICO form, obtaining the same 14 results. On the other hand, no results were obtained on the LILACS database.
Finally, 4 original articles14-17 were identified that answer the research question posed in the field of dentistry.
Although few studies validate effectiveness of the PICO strategy, the exercise conducted in this study showed that the strategy pro vides results that answer a research question in the field of dentistry.
The 4 identified original articles that answer a proposed research question include controversial results because some authors, such as Barclay et al14 and Emshoff et al15 report a slight and low degree of concordance between both diagnosis techniques, concluding that the RDC/TMD instrument used for clinical diagnosis is limited in detecting TMJ disc position, and therefore it needs to be supplemented with MRI diagnosis. On the other hand, Manfredini et al16 and Kraus et al17 report a good level of concordance, showing that a complete medical history can correctly detect disc position alterations, while recognizing the importance of specialized examinations, as shown in Table 3.
Study | Methods | Concordance |
---|---|---|
Barclay et al14 1999 USA | Instruments: RDC/TMD- MRI 1.5 Teslas Sample: 78 TMJs | K = 0.36 Low concordance |
Emsohoff et al15 2002 Austria | Instruments: RDC/TMD- MRI 1.5 Teslas Sample: 168 TMJs | K = 0.10 Slight concordance |
Manfredini et al16 2008 Italy | Instruments: RDC/TMD - MRI 1.5 Teslas Sample: 232 TMJs | K = 0.63 Good concordance |
Kraus et al17 2017 USA | Instruments: RDC/TMD - MRI Sample: 92 TMJ | K = 0.80 Good concordance |
This study did not find systematic reviews to allow a higher level of evidence of the consulted literature. The articles found are observational cross-sectional studies, which according to the evidence levels of the GRADE system show a low level of evidence.7
However, the found information allows dental professionals to recognize that the clinical evaluation of the TMJ has a percentage of error, and definitive treatment cases should ideally rely on diagnostic evaluation through MRI, as patients with no intra-articular abnormalities may undergo unnecessary clinical-surgical interventions. In the case of conservative treatments, clinical examination alone may guide intervention plans, depending on alteration type.
This literature analysis was possible thanks to the PICO strategy, relying on automated databases that are excellent starting points for the search of scientific information. However, this search requires the acquisition of skills by researchers.18 More than 20,000 medical journals and 2,000,000 articles are published annually, requiring the design of indexing systems to facilitate their retrieval.19
Some authors argue that the PICO tool makes it easier to obtain the best available scientific information quickly and accurately;20 however, authors such as Schardt et al21 claim that a successful search using the PICO tool depends on the formulation of a successful research question. Nevertheless, there are few studies that assess the relevance of this tool.22
On the other hand, the authors of the present study consider that another important factor in the search for information is the researcher’s expertise in the management of resources and knowledge of thesauruses, as the way of indexing information varies from one database to the other. The language- controlled search terms for MEDLINE (MeSH) and EMBASE (Emtree) are not identical, so it is important to specify searches according to the database used. In the present example, for instance, when the predictive value term was normalized in natural language in all three thesauruses, the MeSH term was “predictive value of tests”, while the Emtree term was “predictive value” and in DeCS was “predictive test value”.
The exercise carried out in this study showed that the PICO mnemonic helps obtain results to answer the clinical question posed regarding the concordance between clinical and imaging diagnoses to detect a TMJ disc displacement, as it was answered through studies found using the PICO strategy; therefore, the authors consider this to be a tool that makes it easier to find answers to research questions in the field of health, specifically in dentistry. On the other hand, taking into account the recommended types of study for questions in a clinical diagnostic scenario, appropriate cross-sectional, diagnostic and comparative studies were found.
The authors of this article thank the Universidad del Valle Libraries Division for allowing the use of its electronic resources, and the TEBLAMI Research Group.
3. Fernández-Altuna MA, Martínez del Prado A, Arriarán Rodríguez E, Gutiérrez Rayón D, Toriz Castillo HA, Lifshitz Guinzberg A. Uso de los MeSH: una guía práctica. Investigación en educación médica. 2016; 5(20): 220-9.
MA Fernández-Altuna A Martínez del Prado E Arriarán Rodríguez D Gutiérrez Rayón HA Toriz Castillo A Lifshitz Guinzberg Uso de los MeSH: una guía prácticaInvestigación en educación médica2016520220229
5. Biblioteca Virtual en Salud. DeCS - Descriptores en ciencias de la salud. São Paulo: biblioteca virtual en salud, 2018. Available in http://decs.bvs.br/E/decsweb2018.htm
Biblioteca Virtual en Salud DeCS - Descriptores en ciencias de la saludSão Paulobiblioteca virtual en salud2018http://decs.bvs.br/E/decsweb2018.htm
6. Aromataris E, Riitano D. Constructing a search strategy and searching for evidence: a guide to the literature search for a systematic review. Am J Nurs. 2014; 114(5): 49-56. DOI: https://doi.org/10.1097/01.NAJ.0000446779.99522.f6
E Aromataris D Riitano Constructing a search strategy and searching for evidence: a guide to the literature search for a systematic reviewAm J Nurs.201411454956https://doi.org/10.1097/01.NAJ.0000446779.99522.f6
7. Aguayo-Albasini JL, Flores-Pastor B, Soria-Aledo V. [GRADE system: classification of quality of evidence and strength of recommendation]. Cir Esp. 2014; 92(2): 82-8. DOI: https://doi.org/10.1016/j.ciresp.2013.08.002
JL Aguayo-Albasini B Flores-Pastor V Soria-Aledo [GRADE system: classification of quality of evidence and strength of recommendation]Cir Esp.20149228288https://doi.org/10.1016/j.ciresp.2013.08.002
9. Ohrbach R, Dworkin SF. AAPT Diagnostic Criteria for Chronic Painful Temporomandibular Disorders. J Pain. 2019. DOI: https://doi.org/10.1016/j.jpain.2019.04.003
R Ohrbach SF Dworkin AAPT Diagnostic Criteria for Chronic Painful Temporomandibular DisordersJ Pain.2019https://doi.org/10.1016/j.jpain.2019.04.003
10. Schiffman E, Ohrbach R, Truelove E, Look J, Anderson G, Goulet JP, et al. Diagnostic criteria for temporomandibular disorders (DC/TMD) for clinical and research applications: recommendations of the International RDC/TMD Consortium Network and Orofacial Pain Special Interest Group. J Oral Facial Pain Headache. 2014; 28(1): 6-27. DOI: https://doi.org/10.11607/jop.1151
E Schiffman R Ohrbach E Truelove J Look G Anderson JP Goulet Diagnostic criteria for temporomandibular disorders (DC/TMD) for clinical and research applications: recommendations of the International RDC/TMD Consortium Network and Orofacial Pain Special Interest GroupJ Oral Facial Pain Headache.2014281627https://doi.org/10.11607/jop.1151
11. Orhan K, Aksoy S. Magnetic Resonance Imaging of TMJ. En: Rozylo-Kalinowska I, Orhan K. Imaging of the Temporomandibular Joint. Suiza: Springer, 2019. 155-204.
K Orhan S Aksoy Magnetic Resonance Imaging of TMJ I Rozylo-Kalinowska K Orhan Imaging of the Temporomandibular JointSuizaSpringer2019155204
12. Carneiro AV. Diagnostic characteristics of tests: sensitivity, specificity, predictive values and likelihood ratios. Rev Port Cardiol. 2011; 30(5): 551-8.
AV Carneiro Diagnostic characteristics of tests: sensitivity, specificity, predictive values and likelihood ratiosRev Port Cardiol.2011305551558
13. Díaz Narváez VP. Metodología de la investigación científica y bioestadística: para médicos, odontólogos y estudiantes de ciencias de la salud. Chile: RiL editores, 2009.
VP Díaz Narváez Metodología de la investigación científica y bioestadística: para médicos, odontólogos y estudiantes de ciencias de la saludChileRiL editores2009
14. Barclay P, Hollender LG, Maravilla KR, Truelove EL. Comparison of clinical and magnetic resonance imaging diagnosis in patients with disk displacement in the temporomandibular joint. Oral Surg Oral Med Oral Pathol Oral Radiol Endod. 1999; 88(1): 37-43.
P Barclay LG Hollender KR Maravilla EL Truelove Comparison of clinical and magnetic resonance imaging diagnosis in patients with disk displacement in the temporomandibular jointOral Surg Oral Med Oral Pathol Oral Radiol Endod.19998813743
15. Emshoff R, Brandlmaier I, Bosch R, Gerhard S, Rudisch A, Bertram S. Validation of the clinical diagnostic criteria for temporomandibular disorders for the diagnostic subgroup - disc derangement with reduction. J Oral Rehabil. 2002; 29(12): 1139-45.
R Emshoff I Brandlmaier R Bosch S Gerhard A Rudisch S Bertram Validation of the clinical diagnostic criteria for temporomandibular disorders for the diagnostic subgroup - disc derangement with reductionJ Oral Rehabil.2002291211391145
16. Manfredini D, Guarda-Nardini L. Agreement between research diagnostic criteria for temporomandibular disorders and magnetic resonance diagnoses of temporomandibular disc displacement in a patient population. Int J Oral Maxillofac Surg. 2008; 37(7): 612-6. DOI: https://doi.org/10.1016/j.ijom.2008.04.003
D Manfredini L Guarda-Nardini Agreement between research diagnostic criteria for temporomandibular disorders and magnetic resonance diagnoses of temporomandibular disc displacement in a patient populationInt J Oral Maxillofac Surg.2008377612616https://doi.org/10.1016/j.ijom.2008.04.003
17. Kraus S, Prodoehl J. Disc displacement without reduction with limited opening: a clinical diagnostic accuracy study. Physiother Theory Pract. 2017; 33(3): 238-44. DOI: https://doi.org/10.1080/09593985.2017.1288282
S Kraus J Prodoehl Disc displacement without reduction with limited opening: a clinical diagnostic accuracy studyPhysiother Theory Pract.2017333238244https://doi.org/10.1080/09593985.2017.1288282
18. Campos-Asensio C. How to develop a bibliographic search strategy. Enferm Intensiva. 2018; 29(4): 182-6. DOI: https://doi.org/10.1016/j.enfi.2018.09.001
C Campos-Asensio How to develop a bibliographic search strategyEnferm Intensiva.2018294182186https://doi.org/10.1016/j.enfi.2018.09.001
19. Jiménez Villa J, Argimon Pallás JM, Martín ZA, Vilardell Tarrés M. Publicación científica biomédica: cómo escribir y publicar un artículo de investigación. España: Elsevier; 2016.
J Jiménez Villa JM Argimon Pallás ZA Martín M Vilardell Tarrés Publicación científica biomédica: cómo escribir y publicar un artículo de investigaciónEspañaElsevier2016
20. Landa-Ramírez E, Arredondo-Pantaleón AJ. Herramienta PICO para la formulación y búsqueda de preguntas clínicamente relevantes en la psicooncología basada en la evidencia. Psicooncología. 2014; 11(2-3): 259. DOI: https://doi.org/10.5209/rev_PSIC.2014.v11.n2-3.47387
E Landa-Ramírez AJ Arredondo-Pantaleón Herramienta PICO para la formulación y búsqueda de preguntas clínicamente relevantes en la psicooncología basada en la evidenciaPsicooncología.2014112-3259259https://doi.org/10.5209/rev_PSIC.2014.v11.n2-3.47387
21. Schardt C, Adams MB, Owens T, Keitz S, Fontelo P. Utilization of the PICO framework to improve searching PubMed for clinical questions. BMC Med Inform Decis Mak. 2007; 7:16. DOI: https://doi.org/10.1186/1472-6947-7-16
C Schardt MB Adams T Owens S Keitz P Fontelo Utilization of the PICO framework to improve searching PubMed for clinical questionsBMC Med Inform Decis Mak.200771616https://doi.org/10.1186/1472-6947-7-16
22. Eriksen MB, Frandsen TF. The impact of patient, intervention, comparison, outcome (PICO) as a search strategy tool on literature search quality: a systematic review. J Med Libr Assoc. 2018; 106(4): 420-31. DOI: https://doi.org/10.5195/jmla.2018.34523
MB Eriksen TF Frandsen The impact of patient, intervention, comparison, outcome (PICO) as a search strategy tool on literature search quality: a systematic reviewJ Med Libr Assoc.20181064420431https://doi.org/10.5195/jmla.2018.34523