首页 | 本学科首页   官方微博 | 高级检索  
相似文献
 共查询到20条相似文献，搜索用时 72 毫秒
1.
The performance of adverse effects search filters in MEDLINE and EMBASE   总被引：1，自引：1，他引：0  
Background: Search filters can potentially improve the efficiency of searches involving electronic databases such as medline and embase . Although search filters have been developed for identifying records that contain adverse effects data, little is known about the sensitivity of such filters. Objectives: This study measured the sensitivity of using available adverse effects filters to retrieve papers with adverse effects data. Methods: A total of 233 included studies from 26 systematic reviews of adverse effects were used for analysis. Search filters from medline and embase were tested for their sensitivity in retrieving the records included in these reviews. In addition, the sensitivity of each individual search term used in at least one search filter was measured. Results: Subheadings proved the most useful search terms in both medline and embase . No indexing terms in medline achieved over 12% sensitivity. The sensitivity of published search filters varied in medline from 3% to 93% and in embase from 57% to 97%. Whether this level of sensitivity is acceptable will be dependent on the purpose of the search. Conclusions: Although no adverse effects search filter captured all the relevant records, high sensitivity could be achieved. Search filters may therefore be useful in retrieving adverse effects data.  相似文献   

2.
OBJECTIVE: This study aimed to assess the performance, in terms of sensitivity and precision, of different approaches to searching MEDLINE and EMBASE to identify studies of adverse effects. METHODS: Five approaches to searching for adverse effects evidence were identified: approach 1, using specified adverse effects; approach 2, using subheadings/qualifiers; approach 3, using text words; approach 4, using indexing terms; approach 5, searching for specific study designs. The sensitivity and precision of these five approaches, and combinations of these approaches, were compared in a case study using a systematic review of the adverse effects of seven anti-epileptic drugs. RESULTS: The most sensitive search strategy in MEDLINE (97.0%) required a combination of terms for specified adverse effects, floating subheadings, and text words for 'adverse effects'. In EMBASE, a combination of terms for specified adverse effects and text words for 'adverse effects' provided the most sensitive search strategy (98.6%). Both these search strategies yielded low precision (2.8%). CONCLUSIONS: A highly sensitive search in either database requires a combination of approaches, and has low precision. This suggests that better reporting and indexing of adverse effects is required and that an effective generic search filter may not yet be feasible.  相似文献   

3.
Objective:We previously developed draft MEDLINE and Embase (Ovid) geographic search filters for Organisation for Economic Co-operation and Development (OECD) countries to assess their feasibility for finding evidence about the countries. Here, we describe the validation of these search filters.Methods:We identified OECD country references from thirty National Institute for Health and Care Excellence (NICE) guidelines to generate gold standard sets for MEDLINE (n=2,065) and Embase (n=2,023). We validated the filters by calculating their recall against these sets. We then applied the filters to existing search strategies for three OECD-focused NICE guideline reviews (NG103 on flu vaccination, NG140 on abortion care, and NG146 on workplace health) to calculate the filters'' impact on the number needed to read (NNR) of the searches.Results:The filters both achieved 99.95% recall against the gold standard sets. Both filters achieved 100% recall for the three NICE guideline reviews. The MEDLINE filter reduced NNR from 256 to 232 for the NG103 review, from 38 to 27 for the NG140 review, and from 631 to 591 for the NG146 review. The Embase filter reduced NNR from 373 to 341 for the NG103 review, from 101 to 76 for the NG140 review, and from 989 to 925 for the NG146 review.Conclusion:The NICE OECD countries'' search filters are the first validated filters for the countries. They can save time for research topics about OECD countries by finding the majority of evidence about OECD countries while reducing search result volumes in comparison to no filter use.  相似文献   

4.

Background

Search filter development for adverse effects has tended to focus on retrieving studies of drug interventions. However, a different approach is required for surgical interventions.

Objective

To develop and validate search filters for medline and Embase for the adverse effects of surgical interventions.

Methods

Systematic reviews of surgical interventions where the primary focus was to evaluate adverse effect(s) were sought. The included studies within these reviews were divided randomly into a development set, evaluation set and validation set. Using word frequency analysis we constructed a sensitivity maximising search strategy and this was tested in the evaluation and validation set.

Results

Three hundred and fifty eight papers were included from 19 surgical intervention reviews. Three hundred and fifty two papers were available on medline and 348 were available on Embase. Generic adverse effects search strategies in medline and Embase could achieve approximately 90% relative recall. Recall could be further improved with the addition of specific adverse effects terms to the search strategies.

Conclusion

We have derived and validated a novel search filter that has reasonable performance for identifying adverse effects of surgical interventions in medline and Embase. However, we appreciate the limitations of our methods, and recommend further research on larger sample sizes and prospective systematic reviews.  相似文献   

5.
Objective:The aim of this project was to validate search filters for systematic reviews, intervention studies, and observational studies translated from Ovid MEDLINE and Embase syntax and used for searches in PubMed and Embase.com during the development of evidence summaries supporting first aid guidelines. We aimed to achieve a balance among recall, specificity, precision, and number needed to read (NNR).Methods:Reference gold standards were constructed per study type derived from existing evidence summaries. Search filter performance was assessed through retrospective searches and measurement of relative recall, specificity, precision, and NNR when using the translated search filters. Where necessary, search filters were optimized. Adapted filters were validated in separate validation gold standards.Results:Search filters for systematic reviews and observational studies reached recall of ≥85% in both PubMed and Embase. Corresponding specificities for systematic review filters were ≥96% in both databases, with a precision of 9.7% (NNR 10) in PubMed and 5.4% (NNR 19) in Embase. For observational study filters, specificity, precision, and NNR were 68%, 2%, and 51 in PubMed and 47%, 0.8%, and 123 in Embase, respectively. These filters were considered sufficiently effective. Search filters for intervention studies reached a recall of 85% and 83% in PubMed and Embase, respectively. Optimization led to recall of ≥95% with specificity, precision, and NNR of 49%, 1.3%, and 79 in PubMed and 56%, 0.74%, and 136 in Embase, respectively.Conclusions:We report validated filters to search for systematic reviews, observational studies, and intervention studies in guideline projects in PubMed and Embase.com.  相似文献   

6.
Objective:Locating systematic reviews is essential for clinicians and researchers when creating or updating reviews and for decision-making in health care. This study aimed to develop a search filter for retrieving systematic reviews that improves upon the performance of the PubMed systematic review search filter.Methods:Search terms were identified from abstracts of reviews published in Cochrane Database of Systematic Reviews and the titles of articles indexed as systematic reviews in PubMed. Both the precision of the candidate terms and the number of systematic reviews retrieved from PubMed were evaluated after excluding the subset of articles retrieved by the PubMed systematic review filter. Terms that achieved a precision greater than 70% and relevant publication types indexed with MeSH terms were included in the filter search strategy.Results:The search strategy used in our filter added specific terms not included in PubMed''s systematic review filter and achieved a 61.3% increase in the number of retrieved articles that are potential systematic reviews. Moreover, it achieved an average precision that is likely greater than 80%.Conclusions:The developed search filter will enable users to identify more systematic reviews from PubMed than the PubMed systematic review filter with high precision.  相似文献   

7.
相似文献   

8.
Objective:There are no existing validated search filters for the group of 37 Organisation for Economic Co-operation and Development (OECD) countries. This study describes how information specialists from the United Kingdom''s National Institute for Health and Care Excellence (NICE) developed and evaluated novel OECD countries’ geographic search filters for MEDLINE and Embase (Ovid) to improve literature search effectiveness for evidence about OECD countries.Methods:We created the draft filters using an alternative approach to standard filter construction. They are composed entirely of geographic subject headings and are designed to retain OECD country evidence by excluding non-OECD country evidence using the NOT Boolean operator. To evaluate the draft filters’ effectiveness, we used MEDLINE and Embase literature searches for three NICE guidelines that retrieved >5,000 search results. A 10% sample of the excluded references was screened to check that OECD country evidence was not inadvertently excluded.Results:The draft MEDLINE filter reduced results for each NICE guideline by 9.5% to 12.9%. In Embase, search results were reduced by 10.7% to 14%. Of the sample references, 7 of 910 (0.8%) were excluded inadvertently. These references were from a guideline about looked-after minors that concerns both OECD and non-OECD countries.Conclusion:The draft filters look promising—they reduced search result volumes while retaining most OECD country evidence from MEDLINE and Embase. However, we advise caution when using them in topics about both non-OECD and OECD countries. We have created final versions of the search filters and will validate them in a future study.  相似文献   

9.

Background

The most current objectively derived search filters for adverse drug effects are 15 years old and other strategies have not been developed and tested empirically.

Objective

To develop and validate search filters to retrieve evidence on adverse drug effects from Ovid medline and Ovid Embase.

Methods

We identified systematic reviews of adverse drug effects in Epistemonikos. From these reviews, we collated their included studies which we then randomly divided into three tests and one validation set of records. We constructed a search strategy to maximise relative recall using word frequency analysis with test set one. This search strategy was then refined using test sets two and three and validated on the final set of records.

Results

Of 107 systematic reviews which met our inclusion criteria, 1948 unique included studies were available from medline and 1980 from Embase. Generic adverse drug effects searches in medline and Embase achieved 90% and 89% relative recall, respectively. When specific adverse effects terms were added recall was improved.

Conclusion

We have derived and validated search filters that retrieve around 90% of records with adverse drug effects data in medline and Embase. The addition of specific adverse effects terms is required to achieve higher recall.  相似文献   

10.
Background: Research on identifying trials using geographic filters is limited. Objectives:  To test the sensitivity and precision of a filter to identify African randomised controlled trials (RCTs). Methods: We searched medline and embase for RCTs published in 2004 using a Cochrane filter for RCTs. The search was limited to HIV/AIDS but irrespective of location. Two investigators independently identified African RCTs from the retrieved records forming a reference set. We then repeated the search using an African geographic filter comprising country and regional terms forming the filter set. We compared the sensitivity and precision of the sets. Results: The medline reference set comprised 1799 records with 23 African RCTs; for embase , the reference set comprised 763 records with 37 African RCTs. The medline filter set comprised 180 records with 17 African RCTs; the embase filter set comprised 98 records with 27 African RCTs. Sensitivity of the filter was 74% (medline ) and 73% (embase ). Addition of the filter improved precision from 1.3% to 9.4% (medline ) and from 5% to 28% (embase ). Conclusion: The African filter improved precision with some loss in sensitivity. Incomplete reporting of trial location in electronic bibliographic records restricts efficiency of geographic filters. Prospective trial registration should alleviate this.  相似文献   

11.
Background: People search medline for trials of healthcare interventions for clinical decisions, or to produce systematic reviews, practice guidelines, or technology assessments. Finding all relevant randomized controlled trials (RCTs) with little extraneous material is challenging. Objective: To provide comparative data on the operating characteristics of search filters designed to retrieve RCTs from medline . Methods: We identified 38 filters. The testing database comprises handsearching data from 161 clinical journals indexed in medline . Sensitivity, specificity and precision were calculated. Results: The number of terms and operating characteristics varied considerably. Comparing the retrieval against the single term ‘randomized controlled trials.pt.’ (sensitivity for retrieving RCTs, 93.7%), 24 of 38 filters had statistically higher sensitivity; 6 had a sensitivity of at least 99.0%. Four other filters had specificities (non retrieval of non‐RCTs) that were statistically not different or better than the single term (97.6%). Precision was poor: only two filters had precision (proportion of retrieved articles that were RCTs) statistically similar to that of the single term (56.4%)—all others were lower. Filters with more search terms often had lower specificity, especially at high sensitivities. Conclusion: Many RCT filters exist (n = 38). These comparative data can direct the choice of an RCT filter.  相似文献   

12.
Objectives: To devise and evaluate a sensitive search strategy to retrieve diagnostic studies on specific diagnostic tests for deep vein thrombosis (DVT). Methods: Systematic reviews on diagnostic tests for DVT were identified and the studies cited by them used to produce a reference set of search results (to be used to evaluate different search strategies). Five existing diagnosis search filters were combined to produce a sensitive search. This combined search was then refined to produce a more specific strategy, which was run on medline and the results were checked against the reference set. This search was too specific and was modified to produce a more balanced final strategy, which was again tested and the results compared with the reference set. The sensitivity of this newly created strategy was compared with the existing diagnosis searches already found. Finally, studies identified by the final search strategy were critically appraised for validity and relevance and the selected articles were compared with those found in the reference set. Results: The final filter retrieved 124 out of 126 references from the reference set. From the search result, 227 cohort studies were selected and 147 of these were not cited in any of the systematic reviews on diagnostic tests for DVT. Conclusions: The search strategy had 98.8% sensitivity. The precision of 8.8%, although low, compares well with other strategies with high sensitivity. Most of the systematic reviews on diagnosing a DVT have omitted a number of high quality articles.  相似文献   

13.
OBJECTIVES: Difficulties encountered in the retrieval of evidence-based nursing (EBN) literature and recognition of terminology, research focus, and design differences between evidence-based medicine and nursing led to the realization that nursing needs its own filter strategies for evidence-based practice. This article describes the development and evaluation of filters that facilitate evidence-based nursing searches. METHODS: An inductive, multistep methodology was employed. A sleep search strategy was developed for uniform application to all filters for filter development and evaluation purposes. An EBN matrix was next developed as a framework to illustrate conceptually the placement of nursing-sensitive filters along two axes: horizontally, an adapted nursing process, and vertically, levels of evidence. Nursing diagnosis, patient outcomes, and primary data filters were developed recursively. Through an interface with the PubMed search engine, the EBN matrix filters were inserted into a database that executes filter searches, retrieves citations, and stores and updates retrieved citations sets hourly. For evaluation purposes, the filters were subjected to sensitivity and specificity analyses and retrieval set comparisons. Once the evaluation was complete, hyperlinks providing access to any one or a combination of completed filters to the EBN matrix were created. Subject searches on any topic may be applied to the filters, which interface with PubMed. RESULTS: Sensitivity and specificity for the combined nursing diagnosis and primary data filter were 64% and 99%, respectively; for the patient outcomes filter, the results were 75% and 71%, respectively. Comparisons were made between the EBN matrix filters (nursing diagnosis and primary data) and PubMed's Clinical Queries (diagnosis and sensitivity) filters. Additional comparisons examined publication types and indexing differences. Review articles accounted for the majority of the publication type differences, because "review" was accepted by the CQ but was "NOT'd" by the EBN filter. Indexing comparisons revealed that although the term "nursing diagnosis" is in Medical Subject Headings (MeSH), the nursing diagnoses themselves (e.g., sleep deprivation, disturbed sleep pattern) are not indexed as nursing diagnoses. As a result, abstracts deemed to be appropriate nursing diagnosis by the EBN filter were not accepted by the CQ diagnosis filter. CONCLUSIONS: The EBN filter capture of desired articles may be enhanced by further refinement to achieve a greater degree of filter sensitivity. Retrieval set comparisons revealed publication type differences and indexing issues. The EBN matrix filter "NOT'd" out "review," while the CQ filter did not. Indexing issues were identified that explained the retrieval of articles deemed appropriate by the EBN filter matrix but not included in the CQ retrieval. These results have MeSH definition and indexing implications as well as implications for clinical decision support in nursing practice.  相似文献   

14.

Objective:

The objective of this study was to validate an assessment instrument for MEDLINE search strategies at an academic medical center.

Method:

Two approaches were used to investigate if the search assessment tool could capture performance differences in search strategy construction. First, data from an evaluation of MEDLINE searches from a pediatric resident''s longitudinal assessment were investigated. Second, a cross-section of search strategies from residents in one incoming class was compared with strategies of residents graduating a year later. MEDLINE search strategies formulated by faculty who had been identified as having search expertise were used as a gold standard comparison. Participants were presented with a clinical scenario and asked to identify the search question and conduct a MEDLINE search. Two librarians rated the blinded search strategies.

Results:

Search strategy scores were significantly higher for residents who received training than the comparison group with no training. There was no significant difference in search strategy scores between senior residents who received training and faculty experts.

Conclusion:

The results provide evidence for the validity of the instrument to evaluate MEDLINE search strategies. This assessment tool can measure improvements in information-seeking skills and provide data to fulfill Accreditation Council for Graduate Medical Education competencies.

Highlights

  • The University of Michigan MEDLINE Search Assessment tool can be used to assess search skills in residency education.
  • Five elements were identified as critical elements in the development of an effective MEDLINE search strategy: inclusion of all search concepts, appropriate use of Medical Subject Headings, appropriate use of search limits, successful combination of all concepts, and search efficiency.

Implications

  • This validated assessment tool can serve as an effective means to measure improvements in residents'' information-seeking skills and provide data to fulfill Accreditation Council for Graduate Medical Education competencies.
  相似文献   

15.
OBJECTIVES: To assess the performance of published search filters in finding diagnostic test accuracy studies. METHODS: Diagnostic test accuracy search filters were identified by searching medline, our own files and by requesting unpublished filters from colleagues. We applied the filters to a case study review of diagnostic test accuracy studies for urinary tract infections (UTI) in young children. The included studies with records in medline formed the gold standard. The performance of the filters in finding those gold standard records was assessed. RESULTS: We identified twenty-three diagnostic test accuracy search filters for use with medline. The case study systematic review of UTI included 179 studies of diagnostic test accuracy, of which 160 were available in medline. The filters showed a wide range of sensitivities (range: 20.6% to 86.9%) and precision (range: 1% to 9.4%). CONCLUSIONS: Our results broadly support those reported in two other studies. The search filters tested do not offer an adequate trade-off between sensitivity and precision to be used to identify studies for systematic reviews. However, there are methods available to explore whether search filters are viable based on an objective statistical analysis of the text and indexing used in records.  相似文献   

16.
Background/objectives: Methodological decisions made during the research process can influence generalizability of findings to real world practice. The aims of this study were to explore the impact of decisions made in the development of a palliative care search filter and to consider the implications for implementation. Methods: Three elements of the original study methodology were explored: (i) choice of OVID medline field delimiters; (ii) use of the general medical literature to evaluate the filter's performance; and (iii) use of the OVID interface. Sensitivity, specificity, accuracy and precision rates of variant search strategies were compared to consider each issue. Results: The delimiter .af. outperformed the alternatives of .tw. or .mp. in OVID medline , improving sensitivity from 45.4 to 46.2%. Applying the filter in the specialist palliative literature resulted in 87.5% (692/791) of articles being retrieved using either .tw. or .mp., increasing to 100% (791/791) with the .af. delimiter. Finally, a PubMed version of the filter was successfully validated. Conclusions: Reviewing three methodological decisions that preserved validity in an original study led to the improved utility of a search filter in practice. Generating high‐quality evidence is only part of evidence‐based practice: consideration of generalizability issues can inform further research and effective evidence implementation.  相似文献   

17.
Objective:This study retroactively investigated the search used in a 2019 review by Hayden et al., one of the first systematic reviews of prognostic factors that was published in the Cochrane Library. The review was designed to address recognized weaknesses in reviews of prognosis by using multiple supplementary search methods in addition to traditional electronic database searching.Methods:The authors used four approaches to comprehensively assess aspects of systematic review literature searching for prognostic factor studies: (1) comparison of search recall of broad versus focused electronic search strategies, (2) linking of search methods of origin for eligible studies, (3) analysis of impact of supplementary search methods on meta-analysis conclusions, and (4) analysis of prognosis filter performance.Results:The review''s focused electronic search strategy resulted in a 91% reduction in recall, compared to a broader version. Had the team relied on the focused search strategy without using supplementary search methods, they would have missed 23 of 58 eligible studies that were indexed in MEDLINE; additionally, the number of included studies in 2 of the review''s primary outcome meta-analyses would have changed. Using a broader strategy without supplementary searches would still have missed 5 studies. The prognosis filter used in the review demonstrated the highest sensitivity of any of the filters tested.Conclusions:Our study results support recommendations for supplementary search methods made by prominent systematic review methodologists. Leaving out any supplemental search methods would have resulted in missed studies, and these omissions would not have been prevented by using a broader search strategy or any of the other prognosis filters tested.

Open in a separate windowLeah Boulos  相似文献   

18.
OBJECTIVES: To detect term(s) in the Cochrane Highly Sensitive Search Strategy (HSSS) that retain high sensitivity but improve precision in retrieving reports of trials in the PubMed version of medline. METHODS: Individual terms from the PubMed version of the HSSS were added, term by term, to an African HIV/AIDS strategy to identify reports of trials in medline using PubMed. The titles and abstracts of the records retrieved were read by two handsearchers and checked by a clinical epidemiologist. The sensitivity and precision of each term in the three phases of the HSSS were calculated. RESULTS: Of 7,719 records retrieved, 285 were identified as reports of trials [204 randomized (RCTs); 81 possibly randomized or quasi-randomized (CCTs)]. Phase III had the highest sensitivity (92%). Overall, precision was very low (3.7%). One term, 'random*[tw]', retrieved all RCTs found by our search and improved precision to 29%. The least sensitive terms, yielding no records, were '(doubl* AND mask*)[tw]' and terms containing 'trebl*' or 'tripl*', except for '(tripl* AND blind*)[tw]'. The highest precision per term was for 'Double-blind Method [MeSH]' (76%). CONCLUSIONS: To retrieve all RCTs and CCTs found by our search, seven terms are needed but precision remains low (4.3%). Developments in the methods of search strategy design may help to improve precision while retaining high levels of sensitivity by identifying term(s) which occur frequently in relevant records and are the most efficient at discriminating between different study designs.  相似文献   

19.
OBJECTIVES: The objectives of the study were: to provide an overview of approaches to methodological search filter development; to identify and critically review the stages of methodological search filter development; to devise a search filter appraisal checklist based on the review. METHODS: An iterative approach to searching was employed utilizing health and library databases, the world wide web and citation searching. Further systematic methods included hand searching of key journals in the field of search filter development, contacting known experts in the field and scanning reference lists of relevant papers to identify additional studies. Altogether, 51 potentially relevant papers were found, of which 20 met the inclusion criteria. RESULTS: Four stages of search filter development were identified from the literature (search term selection, identification of a gold standard, evaluation and validation). Variations in the methods used to approach these four stages were identified, most importantly in the extent to which search filters are tested and validated. CONCLUSION: Awareness of the process and limitations involved in search filter development is essential to make an informed decision on the applicability and validity of search filters. The findings of this review indicate a considerable agenda for future research, in particular, to improve the quality of reporting of search filters and to inform users on their use and application. Based on the review, guidance in the appraisal process of search filters is given in the form of a checklist.  相似文献   

20.
Objective:We aimed to determine overlaps and optimal combination of multiple database retrieval and citation tracking for evidence synthesis, based on a previously conducted scoping review on facilitators and barriers to implementing nurse-led interventions in dementia care.Methods:In our 2019 scoping review, we performed a comprehensive literature search in eight databases (CENTRAL, CINAHL, Embase, Emcare, MEDLINE, Ovid Nursing Database, PsycINFO, and Web of Science Core Collection) and used citation tracking. We retrospectively analyzed the coverage and overlap of 10,527 retrieved studies published between 2015 and 2019. To analyze database overlap, we used cross tables and multiple correspondence analysis (MCA).Results:Of the retrieved studies, 6,944 were duplicates and 3,583 were unique references. Using our search strategies, considerable overlaps can be found in some databases, such as between MEDLINE and Web of Science Core Collection or between CINAHL, Emcare, and PsycINFO. Searching MEDLINE, CINAHL, and Web of Science Core Collection and using citation tracking were necessary to retrieve all included studies of our scoping review.Conclusions:Our results can contribute to enhancing future search practice related to database selection in dementia care research. However, due to limited generalizability, researchers and librarians should carefully choose databases based on the research question. More research on optimal database retrieval in dementia care research is required for the development of methodological standards.  相似文献   

设为首页 | 免责声明 | 关于勤云 | 加入收藏

Copyright©北京勤云科技发展有限公司  京ICP备09084417号