Factors Can Affect Validity Reliability Of Systematic Review Nursing Essay

Factors Can Affect Validity Reliability Of systematic Review Nursing EssaySystematic canvass with meta-analysis argon considered more(prenominal) purpose than separate qualitys of freshens such as traditional reviews because it involve the application of scientific strategies in ways that limit the preconceived opinion but the interpretation of the dictatorial rate to make believe like any other type of interrogation is overthrow to submit and this articles testament illustrate the sources of deviate in every step of conducting a domineering review and what is its types and ways.Keywords Systematic review, Bias, Meta-analysisIntroductionA systematic review is an everywhereview of many studies that used clear and reproducible methods while a meta-analysis is a mathematical subtraction of the results of two or more primary studies that address the selfsame(prenominal) assumption in the same way.Systematic reviews be very popular so somewhat 2500 new English lan guage systematic reviews are indexed in Medline annuall(a)y (Mother D, Tetzlaff J, Tricco a, et al). While the number is impressive ,the choice of their reporting is not always warning which lead to some kind of strokeed results and thusly shrink their usefulness.Although meta-analysis can increase the precision of a result, it is alpha to ensure that the methods used for the review were well-grounded and reliable. (Greenhangh. 1997)Speaking generally,thither are two sources -at least- can generate bias in systematic reviews the risk of bias in the included studies which it can exaggerate the results of a treatments effectiveness by 18% (Pidal J, Hrobjartsson A, Jorgensen KJ, et al) and the review itself as it has a little control over the reporting of RTCs but it can have considrable control over conducting and reporting the review, thereby minimizing the bias of review itself.In this article we will try to spot the sources of bias in every step of conducting a systematic re view and what is its types and ways and later onwards that we will talk in details about each factor might cause a bias including return bias, time lag bias, citation bias, the influence of external funding on the validity of systematic review and event reporting bias.Assessing the Quality of a Systematic ReviewGeneral Tips (step-by-step)Fundamentally, the quality of a systematic review and the reliability of its result are contingent on both the quality of the included studies and the quality of the methodology used to produce the systematic review.The first most burning(prenominal) step in conducting systematic review is proposing a clear, specific,focused and concise question which will guide the review process subsequently.Searching for articles to be included can be retrieved by electronic databases, searching by hands through book journals and by contacting researchers in the area of interest. To avoid the bias in the retrieval of articles the search strategy specified in the protocol must include as much details as possible. In most cases this amounts of to a list of keywords and how they will be combined for use in electronic search engines. whatever knowledge of the capability of each subject specific database is important at this point, as some databases kick the bucket a thesaurus search system and others operate on the basis of keywords only.Next step, occupyive inclusion studies whitethorn bias the results of systematic reviews if selected based on report characteristics which called Biased inclusion criteria and low methodological quality of studies included in a systematic review is another important source of bias (Strerne JAC, Egger M, Smith GD 2001) and inclusion of data from sources other than randomized trials reduces the reliability of the conclusions of a systematic review on issues of prevention and treatment, so they should be thoroughly considered and properly defined to avoid equivocalness and to inform the validity of the review. As protocol availability may decrease the biased post-hoc changes to methods and selective outcome reporting, this information should be included in the review protocol to minimize this bias.Even if the pack has high congenital validity, it may not to be generalizable(high external validity). There is a great deal a trad-off between internal and external validity. To decide about the generalizability of the study is to explore whether the study population appears to be representative of the population to which you wish to apply the results and even in equivalent populations, differences in the settings and in culture or other contextual factors, should as well be considered.(Petticrew M, Robert, H 2008)Reviewing the results of a number of studies of course itself provides a est of generalizability, if the results have been replicated in several settings with contrary population, then this gives an indication of whether the results are transferable. If the number of stu dies is coarse enough, it can suggest the range of effect sizes to be expected in different settings. Generalizability is not often assessed separately in systematic reviews, though consideration of the issue is included in some critical appraisal checklists. (Deeks J, Dinnes J, DAmico R, Sowden A, Sakarovitch C. 2003)The risk of bias of a particular study is a key component in the assessment of studies that affect the validity of the results of a systematic review. Therefore, reducing the risk of bias assessment can be completed by using scales, checklists and every individual component should be reported for each study.(Sandrson S, Tatt ID, Higgins JP 2007).As the protocol developing, all the outcomes derived from the included studies should be considered and the outcome of primary importance should be differentiated from the secondary outcomes as recent surveys have showed that the outcomes selectively reported in closing reports were significantly more belike to be statistica lly significant than those omitted (Chan AW, Hrobjartsson A, Haahr MT, et al 2004). Therefore, if a review does not identify important variables clearly, the review risks being subject to bias.So, the reviewer might select statistically significant variables and ignore the ones were initially important by the reviewer.When it comes to analysing data, the analysing method is determined by the review question and the type of data collected and it should include a narrative synthesis for describing the results and risk of bias. The next step is usually determining if statistical synthesis is appropriate to apply or not. Indeed, such forced analysis might in the axiom scraps in garbage out, providing useless results which it will discussed Later.When the results of the analysis are ready, there are many different way to represent them but sufficient details should be presented to dtermine the potential threats to validity.As conclusion in the review, the reviewer should discuss the ri sk of bias, competency, limitation, weakness and applicability of the recite for each main outcome to ensure that clinicians have all the information to interpret the results. A table outlining the users guides to the checkup checkup Literature highlight critical appraisal questions for systematic reviews and meta-analyses may help to reduce the bias in every step when conducting a systematic review.( board 1)Table 1. Questions should be considered in determining if the results of systematic review are valid. ( adapted from Crowther, MA. Cook, DJ 2007)Did the overview address a focused clinical question?Were the criteria used to select articles for inclusion both defined and appropriate?What is the likelihood that relevant studies were missed?Was the validity of the included studies assessed?Were the assessment reproducible?How precise were the results of the overview?In assessing the value the review, it is important to consider the following questionCan the results be applied to my patients, and will the results help me care for my patients?Are the benefits worth the harms and costs?Garbage in garbage out?The quality of component marks is important as an example if the raw material is not that quality, then the purposes of reviews may also be the same. So what we put in exactly what we get out. Clearly, the studies included in systematic reviews should ideally be of high methodological quality and free of bias as possible.The biases that endanger the validity of clinical trials are relate to systematic differences in the patients characteristics at baseline (selection bias), unequal provision of care apart from the treatment under rating (performance bias), biased assessment of outcomes (detection bias) , and bias due to exclusion of patients after they have been allocated to treatment groups (attrition bias).(Altman 1991)Some reviews produced discordant results precisely because the authors chose to ignore the quality of component trails. The same reviewers were considerably more thorough in their attempt to identify all-relevant trails,Independent of publication statue or language of publication.Although the quality of component trails happened to be more important in this particular situation, the dispersion of findings from clinical trials is known to be biased, and a comprehensive literature search is an essential intergradient of high-quality reviews. (Eddger,M. Dickersin, K. Smith,G, S 2001)Putting the light on dissemination of research findings, Scherer et al. showed that only about half of abstracts presented at conferences are later promulgated in full.The fact that sustainable proportion of studies remains unpublished after the study had been completed must be a concern as a large information remains hidden from reviewers. Making things worse, the dissemination of research findings is not a random process, rather it is strongly influenced by the nature and guidance of results. (Eddger,M. Dickersin, K. Smith,G, S 2 001)Type of reporting biasDefinitionPublication biasThe publication or non-puplication of research findings, depending on the nature and direction of resultsTime lag biasThe rapid or delayed publication of research findings, depending on the nature and direction of resultsDuplicate publication biasThe multiple or singular publication of research findings, depending on the nature and direction of resultsCitation biasThe citation or non-citation of research findings, depending on the nature and direction of resultsLanguage biasThe publication of research findings in particular language, depending on the nature and direction of resultsOutcome reporting biasThe selecting reporting of some outcomes but not others, depending on the nature and direction of resultsFigure 1.2 (Adapted from Eddger,M. Dickersin, K. Smith,G, S 2001)Publication BiasIn a 1979 article on the file drawer caper and tolerance for null results Rosenthal said, where the journals are filled with the 5 per cent of the s tudies that show type I errors, while the file drawers back at the lab are filled with the 95 per cent of the studies that show non significant results. (Rosenthal R. 1979). The file drawer problem has long been recognized in the social sciences as a review of psychology journals found that of 294 studies published in 1970s, 97% rejected the null hypothesis at the 5% level.(Sterling TD.1980)It is thus possible that studies which suggest a beneficial treatment effect are published, while an equal mass of data pointing the other way remains unpublished. In this situation, a systematic review of the published trails could identify a spurious beneficial treatment effect, or miss an important adverse effect of a treatment. In the field of cancer chemotherapy such publication has been demonstrated by comparing the result from studies identified in a literature search with those contained in an international trials registry (see figure 1.2). (Simes RJ. 1986)Time lag biasPublished studies c ontinued to appear many years after approval by the ethic committee. Among proposals submitted to the Royal Prince Alfred Hospital Ethics Committee in Sydney, 85% of studies with significant results as compared to 65% of studies with null results had been published after 10 years (Stern JM, Simes RJ. 1997). The average time to publication was 4.8 years for studies with significant results comparing to 8.0 years for studies with null results. In fact, the time lag was attributable to differences in the time from completion to publication.(Eddger,M. Dickersin, K. Smith,G, S 2001)0.71.01.3Published 16 (1908)Registered 13 (2491)Survival ratio(95% confidence interval)Figure 1.2 (adapted from Simes)These findings indicate that time lag bias may be cut ind in systematic reviews even when most or all trails will eventually be published. Trails with positive results will dominate the literature and introduce bias for several years until the negative results finally appear.The influence of e xternal funding and commercial interestsMany systematic reviews are funded by organizations such as pharmaceutical companies. As in the design of randomized trials, the design of systematic reviews can be influenced (particularly through manipulation of inclusion and exclusion criteria) to select a particular set of studies. As a result, such systematic reviews may present a biased viewpoint. Careful assessment of the quality of the systematic review should reveal the flaws in their design. Another way in which bias can be introduced is through biased interpretation of the results of a systematic review funded by attention or authored by investigators who are influenced by industry.(Crowther, MA. Cook, DJ 2007)External funding was associated with publication independently of the statistical significance of the results. Funding by presidential term agencies was significantly associated with publication in three cohorts of proposals submitted to ethics committees whereas pharmaceuti cal industry sponsored studies were less probable to be published in two studies. Indeed, the pharmaceutical industry tends to discourage the publication of negative studies which it has funded. (Eddger,M. Dickersin, K. Smith,G, S 2001).Duplicate publication biasOnce a list of articles is obtained, they should be reviewed by two or more individuals and compared with a list of pre-developed inclusion and exclusion criteria The production of multiple publications from single studies can lead to bias in a number of ways. Two or more systematic reviews on the same topic may arrive at different conclusion, which raise concern about validity. Studies with significant results are more likely to lead to multiple publications, which makes it more likely that they will be located and included in a meta-analysis.Moher and Johansen and Gotzsche described the difficulties caused by redundancy and the disaggregation of medical research when results from multicentre trail are presented in several publications. It may be impossible for reviewers to determine whether two papers represent duplicate publications of one trail or two separate trails, since example exist where two articals reporting the same trail do not share a single harsh author. (Eddger,M. Dickersin, K. Smith,G, S 2001).Citation biasThe perusal of the reference lists of articles is used to identify additional articles that may be relevant. The problem with this approach is that the act of citing previous work is far from objective and retrieving literature by scanning references lists for many possible motivations such as decoration and showing up-to-dateness and knowledge may thus produce a biased sample of studies. (Eddger,M. Dickersin, K. Smith,G, S 2001)Language biasLanguage bias still evident in many reviews (Hearther, 2009). Reviewers are often exclusively based on trails published in English. For example, among 36 meta-analyses reported in leading English-language general medicine journals from 1991 to 1993, 26 had restricted their search to studies in English language. Reviewers in other countries will published their work in local journals as well as English language journal if their results are positive while negative results will just be published in local journals.This is demonstrated for the German language literature when comparing articles published by the same author, 63% of trails published in English had produced significant results as compared to 35% of trails published in German. Thus bias could be introduced in meta-analyses exclusively based on English-language reports.(Figure 1.3) (Eddger,M. Dickersin, K. Smith,G, S 2001)Figure 1.3 (adapted from Egger et al.)Outcome reporting biasReporting the outcome can be influenced by the results the outcome with the most easy findings will generally be reported. (Eddger,M. Dickersin, K. Smith,G, S 2001).The future of unbiased, systematic reviewingReporting biases is potentially serious problem for systematic review. While th e Cochrane collaborationism has a simple aim -help people to make well informed dicisions about healthcare-, there are many challenges that must be met to achieve this aim. honest and social challenges include finding ways to continue to build on enthusiasm while avoiding duplication and minimizing bias, to ensure sustainability and to accommodate diversity.Logistical challenges include finding ways to identify efficiently trails and manage criticisms and updates of reviews.Methodological challenges include developing sound guidelines for deciding what types of studies to include in reviews, effective ways of communicating the results of reviews and summarizing the strength of evidence for specific effects. (Eddger,M. Dickersin, K. Smith,G, S 2001).Conclusion and Summary pointsIn summary, There are numerous ways in which bias can be introduced in reviews and meta-analysis of controlled clinical trials. All these biases are more likely to affect small studies therefore, their result s need large treatment effect to be significant. On the other side, the large studies invest more money and time that means they are more likely to be high methodological quality and published even if their results are negative. Bias in a systematic review may become evident through an association between the size of the treatment effect and study size. Reliability and validity often not established within quality assessment instrument (Heather, 2009).If the methodological quality of trials is inadequate the findings of reviews of this materials may also be compromised. Publication bias can distort findings because trials with statically significant results are more likely to be published, and without delay, than trials without significant results. Among published trails, those with significant results are more likely to get published in English, more likely to be cited, and more likely to be published more than once which means that they will also be more likely to identified and i ncluded in reviews. The choice of the outcome that is reported can be influenced by the results. The outcome with the most favorable findings will generally be reported, which may introduced bias. Criteria for inclusion of studies into a review may be influenced by knowledge of the results of the set of potential studies. The definition of eligibility criteria for trails to be included, a comprehensive search for such tails, and an assessment of their methodological quality are central to systematic reviews. Systematic reviews are thus more likely to avoid bias than traditional, narrative reviews.(Eddger,M. Dickersin, K. Smith,G, S 2001)Nevertheless, the systematic review is a powerful research methodology which answers question on the the basis of good evidence and provides researchers with a valuable, impartial, comprehensive and up-to-date summary of the work conducted in a specific area.