|
 |
| REVIEW ARTICLE |
|
| Year : 2019 | Volume
: 24
| Issue : 6 | Page : 410-416 |
|
Assessing the quality of existing clinical practice guidelines for chemotherapy drug extravasation by appraisal of guidelines for research and evaluation II
Masoud Bahrami1, Tayebeh Karimi2, Ghasem Yadegarfar3, Ali Norouzi4
1 Cancer Prevention Research Center, Faculty of Nursing and Midwifery, Isfahan University of Medical Sciences, Isfahan, Iran
2 Student Research Committee, Department of Nursing, Faculty of Nursing and Midwifery, Isfahan University of Medical Sciences, Isfahan, Iran
3 Heart Failure Research Centre and Biostatistics, School of Public Health, Isfahan University of Medical Sciences, Isfahan, Iran
4 PhD Candidate in Medical Library and Information Sciences, Health Information Technology Research Center, School of Management and Medical Information Sciences, Isfahan University of Medical Sciences, Isfahan, Iran
| Date of Submission | 08-Apr-2019 |
| Date of Decision | 15-Jul-2019 |
| Date of Acceptance | 07-Aug-2019 |
| Date of Web Publication | 7-Nov-2019 |
Correspondence Address:
Ms. Tayebeh Karimi
Student Research Committee, Department of Nursing, Faculty of Nursing and Midwifery, Isfahan University of Medical Sciences, Isfahan
Iran
 Source of Support: None, Conflict of Interest: None  | Check |
DOI: 10.4103/ijnmr.IJNMR_80_19
Background: Extravasation is a potentially hazardous event that may occur during chemotherapy. The aim of this study is to assess the quality of existing Clinical Practice Guidelines (CPGs) for chemotherapy drug extravasation by Appraisal of Guidelines for Research and Evaluation II (AGREE II). Materials and Methods: Valid electronic databases and CPGs from 2007 to August 2018 were searched by keywords of CPGs, extravasation, chemotherapy, and cancer. CPGs were evaluated independently by five experts through AGREE II tool, and the consensus among evaluators was calculated by ICC (Intra-class Correlation Coefficient). Results: Five of the 111 CPGs matched the inclusion criteria. The methodological quality of CPGs in domains of “scope and purpose,“ “stakeholder involvement,“ “clarity of presentation,“ and “applicability“ were good, in the domain of “rigor of development,“ was acceptable, and in “editorial independence“ domain, it needed more attention of developers of CPGs. The range of assessors' consensus was within a range of moderate to very good (0.55--0.93). Conclusions: The methodological quality of existing CPGs of chemotherapy drugs extravasation assessed by AGREE II tool is appropriate. Four CPGs had high level while one had moderate level of quality. Therefore, their use is recommended in the clinic to reduce the risk of chemotherapy extravasation to the entire treatment team and the nurses working in the oncology departments.
Keywords: Appraisal of guidelines for research and evaluation II, drug therapy, extravasation of diagnostic and therapeutic materials, neoplasms, practice guideline
How to cite this article:
Bahrami M, Karimi T, Yadegarfar G, Norouzi A. Assessing the quality of existing clinical practice guidelines for chemotherapy drug extravasation by appraisal of guidelines for research and evaluation II. Iranian J Nursing Midwifery Res 2019;24:410-6 |
How to cite this URL:
Bahrami M, Karimi T, Yadegarfar G, Norouzi A. Assessing the quality of existing clinical practice guidelines for chemotherapy drug extravasation by appraisal of guidelines for research and evaluation II. Iranian J Nursing Midwifery Res [serial online] 2019 [cited 2023 Mar 23];24:410-6. Available from: https://www.ijnmrjournal.net/text.asp?2019/24/6/410/270572 |
| Introduction | |  |
Extravasation is a serious and important issue in chemotherapy, occurring in 1 to 7% of cases.[1] This complication may expose not only the patients but also the nurses and caregivers to its harmful effects.[2] As in the success of managing chemotherapy and preventing complications, especially extravasation, nurses' knowledge and competence play a vital role, they should have adequate knowledge in this regard and follow evidence-based recommendations and Clinical Practice Guidelines (CPGs).[3],[4],[5] Organizations, institutions, associations, and cancer groups have developed several CPGs in this regard. CPGs play an important role in clinical practice; they offer valuable recommendations, based on the highest level of evidence.[6] However, CPGs may vary widely in quality.[7] The quality of CPGs refers to being sure that the probable bias in the process of development of the guidelines is well prevented, the internal and external validity of the recommendations are provided, and recommendations are applicable in clinical setting.[8] Expanding the number, complexity, and heterogeneity of CPGs and the concerns about their quality have led to an increase in the need for development of internationally recognized criteria to ensure the quality of CPGs[9],[10] because it is important to evaluate the methods on which a guideline is developed in order to be confident of its recommendations.[7] To do this, different quality appraisal instruments have been developed for evaluating guidelines. Among these, Appraisal of Guidelines for Research and Evaluation II (AGREE II) is reported to be a reliable, internationally used and validated tool.[11]
The AGREE II instrument has been approved by several organizations including the World Health Organization.[12],[13],[14],[15] Comprehensive guidelines of high quality are expected to increase adherence among health workers, reduce individual decisions lacking evidence, and improve the provision of care.[16] So far, no study has been conducted to assess the quality of CPGs for chemotherapy drugs extravasation. However, studies have been conducted to evaluate the quality of CPGs in other sectors.[16],[17],[18],[19],[20],[21],[22],[23],[24],[25] Therefore, the aim of this study was to assess the quality of CPGs for chemotherapy drug extravasation by use of AGREE II to be applied in cancer patients' clinical setting to improve evidence-based decision-making and reduce the risk of extravasation among the patients and the treatment team.
| Materials and Methods | | |
We conducted a review of published CPGs for the management of cancer therapy-induced extravasation. Selection of CPGs was conducted through a systematic search on valid databases such as Scopus, PubMed, Proquest, Cochrane Library, MEDLINE, the web of science, and CPGs editorial bases including Guidelines International Network (GIN), National Institute for Clinical Excellence (NICE), The Cancer Care Ontario (CCO), the National Guidelines Clearinghouse (NGC), and the Scottish Intercollegiate Guidelines Network (SIGN) from 2007 to August 2018 (professional practice guidelines published during the last 10 years as up to date knowledge was considered necessary)[26],[27],[28],[29] by a combination of Mesh keywords including CPGs, extravasation, chemotherapy, and cancer. In this systematic search, the word OR was used to replace the keywords, and the word AND, to combine different keywords together [Table 1]. Inclusion criteria for CPGs covered all guidelines for chemotherapy extravasation, in English, developed by institutes, associations, and cancer groups, based on systematic and evidence-based review (quality of evidence was reviewed). The latest updated version of the guideline for assessment was also selected and for the guidelines, published in several forms, the one with the most details about the development methodology was selected. The CPGs whose access to their full text was impossible and other cases such as service packs, care plans, systematic reviews, patients' guides, and the books were excluded.
After systematic search, the repetitive titles of the searched CPGs were removed and guidelines titles, introductions, and full texts were reviewed by the research team while the inclusion-- exclusion criteria were also considered. In the meantime, the research team agreed on a re-negotiation in cases of controversy until reaching a consensus.
The quality of the existing CPGs for managing extravasation of chemotherapy drugs was independently and separately assessed by the experts through AGREE II. According to the recommendations in AGREE II manual, each guideline is assessed by at least two and preferably four appraisers, as increasing the number of appraisers will increase the reliability of the assessment.[8] Therefore, in this study, each guideline was appraised by five healthcare workers from different disciplines in order to improve the reliability of the assessment. The assessors consisted of three oncology specialists and two nursing staff with work experience in chemotherapy department.
AGREE II is a general tool with 23 items in six domains and has two overall checking items. [Table 2] shows a detailed description of all AGREE II items. Each item is scored on seven-point scale from one (strongly opposed) to seven (fully agree). The score of each of six sections is calculated independently and through the standardization of scores, obtained in each domain. In the final assessment section, the overall quality of the CPGs and the final recommendation of the assessors for the application of the guidance in the clinical setting are expressed.[11] The assessors' agreement among was calculated by ICC.[30] According to previous studies, the researchers calculated the overall quality of each CPG (by a threshold of 60%).[31],[32] Recommendations for using the CPGs in clinic were expressed as “I recommend, I recommend with modifications, and I do not recommend.“ The scores of the domains were categorized as good (80%), acceptable (60--79%), low (40--59%), and very low (40%>), according to previous similar articles.[19],[25] The reliability and validity of AGREE have been investigated in various studies. Terrace (2003), studied accreditation of AGREE, as an international assessment tool for assessing the quality of CPGs, and reported that to be 95% useful, claimed by of the assessors. In addition, the reliability of the parts of the tool was acceptable with a score of 88--64%.[31] In Iran, Rashidianet al. (2012) translated AGREE tool to Persian, whose validity was approved by Tehran University of Medical Sciences and the Ministry of Health and Medical Education joint group. In addition, comparison of the Persian and English versions reliability showed no significant difference.[33] | Table 2: Summary of Guidelines for Research and Evaluation II (AGREE II) structure and detailed list of items within each domain
Click here to view |
Ethical consideration
Review by a Human Ethics Review Committee was not required as this research involved only review of published work and did not involve any data collection from humans.
| Results | | |
After a systematic search, 111 CPGs, related to search keywords were found whose selection flowchart is shown in [Figure 1]. Selected CPGs were evidence based, in English, with number of references in the range between 10 and 18 references, and published between 2012 and 2017. All guidelines, in addition to extravasation management, also focused on prevention and education of signs and symptoms of extravasation to patients.[34],[35],[36],[37],[38] Only two CPGs provided the level of evidence-based recommendations.[35],[36] In the majority of CPGs, the conflict of interest was not expressed or was absent. Updated versions of three CPGs were not available,[34],[35],[36] one CPG would be updated in 2019,[37] and the other one in 2020.[38] Only one CPG provided the source of its funding.[38] Summary of CPGs details has been presented in [Table 3]. Five CPGs were assessed, criticized by five experts and analyzed by standardizing the scores, obtained in each domain, and the overall mean score for each domain was calculated. In addition, the scores of the domains of each separate CPGs, and the general level of quality of CPGs, as well as the final assessors' recommendation on application of the guideline in clinic setting are presented in [Table 4]. Four of the CPGs had a high level of quality, with a minimum score of their five domains higher than 60%. Among them was the CPG for the Management of Extravasation of Cytotoxic Drugs in Adults with the highest score (82.46%).[38] Comparison of the overall mean score in each domain showed that the domain of stakeholder involvement gained the highest score (92.89%) while the editorial independence domain had the lowest (54%). | Table 4: Summary of mean domain scores of Guidelines according to AGREE II
Click here to view |
The scores of CPGs showed that the CPG “Guideline for the management of extravasation of a cytotoxic agent, or a monoclonal antibody used in the treatment of malignant disease“ had the highest scores in terms of clarity of presentation and the rigor of development, while the lowest score was in the field of editorial independence.[36] The guideline for the Management of Extravasation CPG had the highest score in terms of applicability and the lowest scores in terms of scope and purpose and clarity of presentation.[35] The CPG for the Management of the Extravasation of Cytotoxic Drugs in Adults received the highest levels of success in the domains of scope and purpose, stakeholder involvement, and editorial independence.[38] “Guidelines for the Management of Extravasation of a Systemic Anti-Cancer Therapy including Cytotoxic Agents“ had a moderate overall quality in the domains of stakeholder involvement and rigor of development, while the domains of clarity of presentation and applicability obtained the lowest scores.[37] It should be noted that the lowest score in the domain of clarity of presentation (acceptable = 74.44%) was shared in two CPGs.[35],[37] The highest consensus among the assessors was in domain of stakeholder involvement (very good = 0.93) while the lowest was in editorial independence (moderate = 0.55).
| Discussion | | |
The findings of this study showed that assessment of existing CPGs for chemotherapy drugs extravasation by AGREE II tool is appropriate, and the overall quality of four CPGs out of five is high. However, the results, with regard to the scores within the domains, varied from good to very low. Meanwhile, the editorial independence domain had the maximum variability in all guidelines, which means that this domain is not well described in most of the assessed guidelines. Among the domains, the least attention was paid to editorial independence, while the only exception was the CPG for the Management of Extravasation of Cytotoxic Drugs in Adults,[38] which earned a score of 100% in this domain. This finding suggests that either CPGs developers may have not understood the importance of expressing conflicts of interest or they have not explicitly stated them. Evidence suggests that the conflict of interest of the guideline developers may affect the guideline recommendations.[39] Financial conflicts are also common in CPGs.[40],[41],[42] Therefore, in the development process of the guideline, financial information and conflict of interest should be reported and should not affect the development of the guidelines. The stakeholder involvement domain obtained the highest score. Its score was more than 90%. Such high scores are due to the detailed description of the relevant specialized groups, associated with the guideline editorial team, and the clear identification of the main users of the guideline. The development methodology is the main determinant of the quality of CPGs. However, the rigor of development obtained a reasonable overall mean score, and only two CPGs provided levels of evidence-based recommendations,[39],[40] and updated versions of three CPGs were not available.[38],[39],[40] These relatively lower scores are mainly due to inadequate description of the methodology of the development process of the CPGs, lack of external review and updating, lack or shortage of information on the systematic review method, the inclusion and exclusion criteria, and the quality of evidence. High-quality CPGs have systematic reviews and a valid international system for rating the quality of evidence and recommendations.[43],[44],[45]
A limitation of the present study is that we may have lost some of the CPGs and updates. The other limitation of this study was the assessment of English-only guidelines due to the lack of the research team members' other languages ability. The strength points of this study were the use of the AGREE II evaluation tool, which is highly reliable and valid, teaching the assessors how to use it, and assessing the guidelines by them all independently.
| Conclusion | | |
The application and implementation of CPGs depends on the staff's trust on their quality and credibility. Since nurses are responsible for prescribing drugs and play a major role in chemotherapy and due to the high quality of the current CPGs and chemotherapy drugs extravasation, their use is recommended in the clinic to prevent the serious side effects of chemotherapy drugs extravasation to the entire treatment team and the nurses working in the oncology departments.
Acknowledgements
This study is a part of a PhD nursing dissertation which has been approved by Isfahan University of Medical Sciences. We give special thanks for the funding to support this study by the vice-chancellor in research of the Medical University of Isfahan (code 395553).
Financial support and sponsorship
Isfahan University of Medical Sciences
Conflicts of interest
Nothing to declare.
| References | | |
| 1. | Pérez Fidalgo J, García Fabregat L, Cervantes A, Margulies A, Vidall C, Roila F; ESMO Guidelines Working Group. Management of chemotherapy extravasation: ESMO–EONS clinical practice guidelines. Annals of oncology 2012;23(Suppl 7):vii167-vii73.  |
| 2. | Mrayyan MT, Naga BS. Chemotherapy spill management policy: Policy analysis. Middle East J Nurs 2013;101:1-13. |
| 3. | O'grady NP, Alexander M, Burns LA, Dellinger EP, Garland J, Heard SO, et al. Guidelines for the prevention of intravascular catheter-related infections. Clin Infect Dis 2011;52:e162-e93. |
| 4. | Cicolini G, Simonetti V, Comparcini D, Labeau S, Blot S, Pelusi G, et al. Nurses' knowledge of evidence-based guidelines on the prevention of peripheral venous catheter-related infections: A multicentre survey. J Clin Nurs 2014;23:2578-88. |
| 5. | Azais H, Bresson L, Bassil A, Katdare N, Merlot B, Houpeau JL, et al. Chemotherapy drug extravasation in totally implantable venous access port systems: How effective is early surgical lavage? J Vasc Access 2015;16:31-7. |
| 6. | Sardanelli F, Bashir H, Berzaczy D, Cannella G, Espeland A, Flor N, et al. The role of imaging specialists as authors of systematic reviews on diagnostic and interventional imaging and its impact on scientific quality: Report from the EuroAIM Evidence-based Radiology Working Group. Radiology 2014;272:533-40. |
| 7. | Alonso-Coello P, Irfan A, Solà I, Gich I, Delgado-Noguera M, Rigau D, et al. The quality of clinical practice guidelines over the last two decades: A systematic review of guideline appraisal studies. Qual Saf Health Care 2010;19:e58. |
| 8. | Dans AL, Dans LF. Appraising a tool for guideline appraisal (the AGREE II instrument). J Clin Epidemiol 2010;63:1281-2. |
| 9. | Burgers JS, Fervers B, Haugh M, Brouwers M, Browman G, Philip T, et al. International assessment of the quality of clinical practice guidelines in oncology using the Appraisal of Guidelines and Research and Evaluation Instrument. J Clin Oncol 2004;22:2000-7. |
| 10. | Melnyk BM, Fineout-Overholt E. Evidence-Based Practice in Nursing & Healthcare: A Guide to Best Practice. 3 rd ed. Philadelphia: Wolters Kluwer; 2015. |
| 11. | Brouwers MC, Kho ME, Browman GP, Burgers JS, Cluzeau F, Feder G, et al. AGREE II: advancing guideline development, reporting and evaluation in health care. CMAJ 2010;182:E839-42. |
| 12. | Brouwers MC, Kho ME, Browman GP, Burgers JS, Cluzeau F, Feder G, et al. Development of the AGREE II, part 2: Assessment of validity of items and tools to support application. CMAJ 2010;182:E472-8. |
| 13. | Yang C, Zhang Z, Zhang L, Tian J, Yu D, Wang J, et al. Quality assessment of clinical practice guidelines on tic disorders with AGREE II instrument. Psychiatry Res 2018;259:385-91. |
| 14. | Gavriilidis P, Roberts KJ, Askari A, Sutcliffe RP, Huo TL, Liu PH, et al. Evaluation of the current guidelines for resection of hepatocellular carcinoma using the appraisal of guidelines for research and evaluation II instrument. J Hepatol 2017;67:991-8. |
| 15. | Zhang ZW, Liu XW, Xu BC, Wang SY, Li L, Kang YY, et al. Analysis of quality of clinical practice guidelines for otorhinolaryngology in China. PLoS One 2013;8:e53566. |
| 16. | Grammatikopoulou MG, Theodoridis X, Gkiouras K, Stamouli EM, Mavrantoni ME, Dardavessis T, et al. AGREEing on guidelines for nutrition management of adult severe burn patients. J Parenter Enteral Nutr 2019;43:490-6. |
| 17. | Radwan M, Akbari Sari A, Rashidian A, Takian A, Abou-Dagga S, Elsous A. Appraising the methodological quality of the clinical practice guideline for diabetes mellitus using the AGREE II instrument: A methodological evaluation. JRSM Open 2017;8:2054270416682673. |
| 18. | Gillespie BM, Bull C, Walker R, Lin F, Roberts S, Chaboyer W. Quality appraisal of clinical guidelines for surgical site infection prevention: A systematic review. PLoS One 2018;13:e0203354. |
| 19. | Messina C, Bignotti B, Bazzocchi A, Phan CM, Tagliafico A, Guglielmi G, et al. A critical appraisal of the quality of adult dual-energy X-ray absorptiometry guidelines in osteoporosis using the AGREE II tool: An EuroAIM initiative. Insights Imaging 2017;8:311-7. |
| 20. | Brasil RFG, Silva MJd, Moura ERF. Evaluation of the clinical protocol quality for family planning services of people living with HIV/AIDS. Rev Esc Enferm USP 2018;52:e03335. |
| 21. | Huang M, Zhou X. Appraisal of guidelines for androgenetic alopecia using the appraisal of guidelines for research and evaluation II instrument. J Eval Clin Pract 2015;21:1089-94. |
| 22. | Lucendo AJ, Arias Á, Redondo-González O, Molina-Infante J. Quality assessment of clinical practice guidelines for eosinophilic esophagitis using the AGREE II instrument. Expert Rev Gastroenterol Hepatol 2017;11:383-90. |
| 23. | Holmer HK, Ogden LA, Burda BU, Norris SL. Quality of clinical practice guidelines for glycemic control in type 2 diabetes mellitus. PLoS One 2013;8:e58625. |
| 24. | Tolunay O, Tolunay I, Yildizdaş RD, Celik T, Çelik Ü. Appraisal of the “pediatric ARDS: Consensus recommendations from the pediatric acute lung injury consensus conference“ with the AGREE II instrument. Turk J Med Sci 2018;48:84-8. |
| 25. | Sekercioglu N, Al-Khalifah R, Ewusie JE, Elias RM, Thabane L, Busse JW, et al. A critical appraisal of chronic kidney disease mineral and bone disorders clinical practice guidelines using the AGREE II instrument. Int Urol Nephrol 2017;49:273-84. |
| 26. | Malanchini G, Stefanini GG. Another reason to endorse and spread guidelines. Eur Heart J 2019;40:82-3. |
| 27. | Kyriakoulis K, Patelarou A, Laliotis A, Wan AC, Matalliotakis M, Tsiou C, et al. Educational strategies for teaching evidence-based practice to undergraduate health students: Systematic review. J Educ Eval Health Prof 2016;13:34. |
| 28. | Ruzafa-Martínez M, López-Iborra L, Barranco DA, Ramos-Morcillo AJ. Effectiveness of an evidence-based practice (EBP) course on the EBP competence of undergraduate nursing students: A quasi-experimental study. Nurse Educ Today 2016;38:82-7. |
| 29. | Dahm P, Yeung LL, Chang SS, Cookson MS. A critical review of clinical practice guidelines for the management of clinically localized prostate cancer. J Urol 2008;180:451-60. |
| 30. | Koo TK, Li MY. A guideline of selecting and reporting intraclass correlation coefficients for reliability research. J Chiropr Med 2016;15:155-63. |
| 31. | Terrace L. Development and validation of an international appraisal instrument for assessing the quality of clinical practice guidelines: The AGREE project. Qual Saf Health Care 2003;12:18-23. |
| 32. | Ou Y, Goldberg I, Migdal C, Lee PP. A critical appraisal and comparison of the quality and recommendations of glaucoma clinical practice guidelines. Ophthalmology 2011;118:1017-23. |
| 33. | Rashidian A, Yousefi-Nooraie R. Development of a Farsi translation of the AGREE instrument, and the effects of group discussion on improving the reliability of the scores. J Eval Clin Pract 2012;18:676-81. |
| 34. | |
| 35. | |
| 36. | Pan Birmingham Cancer Network Governance Committee. Guideline for the management of extravasation of a cytotoxic agent or a monoclonal antibody used in the treatment of malignant disease. Worcestershire Acute Hospitals NHS Trust 2015. Available from: file:///C:/Users/aria/Downloads/WAHT-HAE-014%20v4.2%20(1).pdf. |
| 37. | |
| 38. | |
| 39. | Norris SL, Burda BU, Holmer HK, Ogden LA, Fu R, Bero L, et al. Author's specialty and conflicts of interest contribute to conflicting guidelines for screening mammography. J Clin Epidemiol 2012;65:725-33. |
| 40. | Neuman J, Korenstein D, Ross JS, Keyhani S. Prevalence of financial conflicts of interest among panel members producing clinical practice guidelines in Canada and United States: Cross sectional study. BMJ 2011;343:d5621. |
| 41. | Norris SL, Holmer HK, Ogden LA, Selph SS, Fu R. Conflict of interest disclosures for clinical practice guidelines in the national guideline clearinghouse. PLoS One 2012;7:e47343. |
| 42. | Mendelson TB, Meltzer M, Campbell EG, Caplan AL, Kirkpatrick JN. Conflicts of Interest in Cardiovascular Clinical Practice Guidelines. JAMA Internal Medicine 2011;171:577-84. |
| 43. | Northern Ireland Cancer Network. Guidelines for the safe prescribing, handling and administration of Systemic Anti-Cancer Therapies (SACT). NICaN Pharmacy group 2016. Available from: file:///C:/Users/aria/Downloads/Guidelines-for-the-safe-prescribing-handling-administration-of-hazardous.pdf. |
| 44. | |
| 45. | Leung M, Bland R, Bladassarre F, Green E, Kaizer L, Hertz S, et al. Part 2: Administration of chemotherapy and management of preventable adverse events. Toronto (ON): Cancer Care Ontario; Program in Evidence-based Care Practice Guideline Report No.: 12-12-2; 2014. |
[Figure 1]
[Table 1], [Table 2], [Table 3], [Table 4]
|
Search Pubmed for