EXPLORING THE BENEFITS, CHALLENGES AND GUIDELINES OF DEVOPS ADOPTION: A SYSTEMATIC LITERATURE REVIEW AND AN EMPIRICAL STUDY
DOI:
https://doi.org/10.46754/jmsi.2024.10.007Keywords:
DevOps, Systematic literature review, Interview, DevOps adoption, DevOps benefits and challengesAbstract
This study aims to explore the benefits and challenges of DevOps adoption in the rapidly evolving landscape of DevOps and Information Technology (IT) firms. DevOps is a software development approach that emphasises communication and collaboration between software developers and IT operations teams, aiming to streamline processes and enhance software delivery. Despite the growing popularity of DevOps, there are several challenges to its adoption, including stakeholder confusion, a lack of clear processes and guidelines, and a lack of empirical studies that discuss the challenges of DevOps. To establish a foundation of understanding and provide insights into the benefits, challenges, and guidelines for DevOps adoption, this study uses a two-fold approach, including a systematic literature review and conducts semi-structured interviews involving six organisations of various sizes. The interviews aimed to obtain evidence of DevOps adoption in practice and to detail real scenarios and explain the role of each category during DevOps adoption. The study provides insights into the challenges faced by software organisations in adopting the DevOps culture and the benefits of DevOps adoption. The study also proposes DevOps adoption guidelines based on the findings. The findings contribute to the existing literature on DevOps adoption and provide valuable recommendations for software organisations.
References
Azad, N., & Hyrynsalmi, S. (2023). DevOps critical success factors — A systematic literature review. Information and Software Technology, 157, 107150. https://doi.org/10.1016/j.infsof.2023.107150
Lwakatare, L. E., Kilamo, T., Karvonen, T., Sauvola, T., Heikkilä, V., Itkonen, J., Kuvaja, P., Mikkonen, T., Oivo, M., & Lassenius, C. (2019). DevOps in practice: A multiple case study of five companies. Information and Software Technology, 114, 217–230. https://doi.org/10.1016/j.infsof.2019.06.010
Karamitsos, I., Albarhami, S., & Apostolopoulos, C. (2020). Applying DevOps practices of continuous automation for machine learning. Information, 11(7), 363. https://doi.org/10.3390/info11070363
Van Belzen, M., Trienekens, J., & Kusters, R. (2019). Critical success factors of continuous practices in a DevOps context. 28th International Conference on Information Systems Development (ISD2019 Toulon, France).
Grande, R., Vizcaíno, A., & García, F. O. (2023). Is it worth adopting DevOps practices in Global Software Engineering? Possible challenges and benefits. Computer Standards & Interfaces, 87, 103767. https://doi.org/10.1016/j.csi.2023.103767
Almashhadani, M., Mishra, A., Yazici, A., & Younas, M. (2023). Challenges in agile software maintenance for local and global development: An empirical assessment. Information, 14(5), 261. https://doi.org/10.3390/info14050261
Cusumano, M. A., & Selby, R. W. (1998). Microsoft secrets: how the world’s most powerful software company creates technology, shapes markets, and manages people. Free Press.
Fawzy, A. H., Wassif, K., & Moussa, H. (2023). Framework for automatic detection of anomalies in DevOps. Journal of King Saud University - Computer and Information Sciences, 35(3), 8-19. https://doi.org/10.1016/j.jksuci.2023.02.010
Zarour, M., Alhammad, N., Alenezi, M., & Alsarayrah, K. (2020). DEVOPS PROCESS MODEL ADOPTION IN SAUDI ARABIA: AN EMPIRICAL STUDY. Jordanian Journal of Computers and Information Technology, 0, 1. https://doi.org/10.5455/jjcit.71-1580581874
Riungu-Kalliosaari, L., Mäkinen, S., Lwakatare, L. E., Tiihonen, J., & Männistö, T. (2016). DevOps adoption benefits and challenges in practice: A case study. in Product-Focused Software Process Improvement: 17th International Conference, PROFES 2016, Trondheim, Norway, November 22-24 (pp. 590–597).
Roy, R., Stark, R., Tracht, K., Takata, S., & Mori, M. (2016). Continuous maintenance and the future – Foundations and technological challenges. CIRP Annals, 65(2), 667-688. https://doi.org/10.1016/j.cirp.2016.06.006
Laukkanen, E., Itkonen, J., & Lassenius, C. (2016). Problems, causes and solutions when adopting continuous delivery—A systematic literature review. Information and Software Technology, 82, 55-79. https://doi.org/10.1016/j.infsof.2016.10.001
Brereton, P., Kitchenham, B. A., Budgen, D., Turner, M., & Khalil, M. (2006). Lessons from applying the systematic literature review process within the software engineering domain. Journal of Systems and Software, 80(4), 571-583. https://doi.org/10.1016/j.jss.2006.07.009
Díaz, J., López-Fernández, D., Pérez, J., & González-Prieto, Á. (2021). Why are many businesses instilling a DevOps culture into their organization? Empirical Software Engineering, 26(2), Article 25. https://doi.org/10.1007/s10664-020-09919-3
Mandepudi, S. (2019). Communication Challenges in DevOps & Mitigation Strategies [Master Thesis, Blekinge Institute of Technology]. https://www.diva-portal.org/smash/get/diva2:1368400/FULLTEXT02
Harding, T. S., & Whitehead, D. (2013). Analysing data in qualitative research. In Nursing & midwifery research: Methods and appraisal for evidence-based practice (4th ed., pp. 141-160). Elsevier Mosby.
Quick, J., & Hall, S. (2015). Part two: Qualitative research. Journal of Perioperative Practice, 25(7-8), 129-133. https://doi.org/10.1177/1750458915025007-803
Brandão, C. (2014b). Book review: Qualitative data analysis with NVivo (2nd ed.). Qualitative Research in Psychology, 12(4), 492-494. https://doi.org/10.1080/14780887.2014.992750+
Guerrero, J., Certuche, C., Zúñiga, K., & Pardo, C. (2020). Trends in devops: A systematic mapping of the literature [Tendencias en devops: Un mapeo sistemático de la literatura],” RISTI - Revista Iberica de Sistemas e Tecnologias de Informacao, vol. 2020, no. E32, 2020
Badshah, S., Khan, A. A., & Khan, B. (2020). Towards process improvement in DevOps: A systematic literature review. ACM International Conference Proceeding Series, pp. 427-433, 2020, https://doi.org/10.1145/3383219.3383280
Lucy Ellen, L. (2017). DevOps adoption and implementation in software development practice: concept, practices, benefits and challenges.. OuluREPO. https://urn.fi/URN:ISBN:9789526217116
Muñoz, M., Negrete, M., & Mejía, J. (2019). Proposal to avoid Issues in the DevOps Implementation: A systematic literature review. In Advances in intelligent systems and computing (pp. 666-677). https://doi.org/10.1007/978-3-030-16181-1_63
Albuquerque, A. B., & Cruz, V. L. (2018). Implementing DevOps in legacy systems. In Advances in intelligent systems and computing (pp. 143-161). https://doi.org/10.1007/978-3-030-00184-1_14
Morales, J. A., Yasar, H., & Volkman, A. (2018). Implementing DevOps practices in highly regulated environments. ACM International Conference Proceeding Series, vol. Part F1477, pp. 1-9, 2018, https://doi.org/10.1145/3234152.3234188
Wiedemann, A., Wiesche, M., Gewald, H., & Krcmar, H. (2019). Implementing the Planning Process within DevOps Teams to Achieve Continuous Innovation. In Proceedings of the Annual Hawaii International Conference on System Sciences. https://doi.org/10.24251/
hicss.2019.841
Daneva, M., & Bolscher, R. (2020). What we know about software architecture styles in continuous delivery and DevOps? In Communications in computer and information science (pp. 26-39). https://doi.org/10.1007/978-3-030-52991-8_2
Katal, A., Bajoria, V., & Dahiya, S. (2019). DevOps: Bridging the gap between development and operations. In Proceedings of the 3rd International Conference on Computing Methodologies and Communication, ICCMC 2019, pp. 1-7. https://doi.org/10.1109/
iccmc.2019.8819631
Cois, C. A., Yankel, J., & Connell, A. (2014). Modern DevOps: Optimizing software development through effective system interactions. IEEE International Professional Communication Conference, vol. 2015-Janua, pp. 1-7. https://doi.org/10.1109/ipcc.2014.7020388
Bolscher, R., & Daneva, M. (2019). Designing software architecture to support continuous delivery and DevOps: A systematic literature review. ICSOFT 2019 - Proceedings of the 14th International Conference on Software Technologies. https://doi.org/10.5220/0007837000270039
Bang, S. K., Chung, S., Choh, Y., & Dupuis, M. (2013). A grounded theory analysis of modern web applications: Knowledge, skills, and abilities for DevOps. In RIIT 2013 - Proceedings of the 2nd Annual Conference on Research in Information Technology, 2013, pp. 61-62. https://doi.org/10.1145/2512209.2512229
Artac, M., Borovssak, T., Di Nitto, E., Guerriero, M., & Tamburri, D. A. (2017). DevOps: Introducing infrastructure-as-code. Proceedings - 2017 IEEE/ACM 39th International Conference on Software Engineering Companion, ICSE-C 2017, pp. 497-498. https://doi.org/10.1109/icse-c.2017.162
Perez, J. E., Gonzalez-Prieto, A., Diaz, J., Lopez-Fernandez, D., Garcia-Martin, J., & Yague, A. (2021). DevOps Research-Based teaching using qualitative research and Inter-Coder Agreement. IEEE Transactions on Software Engineering, 48(9), 3378-3393. https://doi.org/10.1109/tse.2021.3092705
Cuppett, M. S. (2016). Automation and code control. In DevOps, DBAs, and DBaaS, Berkeley, CA: Apress (pp. 107-121). https://doi.org/10.1007/978-1-4842-2208-9_8
Mishra, A., & Otaiwi, Z. (2020). DevOps and software quality: A systematic mapping. Computer Science Review, 38, 100308. https://doi.org/10.1016/j.cosrev.2020.100308
De Bayser, M., Azevedo, L. G., & Cerqueira, R. (2015). ResearchOps: The case for DevOps in scientific applications. In Proceedings of the 2015 IFIP/IEEE International Symposium on Integrated Network Management, IM 2015. https://doi.org/10.1109/inm.2015.7140503
Laukkarinen, T., Kuusinen, K., & Mikkonen, T. (2017). DevOps in regulated software development: Case medical devices. Proceedings - 2017 IEEE/ACM 39th International Conference on Software Engineering: New Ideas and Emerging Results Track, ICSE-NIER 2017. https://doi.org/10.1109/icse-nier.2017.20
Senapathi, M., Buchan, J., & Osman, H. (2018). DevOps capabilities, practices, and challenges: Insights from a case study. ACM International Conference Proceeding Series, vol. Part F1377, pp. 57-67. https://doi.org/10.1145/3210459.3210465
Riungu-Kalliosaari, L., Mäkinen, S., Lwakatare, L. E., Tiihonen, J., & Männistö, T. (2016). DevOps adoption benefits and challenges in practice: A case study. In Lecture notes in computer science (pp. 590-597). https://doi.org/10.1007/978-3-319-49094-6_44
Shahin, M., & Babar, M. A. (2020). On the role of software architecture in DevOps transformation: An industrial case study. Proceedings - 2020 IEEE/ACM International Conference on Software and System Processes, ICSSP 2020, vol. 10, pp. 175-184. https://
doi.org/10.1145/3379177.3388891
Ghantous, G. B., & Gill, A. (2017). DevOps: Concepts, practices, tools, benefits and challenges. Proceedings of the 21st Pacific Asia Conference on Information Systems: “‘Societal Transformation Through IS/IT’”, PACIS 2017, pp. 96. http://aisel.aisnet.org/pacis2017/96
Gottesheim, W. (2015). Challenges, benefits and best practices of performance focused DevOps. LT 2015 - Proceedings of the 4th ACM/SPEC International Workshop on Large-Scale Testing, in Conjunction with ICPE 2015, pp. 3. https://doi.org/10.1145/2693182.2693187
Leite, L., Rocha, C., Kon, F., Milojicic, D., & Meirelles, P. (2019). A survey of DevOps Concepts and challenges. ACM Computing Surveys, 52(6), 1-35. https://doi.org/10.1145/3359981
Jones, S., Noppen, J., & Lettice, F. (2016). Management challenges for devops adoption within UK SMEs. In QUDOS 2016 - Proceedings of the 2nd International Workshop on Quality-Aware DevOps, co-located with ISSTA 2016, 2016, pp. 7-11. https://doi.org/10.1145/2945408.2945410
Trigo, A., Varajão, J., & Sousa, L. (2022). DevOps adoption: Insights from a large European Telco. Cogent Engineering, 9(1), Article 2083474. https://doi.org/10.1080/23311916.2022.2083474
Maroukian, K., & Gulliver, S. R. (2020). Leading DevOps Practice and Principle Adoption. 9th International Conference on Information Technology Convergence and Services (ITCSE 2020), May 30-31, 2020, Vancouver, Canada. https://doi.org/10.5121/csit.2020.100504
Maroukian, K., & Gulliver, S. R. (2020b). Exploring the link between leadership and DEVOPs practice and principle adoption. Advanced Computing an International Journal, 11(4), 1-18. https://doi.org/10.5121/acij.2020.11401
Downloads
Published
Issue
Section
License
Copyright (c) 2024 Journal of Mathematical Sciences and Informatics
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
