학술논문

Practices for Managing Machine Learning Products: A Multivocal Literature Review
Document Type
Periodical
Source
IEEE Transactions on Engineering Management IEEE Trans. Eng. Manage. Engineering Management, IEEE Transactions on. 71:7425-7455 2024
Subject
Engineering Profession
Software
Data models
Standards organizations
Organizations
Bibliographies
Production
Solution design
Machine learning (ML)
management of scientists and engineers
multivocal literature review (MLR)
practices
product life cycle
software engineering
Language
ISSN
0018-9391
1558-0040
Abstract
Machine learning (ML) has grown in popularity in the software industry due to its ability to solve complex problems. Developing ML systems involves more uncertainty and risk because it requires identifying a business opportunity and managing source code, data, and trained models. Our research aims to identify the existing practices used in the industry for building ML applications and comprehending the organizational complexity of adopting ML systems. We conducted a multivocal literature review and then created a taxonomy of the practices applied to the ML system life cycle discussed among practitioners and researchers. The core of the study emerged from 41 selected posts from the grey literature and 37 selected scientific papers. Applying Initial Coding and Focused Coding techniques into these data, we mapped 91 practices into six core categories related to designing, developing, testing, and deploying ML systems. The results, including a taxonomy of practices, provide organizations with valuable insights to identify gaps in their current ML processes and practices and a roadmap for improving, optimizing, and managing ML systems.