Machine Learning Infrastructure and Best Practices for Software Engineers

Although creating a machine learning pipeline or developing a working prototype of a software system from that pipeline is easy and straightforward nowadays, the journey toward a professional software system is still extensive. This book will help you get to grips with various best practices and recipes that will help software engineers transform prototype pipelines into complete software products.
The book begins by introducing the main concepts of professional software systems that leverage machine learning at their core. As you progress, you’ll explore the differences between traditional, non-ML software, and machine learning software. The initial best practices will guide you in determining the type of software you need for your product. Subsequently, you will delve into algorithms, covering their selection, development, and testing before exploring the intricacies of the infrastructure for machine learning systems by defining best practices for identifying the right data source and ensuring its quality.
Towards the end, you’ll address the most challenging aspect of large-scale machine learning systems – ethics. By exploring and defining best practices for assessing ethical risks and strategies for mitigation, you will conclude the book where it all began – large-scale machine learning software.

Type
ebook
Category
publication date
2024-01-31
what you will learn

Identify what the machine learning software best suits your needs
Work with scalable machine learning pipelines
Scale up pipelines from prototypes to fully fledged software
Choose suitable data sources and processing methods for your product
Differentiate raw data from complex processing, noting their advantages
Track and mitigate important ethical risks in machine learning software
Work with testing and validation for machine learning systems

no of pages
346
duration
692
key features
Learn how to scale-up your machine learning software to a professional level * Secure the quality of your machine learning pipeline at runtime * Apply your knowledge to natural languages, programming languages, and images
approach
In the book, we combine theoretical foundations of high-quality software systems with practical examples. We explore the established practices and complement them with the state-of-the-art practices from the newest research. Each best practice is based on several years of experience, combined with years of academic and industrial studies.
audience
If you’re a machine learning engineer, this book will help you design more robust software, and understand which scaling-up challenges you need to address and why. Software engineers will benefit from best practices that will make your products robust, reliable, and innovative. Decision makers will also find lots of useful information in this book, including guidance on what to look for in a well-designed machine learning software product.
meta description
Efficiently transform your initial designs into big systems by learning the foundations of infrastructure, algorithms, and ethical considerations for modern software products
short description
Machine learning is an important driver of innovation in software products. This book will help you take your machine learning prototype to the next level and scale it up using concepts such as data provisioning, processing, and quality control.
subtitle
Take your machine learning software from a prototype to a fully fledged software system
keywords
Machine learning, AI Ethics, software engineering, software development, feature engineering, python machine learning, machine learning algorithms
Product ISBN
9781837634064