From Deployment to Monitoring: Deeploy’s Comprehensive MLOps Lifecycle
6 Steps to Understand Deeploy’s Comprehensive MLOps Lifecycle
MLOps is a combination of data engineering, DevOps, and Machine Learning with the objective to automate the end-to-end process of developing, deploying, and managing machine learning models in production. Deeploy’s platform provides a best-of-breed solution for deploying and managing machine learning models, including deployment, serving, prediction and explanation, human feedback loop, model management, and model monitoring. With Deeploy, organizations can ensure compliance with regulations and policies while maintaining control over their predictions.
The Premises of MLOps
Machine Learning Operations (MLOps) is a field that brings together three important domains: Data Engineering, DevOps, and Machine Learning. MLOps automates the end-to-end process of developing, deploying, and managing Machine Learning models in production, making it more scalable, repeatable, and manageable. By combining these domains, MLOps creates a streamlined and automated process for organizations to leverage the power of Machine Learning and generate value for their business.
Deploying Machine Learning models brings them to life, adding value to your company. However, models should remain accurate, reliable, and explainable throughout the lifecycle. Therefore, Deeploy simplifies this process, allowing organizations to quickly bring their models to life and keep control of them.
With Deeploy, organizations enable interaction between humans and Machine Learning models. Additionally, Deeploy’s platform allows organizations to ensure compliance with regulations and policies, which is crucial for high-risk AI use cases.
How Deeploy fits into the MLOps process
Deeploy’s platform covers the deployment step and beyond, ensuring that your ML model predictions stay in control. The platform offers a best-of-breed solution rather than an end-to-end solution.
After developing and training your models in your own infrastructure, you can easily bring them into production in just a few clicks.
What are the supported model frameworks:
1. Model Deployment
Firstly, the deployment process is straightforward and intuitive, allowing organizations to deploy their models seamlessly. The platform offers a wide range of deployment options, including cloud or on-premises. Deeploy’s deployment process is fully customizable, allowing organizations to choose the deployment options that best fit their specific use case.
What are the requirements to deploy my ML models in minutes?
- Model code in the repository in our preferred format
- Access to the repository – public/private
- Knowing which commit to select
- Knowing which model type/framework are using
- An API endpoint/integration
Our default deployment flow uses KServe as a deployment backend. We also support deployments in AWS SageMaker.
2. Model Serving
Once the model is deployed, Deeploy provides an integrated model-serving experience, ensuring that the models are available to the end users without any downtime. The serving framework is based on KServe and runs on Kubernetes. This allows organizations to scale their models up or down based on their usage patterns and traffic volume. In addition, it even provides the option for serverless deployments which is ideal for batch prediction systems.
For advanced configuration, “CPU request”, “CPU limit”, “Memory request” and “Memory limit” can be configured. In addition, the model and explainer can be deployed serverless (Once deployed, serverless apps respond to demand and automatically scale up and down as needed). Especially, if model predictions do not need to be continuously explained, it can be helpful to deploy the explainer serverless to save resources.
3. Model Prediction and Explanations
Deeploy’s platform provides explainable AI models that help organizations understand how the models make their predictions. The platform offers several explainability techniques, including feature importance, SHAP, and LIME values, to help users understand the models’ behavior and make informed decisions. With our latest innovation, we provide Conversational XAI to make even better-informed decisions for every stakeholder within your organization.
What is the supported explainer framework?
- Anchor tabular
- Anchor images
- Anchor text
- SHAP kernel
- Partial Dependance Plot
- Conversational XAI
4. Human Feedback Loop
Deeploy’s platform allows organizations to incorporate human feedback into their Machine Learning models, ensuring that the models remain accurate and reliable over time. As a Data Scientist or Risk & Compliance officer, you can give feedback or evaluation, allowing organizations to continuously monitor your models’ performance and use the provided feedback for model training.
Where is the feedback stored?
The feedback on predictions is visible within Deeploy and in parallel stored in an SQL database that can be accessed and used by the Data Scientist. Within that database feedback can be labeled. For now, feedback is not automatically labeled as it is collected via a free text field.
5. Model Management
Deeploy’s model management capabilities automatically log and trace every model change and prediction, making it easy for users to manage and monitor the models’ performance.
6. Model Monitoring
Finally, Deeploy’s model monitoring capabilities allow organizations to monitor their models’ performance in real-time. The platform provides several monitoring metrics allowing users to identify any issues and take corrective actions quickly.
What are our monitoring features?
- Drift (coming soon)
Streamline Your ML Lifecycle and Ensure AI Governance
In conclusion, Deeploy offers a comprehensive MLOps platform that covers the in-production aspects of the machine learning lifecycle. This enables organizations to responsibly deploy and monitor their high-risk AI use cases. Furthermore, Deeploy provides opportunities to implement Explainable Machine Learning models and enables interaction between AI and humans in the loop.
As a Data Science and/or Risk and Compliance expert, interact with AI using Deeploy, to streamline your ML lifecycle while ensuring compliance with your AI governance.
Please fill in your e-mail and we update you when we have new content!
How a Conversational Explainer Makes AI More Responsible
The implementation of AI in critical decision-making processes is rapidly increasing. Explaining mod…
SageMaker & Deeploy: A non-technical introduction
SageMaker & Deeploy: A non-technical introduction SageMaker & Deeploy: A non-technical intro…