Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Duration 21 hours
Course Outline
Overview of Huawei CloudMatrix
- The CloudMatrix ecosystem and deployment workflows
- Compatible models, formats, and deployment methods
- Common use cases and supported chipsets
Model Preparation for Deployment
- Exporting models from training tools (MindSpore, TensorFlow, PyTorch)
- Utilizing ATC (Ascend Tensor Compiler) for format conversion
- Handling static versus dynamic shape models
Deployment on CloudMatrix
- Creating services and registering models
- Implementing inference services via UI or CLI
- Managing routing, authentication, and access control
Handling Inference Requests
- Differences between batch and real-time inference flows
- Data preprocessing and postprocessing pipelines
- Invoking CloudMatrix services from external applications
Monitoring and Performance Optimization
- Reviewing deployment logs and tracking requests
- Managing resource scaling and load balancing
- Adjusting latency and optimizing throughput
Enterprise Tool Integration
- Linking CloudMatrix with OBS and ModelArts
- Implementing workflows and model versioning
- CI/CD practices for model deployment and rollback
Complete Inference Pipeline
- Deploying a full image classification pipeline
- Benchmarking and verifying accuracy
- Simulating failover scenarios and system alerts
Recap and Future Steps
Requirements
- A solid grasp of AI model training workflows
- Experience working with Python-based ML frameworks
- Foundational knowledge of cloud deployment principles
Target Audience
- AI ops teams
- Machine learning engineers
- Cloud deployment specialists utilizing Huawei infrastructure
Testimonials (2)
The extensive selection of tools presented
Miruna Buzduga - Aeronamic Eastern Europe
Course - AI Enablement Training for Engineers
Step by step training with a lot of exercises. It was like a workshop and I am very glad about that.