Get in Touch
 Duration 21 hours

Course Outline

Overview of Huawei CloudMatrix

  • The CloudMatrix ecosystem and deployment workflows
  • Compatible models, formats, and deployment methods
  • Common use cases and supported chipsets

Model Preparation for Deployment

  • Exporting models from training tools (MindSpore, TensorFlow, PyTorch)
  • Utilizing ATC (Ascend Tensor Compiler) for format conversion
  • Handling static versus dynamic shape models

Deployment on CloudMatrix

  • Creating services and registering models
  • Implementing inference services via UI or CLI
  • Managing routing, authentication, and access control

Handling Inference Requests

  • Differences between batch and real-time inference flows
  • Data preprocessing and postprocessing pipelines
  • Invoking CloudMatrix services from external applications

Monitoring and Performance Optimization

  • Reviewing deployment logs and tracking requests
  • Managing resource scaling and load balancing
  • Adjusting latency and optimizing throughput

Enterprise Tool Integration

  • Linking CloudMatrix with OBS and ModelArts
  • Implementing workflows and model versioning
  • CI/CD practices for model deployment and rollback

Complete Inference Pipeline

  • Deploying a full image classification pipeline
  • Benchmarking and verifying accuracy
  • Simulating failover scenarios and system alerts

Recap and Future Steps

Requirements

  • A solid grasp of AI model training workflows
  • Experience working with Python-based ML frameworks
  • Foundational knowledge of cloud deployment principles

Target Audience

  • AI ops teams
  • Machine learning engineers
  • Cloud deployment specialists utilizing Huawei infrastructure

Number of participants


Price per participant (excl. VAT)

Testimonials (2)

Upcoming Courses

Related Categories