Course Outline
Introduction to the Stratio Platform
- Architectural overview of Stratio and its core modules.
- The strategic role of Rocket and Intelligence in the data lifecycle.
- Accessing and navigating the Stratio user interface.
Utilizing the Rocket Module
- Initiating data ingestion and establishing pipelines.
- Establishing data source connections and setting up transformations.
- Employing PySpark for preprocessing tasks within Rocket.
PySpark Fundamentals for Stratio Users
- Core PySpark data structures and common operations.
- Implementing looping constructs: for, while, and if/else statements.
- Defining and executing custom functions using the def keyword.
Advanced Rocket Integration with PySpark
- Managing streaming ingestion and real-time transformations.
- Applying loops and functions across batch and real-time processing scenarios.
- Adopting best practices to optimize PySpark pipeline performance.
Exploring the Intelligence Module
- Overview of data modeling and analytical capabilities.
- Techniques for feature selection, transformation, and exploration.
- Leveraging PySpark for custom analytics and insight generation.
Constructing Advanced Analytics Workflows
- Creating user-defined functions (UDFs) within the Intelligence module.
- Using conditionals and loops to govern complex data logic.
- Practical applications: segmentation, aggregation, and prediction models.
Deployment and Team Collaboration
- Strategies for saving, exporting, and reusing workflows.
- Collaborative practices with team members on the Stratio platform.
- Reviewing outputs and ensuring seamless integration with downstream tools.
Summary and Future Directions
Requirements
- Proficiency in Python programming.
- Familiarity with data analytics or big data processing principles.
- Fundamental understanding of Apache Spark and distributed computing.
Target Audience
- Data engineers operating within Stratio-based architectures.
- Analysts or developers utilizing the Rocket and Intelligence modules.
- Technical teams migrating to PySpark-centric workflows within Stratio.
Testimonials (3)
Learning that the QGIS and a tool that can used by other different professionals such land survey
Bame Duncan Koko - Bentel Technologies (Pty) Ltd
Course - QGIS for Geographic Information System
How to use open satellites data for real applications
Tshering Dorji - Druk Holding and Investments
Course - Advanced Geographic Information Systems (GIS)
Hands-on examples allowed us to get an actual feel for how the program works. Good explanations and integration of theoretical concepts and how they relate to practical applications.