Course Outline
Introduction to the Stratio Platform
- An overview of Stratio’s architecture and its core modules.
- The specific roles of Rocket and Intelligence within the data lifecycle.
- Procedures for logging in and navigating the Stratio user interface.
Utilizing the Rocket Module
- Managing data ingestion and constructing data pipelines.
- Linking data sources and configuring transformation processes.
- Employing PySpark to handle preprocessing tasks within Rocket.
PySpark Fundamentals for Stratio Users
- Understanding PySpark data structures and core operations.
- Mastering looping constructs, including the use of for, while, and if/else statements.
- Authoring custom functions using the def keyword and applying them effectively.
Advanced Rocket Application with PySpark
- Handling streaming ingestion and real-time transformations.
- Integrating loops and functions across both batch and real-time scenarios.
- Adopting best practices to optimize performance in PySpark pipelines.
Deep Dive into the Intelligence Module
- An overview of data modeling and analytical features.
- Techniques for feature selection, transformation, and exploration.
- Leveraging PySpark for custom analytics and generating insights.
Constructing Advanced Analytics Workflows
- Creating user-defined functions (UDFs) specifically within the Intelligence module.
- Applying conditionals and loops to refine data logic.
- Practical use cases covering segmentation, aggregation, and prediction.
Deployment and Team Collaboration
- Strategies for saving, exporting, and reusing established workflows.
- Facilitating collaboration with team members on the Stratio platform.
- Reviewing outputs and integrating results with downstream tools.
Course Summary and Future Steps
Requirements
- Proficiency in Python programming
- A solid grasp of data analytics or big data processing concepts
- Fundamental knowledge of Apache Spark and distributed computing principles
Intended Audience
- Data engineers operating on Stratio-based platforms
- Analysts or developers utilizing the Rocket and Intelligence modules
- Technical teams in the process of transitioning to PySpark workflows within Stratio
Testimonials (3)
Learning that the QGIS and a tool that can used by other different professionals such land survey
Bame Duncan Koko - Bentel Technologies (Pty) Ltd
Course - QGIS for Geographic Information System
How to use open satellites data for real applications
Tshering Dorji - Druk Holding and Investments
Course - Advanced Geographic Information Systems (GIS)
Hands-on examples allowed us to get an actual feel for how the program works. Good explanations and integration of theoretical concepts and how they relate to practical applications.