Automate task with Python | JT's School

Autoplay
Autocomplete

Previous Lesson Complete and Continue

JRM Data Engineer (2025)

ETL with Python

Data extraction from APIs (130:36)
Web scraping (150:53)
SQL Transformation (128:47)
Python ETL Essentials (128:59)
Data pipeline design patterns (126:08)
Data integration with dlt (108:40)

Production Environment

Git & Github (114:30)
Containerization with Docker (78:47)

Snowflake

Introduction to Snowflake and Data Warehousing Basics (120:21)
Loading Data into Snowflake (116:58)
Unloading Data and File Formats (107:48)
Snowflake SQL Basics (111:48)
Advanced SQL and Data Transformation (117:36)
Query Optimization and Resource Monitoring (109:19)
Automation with Tasks and Streams (104:31)
Final Real-World Project (142:16)

Workflow Orchestration (Airflow)

Airflow theory and Introduction (122:43)
Airflow practical session 1 (129:45)
Airflow practical session 2 (136:58)
Airflow practical session 3 (95:20)

Analytics Engineering

Data Warehousing concepts (136:37)
dbt practical session 1
dbt practical session 2
Orchestrate dbt pipeline

Hadoop

HDFS Theory
Hadoop Implementation
Build a Streaming data pipeline
Hadoop on Cloud

Spark

Spark Dataframes
Spark Column Manipulations
Filter, Drop, Sort
Dataframe aggregations and joining
Reading & Writing
SparkSQL

Kafka

Kafka Theory
Introduction to Kafka with Python
KSQL
Build a Streaming data pipeline

AWS

AWS Introduction & IAM (114:09)
Networking (127:05)
Storage (112:15)
Compute & Containers
Database
Serverless & Data Warehouse (112:58)
Data Streaming (103:17)
Analytics

Azure

Azure Data Factory: Introduction, Data Ingestion from Blob Storage, HTTP (134:14)
Azure Data Factory: Azure Data Flows (148:13)
Azure Data Factory: Databricks Activity, Loading to SQL (152:12)
Azure Databricks: Setup, Secrets, Mounts (134:55)
Azure Databricks: Ingestion, Transformation, Workflows (83:40)
Azure Databricks: Spark SQL (123:21)
Azure Databricks: Incremental Load (147:31)
Azure Databricks: Delta Lake (125:51)

Microsoft Fabric

Microsoft Fabric Introduction (109:20)
Data Warehousing & Power BI - Part 1 (131:05)
Data Warehousing & Power BI - Part 2
Data Factory
Multi Experience DA/BI Engineering Project
Data Engineering
Real Time Intelligence
Multi Experience Data Engineering Project

AI/ML

Statistics and Probability
Predictive Models, Machine Learning Algorithms (Part 1)
Machine Learning Algorithms (Part 2), Recommender Systems
ML in the real world, Deep Learning and Neural Networks (Part 1)
Deep Learning and Neural Networks (Part 2)
Generative AI, The OpenAI API
RAG and LLM Agents
Final Project

Payroll Project

Introduction to Data Engineer Payroll Project
Project Preparation
Generate Data
Combine Data & Deploy Data
ETL Practice & Analyze Data
Dashboard & Report

SQL - 2024

Introduce SQL Server (145:25)
SQL Query Statements (141:24)
Debug, Join & Sub-query in SQL (128:08)
Case-When, Window Function & SQL practice (123:51)
Pivot Table, UDF and Stored Procedure in SQL (132:55)
Basic Optimization SQL Server (127:07)
Practice SQL Test Platform (135:09)
SQL Graph Basic (122:10)

Python - 2024

Introduce to Python & Basic syntax (102:51)
Read files & Algorithms (131:04)
Basic Data Analysts with Python (113:14)
Intermediate Data Analysis with Python (153:20)
Automate task with Python (122:32)
PySpark & JSON (84:23)
Practice Python Test Platform (114:22)
APIs and Demo Project Data Analysis with Python (120:55)

Teach online with

Automate task with Python

Lesson content locked

If you're already enrolled, you'll need to login.

Enroll in Course to Unlock