Data Engineering Foundations
DATA SCIENCE × DATA ENGINEERING
See the data, the system and the decision together.
This hub orders lessons from data foundations through features and machine learning to production. You need not open every page—but should know where each lesson sits in the whole system.
DATA FOUNDATION · PATH 01
Begin with operational systems and data meaning
Understand transactions, shared data contracts, and why a logical view is a beginning rather than the final answer.
Build a stable, reusable and testable data interface.
Open lesson →Understand when mass UPDATE costs more than read–transform–new table.
Open lesson →Trace transactions, CDC and history into point-in-time features.
Open lesson →Compare PostgreSQL, DuckDB, ClickHouse, materialization and IVM.
Open lesson →PIPELINES & ANALYTICAL STORAGE · PATH 02
Make movement and repeated computation trustworthy
Move from orchestration to OLAP and feature storage while separating freshness, physical work and operating cost.
FEATURE ENGINEERING · PATH 03
A feature is costly, contextual evidence—not merely a formula
Study shared computation, representation and domain meaning before features reach a model.
Find shared structure and avoid repeated computation.
Open lesson →Select a customer, calculate RFM and read slopes as churn signals.
Open lesson →PCA, SVD, projections, embeddings and model-derived scores with leakage control.
Open lesson →Trace complexity from sequence scans to structure and embeddings.
Open lesson →Interpret trend, momentum, volatility, liquidity and risk carefully.
Open lesson →Compare data, formulas, compute time and meaning across twelve domains.
Open lesson →See what representation learning automates—and cannot recover.
Open lesson →SQL & MACHINE LEARNING · PATH 04
Begin with the formula, then choose the right abstraction
Build models from relational operations before moving to declarative interfaces, libraries and recommenders.
Derive kNN, Naive Bayes, regression, k-means and Z-score.
Open lesson →Open six ML families without Python.
Open lesson →Build candidates, similarity and ranking in SQL.
Open lesson →Separate SQL-native, SQL-callable and commercial platforms.
Open lesson →Use an in-database library after understanding what it hides.
Open lesson →PRODUCTION & ONLINE ML · PATH 05
Close the loop from features to prediction, drift and continuous learning
Separate online inference, online feature computation and true online learning while preserving evidence for delayed labels.
DOWNLOAD LECTURE MATERIALS
Four slide collections in sequence
The original PowerPoints preserve diagrams and lecture flow; the labs above provide hands-on practice.
Data Storage and Data Systems
การจัดเก็บข้อมูลและระบบข้อมูล
Moving and Processing Data at Scale
การเคลื่อนย้ายและประมวลผลข้อมูลขนาดใหญ่
Beyond Data Engineering
ต่อยอดจากวิศวกรรมข้อมูล
COURSE PRINCIPLE
Data science asks what data means. Data engineering makes the answer reproducible.
A strong model cannot repair mistimed data, leaky features or an unexplainable pipeline. The goal is not only prediction, but knowing which system produced the answer and how far it can be trusted.