Data Engineering Foundations
DATA SCIENCE × DATA ENGINEERING
See the data, the system and the decision together.
This hub orders lessons from data foundations through features and machine learning to production. You need not open every page—but should know where each lesson sits in the whole system.
DATA FOUNDATION · PATH 01
Begin with operational systems and data meaning
Understand transactions, shared data contracts, and why a logical view is a beginning rather than the final answer.
Build a stable, reusable and testable data interface.
Open lesson →Understand when mass UPDATE costs more than read–transform–new table.
Open lesson →Trace transactions, CDC and history into point-in-time features.
Open lesson →Compare PostgreSQL, DuckDB, ClickHouse, materialization and IVM.
Open lesson →PIPELINES & ANALYTICAL STORAGE · PATH 02
Make movement and repeated computation trustworthy
Move from orchestration to OLAP and feature storage while separating freshness, physical work and operating cost.
Run DAGs while inspecting dependencies, retries, schedules and TaskFlow.
Open lesson →Experiment with selectors, schema drift, missing data, duplicate keys and HTTP 429 in a safe simulated site.
Open lesson →Compute from history and materialize only valuable reusable state.
Open lesson →Version features and control point-in-time correctness and serving parity.
Open lesson →FEATURE ENGINEERING · PATH 03
A feature is costly, contextual evidence—not merely a formula
Study shared computation, representation and domain meaning before features reach a model.
Find shared structure and avoid repeated computation.
Open lesson →Select a customer, calculate RFM and read slopes as churn signals.
Open lesson →PCA, SVD, projections, embeddings and model-derived scores with leakage control.
Open lesson →Trace complexity from sequence scans to structure and embeddings.
Open lesson →Interpret trend, momentum, volatility, liquidity and risk carefully.
Open lesson →Compare data, formulas, compute time and meaning across twelve domains.
Open lesson →See what representation learning automates—and cannot recover.
Open lesson →SQL & MACHINE LEARNING · PATH 04
Begin with the formula, then choose the right abstraction
Build models from relational operations before moving to declarative interfaces, libraries and recommenders.
Derive kNN, Naive Bayes, regression, k-means and Z-score.
Open lesson →Open six ML families without Python.
Open lesson →Build candidates, similarity and ranking in SQL.
Open lesson →Separate SQL-native, SQL-callable and commercial platforms.
Open lesson →Use an in-database library after understanding what it hides.
Open lesson →PRODUCTION & ONLINE ML · PATH 05
Close the loop from features to prediction, drift and continuous learning
Separate online inference, online feature computation and true online learning while preserving evidence for delayed labels.
Understand three production meanings of online.
Open lesson →Compare embedded and server OLAP execution boundaries.
Open lesson →Simulate monthly electricity data, inspect feature drift, compare algorithms and training windows, then decide whether to retain or replace the Champion.
Open lesson →Continue to cross-course labs in algorithms, bioinformatics and teaching design.
Open lesson →DOWNLOAD LECTURE MATERIALS
Five slide collections and hands-on files
The PowerPoints preserve diagrams and lecture flow; the notebooks and labs provide hands-on practice.
Data Storage and Data Systems
การจัดเก็บข้อมูลและระบบข้อมูล
XPath, BeautifulSoup and Selenium
Screen Scraping ตั้งแต่ Selector ถึง PostgreSQL
Scraping Notebooks and Data
Notebook และข้อมูลสำหรับฝึก Scraping
Moving and Processing Data at Scale
การเคลื่อนย้ายและประมวลผลข้อมูลขนาดใหญ่
Beyond Data Engineering
ต่อยอดจากวิศวกรรมข้อมูล
COURSE PRINCIPLE
Data science asks what data means. Data engineering makes the answer reproducible.
A strong model cannot repair mistimed data, leaky features or an unexplainable pipeline. The goal is not only prediction, but knowing which system produced the answer and how far it can be trusted.