MODULE 06
Databases and Data Warehousing
Relational modelling, algebra, SQL, normalisation and indexing, then OLAP, dimensional schemas and the preprocessing pipeline.
23 lessons~11h reading
- 0128 min
The Entity–Relationship Model
BeginnerComing soonEntities, attributes, relationships, cardinality and participation constraints, weak entities and ER diagrams.
- 0224 min
The Relational Model and Keys
BeginnerComing soonRelations, tuples, domains; super, candidate, primary, foreign and composite keys.
Assumes: The Entity–Relationship Model
- 0332 min
Relational Algebra
IntermediateComing soonSelection, projection, union, difference, product, rename, and all the join variants, with worked evaluations.
Assumes: The Relational Model and Keys
- 0426 min
Tuple Relational Calculus
AdvancedComing soonDeclarative query specification with quantifiers, and its equivalence to relational algebra.
Assumes: Relational Algebra
- 0530 min
SQL Fundamentals
BeginnerComing soonSELECT/FROM/WHERE, predicates, NULL semantics, ordering and set operations.
Assumes: Relational Algebra
- 0632 min
SQL Joins and Aggregation
IntermediateComing soonInner, outer, self and cross joins; GROUP BY, HAVING, and correlated subqueries.
Assumes: SQL Fundamentals
- 0728 min
SQL Window Functions
AdvancedComing soonOVER/PARTITION BY, ranking, running totals, lag/lead, and analytics without self-joins.
Assumes: SQL Joins and Aggregation
- 0822 min
Integrity Constraints
IntermediateComing soonDomain, entity and referential integrity, cascading actions, assertions and triggers.
Assumes: The Relational Model and Keys
- 0930 min
Functional Dependencies
AdvancedComing soonFDs, Armstrong's axioms, attribute closure, canonical cover and candidate key computation.
Assumes: The Relational Model and Keys
- 1034 min
Normalisation and Normal Forms
AdvancedComing soon1NF through BCNF and beyond, decomposition, lossless join and dependency preservation.
Assumes: Functional Dependencies
- 1124 min
File Organisation
IntermediateComing soonHeap, sequential, hashed and clustered files, page layout, and record addressing.
- 1232 min
Indexing: B+ Trees and Hash Indexes
AdvancedComing soonDense vs sparse, primary vs secondary, multilevel indexes, B+ tree operations and hash indexing.
Assumes: File Organisation
- 1326 min
Transactions and ACID
IntermediateComing soonAtomicity, consistency, isolation, durability; schedules, serialisability and isolation levels.
- 1420 min
OLTP vs OLAP
BeginnerComing soonTransactional and analytical workloads contrasted on schema, access pattern, volume and latency.
Assumes: SQL Joins and Aggregation
- 1530 min
Data Warehouse Modelling
IntermediateComing soonWarehouse architecture, ETL vs ELT, staging, facts, dimensions, grain and slowly changing dimensions.
Assumes: OLTP vs OLAP
- 1626 min
Multidimensional Schemas
IntermediateComing soonStar, snowflake and fact-constellation schemas, with normalisation trade-offs and query implications.
Assumes: Data Warehouse Modelling
- 1726 min
Concept Hierarchies and Measures
AdvancedComing soonDimension hierarchies, and the distributive, algebraic and holistic measure classes with their computability.
Assumes: Multidimensional Schemas
- 1830 min
OLAP Operations and the Data Cube
AdvancedComing soonRoll-up, drill-down, slice, dice and pivot; cube lattice, materialisation and cuboid selection.
Assumes: Concept Hierarchies and Measures
- 1926 min
Data Types and Data Cleaning
BeginnerComing soonNominal, ordinal, interval and ratio scales; detecting and repairing dirty data.
- 2026 min
Normalisation and Discretisation
IntermediateComing soonMin–max, z-score and decimal scaling; equal-width, equal-frequency and entropy-based binning.
Assumes: Data Types and Data Cleaning
- 2124 min
Data Sampling and Compression
IntermediateComing soonReservoir and stratified sampling for large data; lossy vs lossless reduction and numerosity reduction.
Assumes: Normalisation and Discretisation
- 2228 min
Missing Values and Outliers
IntermediateComing soonMCAR/MAR/MNAR mechanisms, imputation strategies, and statistical outlier detection.
Assumes: Data Types and Data Cleaning
- 2326 min
Encoding Categorical Features
IntermediateComing soonOne-hot, ordinal, target, frequency and hashing encoders, and the leakage risks of each.
Assumes: Normalisation and Discretisation