Skip to content
VibeFormer

MODULE 06

Databases and Data Warehousing

Relational modelling, algebra, SQL, normalisation and indexing, then OLAP, dimensional schemas and the preprocessing pipeline.

23 lessons~11h reading

  1. 01

    The Entity–Relationship Model

    BeginnerComing soon

    Entities, attributes, relationships, cardinality and participation constraints, weak entities and ER diagrams.

    28 min
  2. 02

    The Relational Model and Keys

    BeginnerComing soon

    Relations, tuples, domains; super, candidate, primary, foreign and composite keys.

    Assumes: The Entity–Relationship Model

    24 min
  3. 03

    Relational Algebra

    IntermediateComing soon

    Selection, projection, union, difference, product, rename, and all the join variants, with worked evaluations.

    Assumes: The Relational Model and Keys

    32 min
  4. 04

    Tuple Relational Calculus

    AdvancedComing soon

    Declarative query specification with quantifiers, and its equivalence to relational algebra.

    Assumes: Relational Algebra

    26 min
  5. 05

    SQL Fundamentals

    BeginnerComing soon

    SELECT/FROM/WHERE, predicates, NULL semantics, ordering and set operations.

    Assumes: Relational Algebra

    30 min
  6. 06

    SQL Joins and Aggregation

    IntermediateComing soon

    Inner, outer, self and cross joins; GROUP BY, HAVING, and correlated subqueries.

    Assumes: SQL Fundamentals

    32 min
  7. 07

    SQL Window Functions

    AdvancedComing soon

    OVER/PARTITION BY, ranking, running totals, lag/lead, and analytics without self-joins.

    Assumes: SQL Joins and Aggregation

    28 min
  8. 08

    Integrity Constraints

    IntermediateComing soon

    Domain, entity and referential integrity, cascading actions, assertions and triggers.

    Assumes: The Relational Model and Keys

    22 min
  9. 09

    Functional Dependencies

    AdvancedComing soon

    FDs, Armstrong's axioms, attribute closure, canonical cover and candidate key computation.

    Assumes: The Relational Model and Keys

    30 min
  10. 10

    Normalisation and Normal Forms

    AdvancedComing soon

    1NF through BCNF and beyond, decomposition, lossless join and dependency preservation.

    Assumes: Functional Dependencies

    34 min
  11. 11

    File Organisation

    IntermediateComing soon

    Heap, sequential, hashed and clustered files, page layout, and record addressing.

    24 min
  12. 12

    Indexing: B+ Trees and Hash Indexes

    AdvancedComing soon

    Dense vs sparse, primary vs secondary, multilevel indexes, B+ tree operations and hash indexing.

    Assumes: File Organisation

    32 min
  13. 13

    Transactions and ACID

    IntermediateComing soon

    Atomicity, consistency, isolation, durability; schedules, serialisability and isolation levels.

    26 min
  14. 14

    OLTP vs OLAP

    BeginnerComing soon

    Transactional and analytical workloads contrasted on schema, access pattern, volume and latency.

    Assumes: SQL Joins and Aggregation

    20 min
  15. 15

    Data Warehouse Modelling

    IntermediateComing soon

    Warehouse architecture, ETL vs ELT, staging, facts, dimensions, grain and slowly changing dimensions.

    Assumes: OLTP vs OLAP

    30 min
  16. 16

    Multidimensional Schemas

    IntermediateComing soon

    Star, snowflake and fact-constellation schemas, with normalisation trade-offs and query implications.

    Assumes: Data Warehouse Modelling

    26 min
  17. 17

    Concept Hierarchies and Measures

    AdvancedComing soon

    Dimension hierarchies, and the distributive, algebraic and holistic measure classes with their computability.

    Assumes: Multidimensional Schemas

    26 min
  18. 18

    OLAP Operations and the Data Cube

    AdvancedComing soon

    Roll-up, drill-down, slice, dice and pivot; cube lattice, materialisation and cuboid selection.

    Assumes: Concept Hierarchies and Measures

    30 min
  19. 19

    Data Types and Data Cleaning

    BeginnerComing soon

    Nominal, ordinal, interval and ratio scales; detecting and repairing dirty data.

    26 min
  20. 20

    Normalisation and Discretisation

    IntermediateComing soon

    Min–max, z-score and decimal scaling; equal-width, equal-frequency and entropy-based binning.

    Assumes: Data Types and Data Cleaning

    26 min
  21. 21

    Data Sampling and Compression

    IntermediateComing soon

    Reservoir and stratified sampling for large data; lossy vs lossless reduction and numerosity reduction.

    Assumes: Normalisation and Discretisation

    24 min
  22. 22

    Missing Values and Outliers

    IntermediateComing soon

    MCAR/MAR/MNAR mechanisms, imputation strategies, and statistical outlier detection.

    Assumes: Data Types and Data Cleaning

    28 min
  23. 23

    Encoding Categorical Features

    IntermediateComing soon

    One-hot, ordinal, target, frequency and hashing encoders, and the leakage risks of each.

    Assumes: Normalisation and Discretisation

    26 min