Skip to content
VibeFormer

MODULE 19

Graph Machine Learning

Spectral graph theory, PageRank and node embeddings through to GCN, GraphSAGE, GAT and graph transformers.

26 lessons~12h reading

  1. 01

    Graph Theory Refresher

    BeginnerComing soon

    Vertices, edges, degree, paths, cycles, connectivity, bipartite and directed graphs, trees and DAGs.

    Assumes: Graph Representations

    26 min
  2. 02

    Representing Graphs for Learning

    BeginnerComing soon

    Adjacency, degree and incidence matrices, edge indices, node and edge features, and sparse formats.

    Assumes: Graph Theory Refresher

    26 min
  3. 03

    The Graph Laplacian

    AdvancedComing soon

    Unnormalised and normalised Laplacians, the quadratic form, and what the null space encodes.

    Assumes: Representing Graphs for Learning · Quadratic Forms and Definiteness

    30 min
  4. 04

    Spectral Graph Theory

    AdvancedComing soon

    Laplacian eigenvalues, algebraic connectivity, the Fiedler vector and spectral partitioning.

    Assumes: The Graph Laplacian

    30 min
  5. 05

    Centrality Measures

    IntermediateComing soon

    Degree, closeness, betweenness and eigenvector centrality, computed on a worked graph.

    Assumes: Representing Graphs for Learning

    28 min
  6. 06

    PageRank

    IntermediateComing soon

    The random surfer model, the power iteration, damping, and handling dangling nodes.

    Assumes: Centrality Measures · Markov Chains

    30 min
  7. 07

    HITS: Hubs and Authorities

    AdvancedComing soon

    Mutual reinforcement of hub and authority scores, and the contrast with PageRank.

    Assumes: PageRank

    22 min
  8. 08

    Community Detection

    AdvancedComing soon

    Modularity, the Louvain and Leiden methods, label propagation and Girvan–Newman.

    Assumes: Spectral Graph Theory

    30 min
  9. 09

    Node Similarity and Proximity

    IntermediateComing soon

    Common neighbours, Jaccard, Adamic–Adar, SimRank and personalised PageRank proximity.

    Assumes: PageRank

    24 min
  10. 10

    DeepWalk

    AdvancedComing soon

    Random walks as sentences, skip-gram over graphs, and the shallow-embedding paradigm.

    Assumes: Node Similarity and Proximity · word2vec: CBOW and Skip-Gram

    28 min
  11. 11

    node2vec

    AdvancedComing soon

    Biased second-order walks, the p and q parameters, and the homophily/structural-equivalence trade-off.

    Assumes: DeepWalk

    26 min
  12. 12

    The Message Passing Framework

    AdvancedComing soon

    Aggregate, update and readout as a unifying abstraction for every GNN in this module.

    Assumes: node2vec · Backpropagation

    30 min
  13. 13

    Graph Convolutional Networks

    AdvancedComing soon

    The GCN layer, symmetric normalisation, self-loops, and a full numeric forward pass on a small graph.

    Assumes: The Message Passing Framework

    32 min
  14. 14

    Deriving GCN from Spectral Convolution

    AdvancedComing soon

    Graph Fourier transform, Chebyshev polynomial filters, and the first-order approximation that yields GCN.

    Assumes: Graph Convolutional Networks · Spectral Graph Theory

    32 min
  15. 15

    GraphSAGE

    AdvancedComing soon

    Neighbour sampling, mean/pool/LSTM aggregators, and inductive generalisation to unseen nodes.

    Assumes: Graph Convolutional Networks

    28 min
  16. 16

    Graph Attention Networks

    AdvancedComing soon

    Learned attention coefficients over neighbours, multi-head attention on graphs, and interpretability.

    Assumes: GraphSAGE · The Attention Mechanism

    30 min
  17. 17

    GIN and GNN Expressiveness

    AdvancedComing soon

    The Weisfeiler–Lehman test, what message passing provably cannot distinguish, and GIN's injective aggregation.

    Assumes: Graph Attention Networks

    30 min
  18. 18

    Graph Pooling and Readout

    AdvancedComing soon

    Sum, mean and max readout, DiffPool, Top-K pooling, and graph-level prediction.

    Assumes: GIN and GNN Expressiveness

    26 min
  19. 19

    Over-Smoothing and Depth in GNNs

    AdvancedComing soon

    Why deep GNNs collapse node representations, and the residual, jumping-knowledge and PairNorm fixes.

    Assumes: Graph Pooling and Readout

    26 min
  20. 20

    Scalable GNN Training

    AdvancedComing soon

    Neighbour explosion, layer-wise and subgraph sampling, Cluster-GCN and GraphSAINT.

    Assumes: Over-Smoothing and Depth in GNNs

    28 min
  21. 21

    Heterogeneous and Multi-Relational Graphs

    AdvancedComing soon

    Multiple node and edge types, metapaths, R-GCN and heterogeneous attention.

    Assumes: Scalable GNN Training

    28 min
  22. 22

    Knowledge Graphs and Embeddings

    AdvancedComing soon

    Triples, TransE, DistMult, ComplEx and RotatE, and knowledge-graph completion.

    Assumes: Heterogeneous and Multi-Relational Graphs

    30 min
  23. 23

    Temporal and Dynamic Graphs

    AdvancedComing soon

    Snapshot and continuous-time formulations, temporal message passing and TGN.

    Assumes: Knowledge Graphs and Embeddings

    26 min
  24. 24

    Link Prediction

    AdvancedComing soon

    Heuristic scores, encoder–decoder formulations, negative sampling and ranking evaluation.

    Assumes: Graph Attention Networks

    28 min
  25. 25

    Graph Transformers

    AdvancedComing soon

    Full attention over nodes, structural and positional encodings for graphs, and scalability limits.

    Assumes: Link Prediction · The Transformer Architecture

    28 min
  26. 26

    GNN Applications

    IntermediateComing soon

    Recommendation, molecular property prediction, fraud detection, traffic forecasting and physics simulation.

    Assumes: Link Prediction

    26 min