MODULE 19
Graph Machine Learning
Spectral graph theory, PageRank and node embeddings through to GCN, GraphSAGE, GAT and graph transformers.
26 lessons~12h reading
- 0126 min
Graph Theory Refresher
BeginnerComing soonVertices, edges, degree, paths, cycles, connectivity, bipartite and directed graphs, trees and DAGs.
Assumes: Graph Representations
- 0226 min
Representing Graphs for Learning
BeginnerComing soonAdjacency, degree and incidence matrices, edge indices, node and edge features, and sparse formats.
Assumes: Graph Theory Refresher
- 0330 min
The Graph Laplacian
AdvancedComing soonUnnormalised and normalised Laplacians, the quadratic form, and what the null space encodes.
Assumes: Representing Graphs for Learning · Quadratic Forms and Definiteness
- 0430 min
Spectral Graph Theory
AdvancedComing soonLaplacian eigenvalues, algebraic connectivity, the Fiedler vector and spectral partitioning.
Assumes: The Graph Laplacian
- 0528 min
Centrality Measures
IntermediateComing soonDegree, closeness, betweenness and eigenvector centrality, computed on a worked graph.
Assumes: Representing Graphs for Learning
- 0630 min
PageRank
IntermediateComing soonThe random surfer model, the power iteration, damping, and handling dangling nodes.
Assumes: Centrality Measures · Markov Chains
- 0722 min
HITS: Hubs and Authorities
AdvancedComing soonMutual reinforcement of hub and authority scores, and the contrast with PageRank.
Assumes: PageRank
- 0830 min
Community Detection
AdvancedComing soonModularity, the Louvain and Leiden methods, label propagation and Girvan–Newman.
Assumes: Spectral Graph Theory
- 0924 min
Node Similarity and Proximity
IntermediateComing soonCommon neighbours, Jaccard, Adamic–Adar, SimRank and personalised PageRank proximity.
Assumes: PageRank
- 1028 min
DeepWalk
AdvancedComing soonRandom walks as sentences, skip-gram over graphs, and the shallow-embedding paradigm.
Assumes: Node Similarity and Proximity · word2vec: CBOW and Skip-Gram
- 1126 min
node2vec
AdvancedComing soonBiased second-order walks, the p and q parameters, and the homophily/structural-equivalence trade-off.
Assumes: DeepWalk
- 1230 min
The Message Passing Framework
AdvancedComing soonAggregate, update and readout as a unifying abstraction for every GNN in this module.
Assumes: node2vec · Backpropagation
- 1332 min
Graph Convolutional Networks
AdvancedComing soonThe GCN layer, symmetric normalisation, self-loops, and a full numeric forward pass on a small graph.
Assumes: The Message Passing Framework
- 1432 min
Deriving GCN from Spectral Convolution
AdvancedComing soonGraph Fourier transform, Chebyshev polynomial filters, and the first-order approximation that yields GCN.
Assumes: Graph Convolutional Networks · Spectral Graph Theory
- 1528 min
GraphSAGE
AdvancedComing soonNeighbour sampling, mean/pool/LSTM aggregators, and inductive generalisation to unseen nodes.
Assumes: Graph Convolutional Networks
- 1630 min
Graph Attention Networks
AdvancedComing soonLearned attention coefficients over neighbours, multi-head attention on graphs, and interpretability.
Assumes: GraphSAGE · The Attention Mechanism
- 1730 min
GIN and GNN Expressiveness
AdvancedComing soonThe Weisfeiler–Lehman test, what message passing provably cannot distinguish, and GIN's injective aggregation.
Assumes: Graph Attention Networks
- 1826 min
Graph Pooling and Readout
AdvancedComing soonSum, mean and max readout, DiffPool, Top-K pooling, and graph-level prediction.
Assumes: GIN and GNN Expressiveness
- 1926 min
Over-Smoothing and Depth in GNNs
AdvancedComing soonWhy deep GNNs collapse node representations, and the residual, jumping-knowledge and PairNorm fixes.
Assumes: Graph Pooling and Readout
- 2028 min
Scalable GNN Training
AdvancedComing soonNeighbour explosion, layer-wise and subgraph sampling, Cluster-GCN and GraphSAINT.
Assumes: Over-Smoothing and Depth in GNNs
- 2128 min
Heterogeneous and Multi-Relational Graphs
AdvancedComing soonMultiple node and edge types, metapaths, R-GCN and heterogeneous attention.
Assumes: Scalable GNN Training
- 2230 min
Knowledge Graphs and Embeddings
AdvancedComing soonTriples, TransE, DistMult, ComplEx and RotatE, and knowledge-graph completion.
Assumes: Heterogeneous and Multi-Relational Graphs
- 2326 min
Temporal and Dynamic Graphs
AdvancedComing soonSnapshot and continuous-time formulations, temporal message passing and TGN.
Assumes: Knowledge Graphs and Embeddings
- 2428 min
Link Prediction
AdvancedComing soonHeuristic scores, encoder–decoder formulations, negative sampling and ranking evaluation.
Assumes: Graph Attention Networks
- 2528 min
Graph Transformers
AdvancedComing soonFull attention over nodes, structural and positional encodings for graphs, and scalability limits.
Assumes: Link Prediction · The Transformer Architecture
- 2626 min
GNN Applications
IntermediateComing soonRecommendation, molecular property prediction, fraud detection, traffic forecasting and physics simulation.
Assumes: Link Prediction