Resources
Good practices
Train, validate and test: Nested cross-validation Links to an external site.
Automated hyperparameter optimization with Optuna Links to an external site.
Papers
Attention Is All You Need Links to an external site.
Big Bird: Transformers for Longer Sequences Links to an external site.
MSA Transformer (proteins) Links to an external site.
Video lectures
MIT Intro to Deep Learning course Links to an external site.
Stanford CS224W: Machine Learning with Graphs Links to an external site.
Tools
Keras v2 documentation Links to an external site.
Tensorflow v2 documentation Links to an external site.
Segment Anything Links to an external site.
DNA foundation modeling from molecular to genome scale Links to an external site.
PyTorch Geometric (GNNs in pytorch) Links to an external site.
Spektral (GNNs in Keras/TF) Links to an external site.
Other resources mentioned during the course
Tensorflow Playground Links to an external site.
A step-by-step backpropagation example Links to an external site.
DBSCAN (Clustering noisy data) Links to an external site.
Overview of clustering algorithms in sk-learn Links to an external site.