#733 · Primary category: Education & Research

pytorch-GAT

attention attention-mechanism deep-learning gat gat-tutorial graph-attention-network graph-attention-networks jupyter python pytorch pytorch-gat pytorch-implementation self-attention

PyTorch implementation of the original Graph Attention Network (GAT) paper with visualization tools for Cora and PPI datasets.

Project last updated:11/17/22

GitHub Stars

2.7K

Forks

357

Contributors

1

License

MIT

Why we included this project

This repository reads like a well-organized tutorial rather than a bare library drop, which makes it a solid pick if you actually want to understand graph attention networks instead of just running one. It implements the original GAT paper in PyTorch and covers both classic setups: transductive learning on the Cora citation graph and inductive learning on the PPI protein network, so you can watch the same model behave differently across the two. The real selling point for learners is the playground script, which renders the Cora graph, projects the learned embeddings with t-SNE, and plots attention and entropy histograms, so the self-attention math becomes something you can see rather than trust on faith. Code comments and profiling utilities are threaded through the training scripts, which helps you trace where attention coefficients come from and why the model makes the decisions it does.

Articles for this project

No articles for this project yet.

To suggest a topic or contribute an article, contact us.

Related projects in this category