Graph Attention Network

Nicolas Beuve

feb. 03 2022

Room 229 / Zoom

the Graph Attention Network (GAT) is a Graph Neural Network (GNN) using attention to represent relative importance of neighbooring nodes in a graph. GNNs are a special kind of neural network operating on graphs. At first glance, they seem to be not very suitable for image analysis, but after an in-depth analysis of the Graph Attention Network, we will see an example of application of such model in superpixel image classification.

illustration

Petar Veličković and Guillem Cucurull and Arantxa Casanova and Adriana Romero and Pietro Liò and Yoshua Bengio. 2018. Graph Attention Networks.

Pedro H. C. Avelar and Anderson R. Tavares and Thiago L. T. da Silveira and Cláudio R. Jung and Luís C. Lamb. 2020. Superpixel Image Classification with Graph Attention Networks.

William L. Hamilton and Rex Ying and Jure Leskovec. 2018. Inductive Representation Learning on Large Graphs.