This repo is the official implementation of "Do Transformers Really Perform Bad for Graph Representation?".