{"id":788837,"date":"2021-10-26T23:13:10","date_gmt":"2021-10-27T06:13:10","guid":{"rendered":"https:\/\/newed.any0.dpdns.org\/en-us\/research\/?post_type=msr-project&#038;p=788837"},"modified":"2023-12-01T00:17:12","modified_gmt":"2023-12-01T08:17:12","slug":"graphormer","status":"publish","type":"msr-project","link":"https:\/\/newed.any0.dpdns.org\/en-us\/research\/project\/graphormer\/","title":{"rendered":"Graphormer"},"content":{"rendered":"<section class=\"mb-3 moray-highlight\">\n\t<div class=\"card-img-overlay mx-lg-0\">\n\t\t<div class=\"card-background  has-background- card-background--full-bleed\">\n\t\t\t<img loading=\"lazy\" decoding=\"async\" width=\"3841\" height=\"1441\" src=\"https:\/\/newed.any0.dpdns.org\/en-us\/research\/wp-content\/uploads\/2021\/10\/Direction-1-TY-IEEE-VIS.png\" class=\"attachment-full size-full\" alt=\"illustration of a green net on a dark blue background\" style=\"\" srcset=\"https:\/\/newed.any0.dpdns.org\/en-us\/research\/wp-content\/uploads\/2021\/10\/Direction-1-TY-IEEE-VIS.png 3841w, https:\/\/newed.any0.dpdns.org\/en-us\/research\/wp-content\/uploads\/2021\/10\/Direction-1-TY-IEEE-VIS-300x113.png 300w, https:\/\/newed.any0.dpdns.org\/en-us\/research\/wp-content\/uploads\/2021\/10\/Direction-1-TY-IEEE-VIS-1024x384.png 1024w, https:\/\/newed.any0.dpdns.org\/en-us\/research\/wp-content\/uploads\/2021\/10\/Direction-1-TY-IEEE-VIS-768x288.png 768w, https:\/\/newed.any0.dpdns.org\/en-us\/research\/wp-content\/uploads\/2021\/10\/Direction-1-TY-IEEE-VIS-1536x576.png 1536w, https:\/\/newed.any0.dpdns.org\/en-us\/research\/wp-content\/uploads\/2021\/10\/Direction-1-TY-IEEE-VIS-2048x768.png 2048w, https:\/\/newed.any0.dpdns.org\/en-us\/research\/wp-content\/uploads\/2021\/10\/Direction-1-TY-IEEE-VIS-1920x720.png 1920w, https:\/\/newed.any0.dpdns.org\/en-us\/research\/wp-content\/uploads\/2021\/10\/Direction-1-TY-IEEE-VIS-1600x600.png 1600w, https:\/\/newed.any0.dpdns.org\/en-us\/research\/wp-content\/uploads\/2021\/10\/Direction-1-TY-IEEE-VIS-240x90.png 240w\" sizes=\"auto, (max-width: 3841px) 100vw, 3841px\" \/>\t\t<\/div>\n\t\t<!-- Foreground -->\n\t\t<div class=\"card-foreground d-flex mt-md-n5 my-lg-5 px-g px-lg-0\">\n\t\t\t<!-- Container -->\n\t\t\t<div class=\"container d-flex mt-md-n5 my-lg-5 align-self-center\">\n\t\t\t\t<!-- Card wrapper -->\n\t\t\t\t<div class=\"w-100 w-lg-col-5\">\n\t\t\t\t\t<!-- Card -->\n\t\t\t\t\t<div class=\"card material-md-card py-5 px-md-5\">\n\t\t\t\t\t\t<div class=\"card-body \">\n\t\t\t\t\t\t\t\n\t\t\t\t\t\t\t\n\n<h1 class=\"wp-block-heading\" id=\"graphormer\">Graphormer<\/h1>\n\n\n\n<p><\/p>\n\n\t\t\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t<\/div>\n\t\t<\/div>\n\t<\/div>\n<\/section>\n\n\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"5376\" height=\"1981\" src=\"https:\/\/newed.any0.dpdns.org\/en-us\/research\/wp-content\/uploads\/2021\/12\/logo-1031871.png\" alt=\"Graphormer logo\" class=\"wp-image-806557\" srcset=\"https:\/\/newed.any0.dpdns.org\/en-us\/research\/wp-content\/uploads\/2021\/12\/logo-1031871.png 5376w, https:\/\/newed.any0.dpdns.org\/en-us\/research\/wp-content\/uploads\/2021\/12\/logo-1031871-300x111.png 300w, https:\/\/newed.any0.dpdns.org\/en-us\/research\/wp-content\/uploads\/2021\/12\/logo-1031871-1024x377.png 1024w, https:\/\/newed.any0.dpdns.org\/en-us\/research\/wp-content\/uploads\/2021\/12\/logo-1031871-768x283.png 768w, https:\/\/newed.any0.dpdns.org\/en-us\/research\/wp-content\/uploads\/2021\/12\/logo-1031871-1536x566.png 1536w, https:\/\/newed.any0.dpdns.org\/en-us\/research\/wp-content\/uploads\/2021\/12\/logo-1031871-2048x755.png 2048w, https:\/\/newed.any0.dpdns.org\/en-us\/research\/wp-content\/uploads\/2021\/12\/logo-1031871-240x88.png 240w\" sizes=\"auto, (max-width: 5376px) 100vw, 5376px\" \/><\/figure>\n\n\n\n<p>Graphormer is a deep learning package that allows researchers and developers to train custom models for molecule modeling tasks. It aims to accelerate the research and application in AI for molecule science, such as material discovery, drug discovery, etc. Now it supports various molecule simulation tasks, e.g., molecular dynamics and property prediction. In the near future, it will further support important applications in molecule science, such as reaction prediction, retrosynthesis, molecule generation, large-scale molecule (polymer, protein) modeling, drug-protein interaction (DPI), and so on.<\/p>\n\n\n\n<p>Graphormer is initially described in NeurIPS 2021 paper <em>Do Transformer Really Perform Badly for Graph Representation Learning?<\/em> The proposed Graphormer is the first deep learning model built upon a standard Transformer that greatly outperforms all conventional graph neural networks on graph-level prediction tasks.<\/p>\n\n\n\n<p>Graphormer won first place in the <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"https:\/\/ogb.stanford.edu\/kddcup2021\/\">KDD Cup \u2013 OGB-LSC<span class=\"sr-only\"> (opens in new tab)<\/span><\/a> quantum chemistry track, which aims to use AI to predict the quantum properties of more than 3.8 million molecules. This competition attracts more than 500 teams to participate, including DeepMind and other big companies. Recently, Graphormer won the Open Catalyst Challenge, a molecule dynamics competition that aims to model the catalyst-absorbate reaction system by AI, and has more than 0.66 million catalyst-absorbate relaxation systems (144 million structure-energy frames) simulated by density functional theory (DFT) software. Winning the OC challenge demonstrates that Graphormer could largely benefit the development of new AI technology for material discovery, and also other important areas.<\/p>\n\n\n\n<p>Advanced pre-trained versions of Graphormer are available exclusively on <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/nam06.safelinks.protection.outlook.com\/?url=https%3A%2F%2Fquantum.microsoft.com%2Fen-us%2Four-story%2Fquantum-elements-overview&data=05%7C01%7Cpdai%40microsoft.com%7Ced9dacd2fd7e40a374f008dbf235a5bb%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638370084460740234%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=0Ka69tVjAp1VKsBOcSpKPNsqBuUlE%2B66ZHmKY72zd3s%3D&reserved=0\" target=\"_blank\" rel=\"noopener noreferrer\">Azure Quantum Elements<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>.<\/p>\n\n\n\n<div class=\"wp-block-buttons is-layout-flex wp-block-buttons-is-layout-flex\">\n<div class=\"wp-block-button is-style-fill-github\"><a data-bi-type=\"button\" class=\"wp-block-button__link wp-element-button\" href=\"https:\/\/github.com\/microsoft\/Graphormer\/\" target=\"_blank\" rel=\"noreferrer noopener\">GitHub<\/a><\/div>\n\n\n\n<div class=\"wp-block-button\"><a data-bi-type=\"button\" class=\"wp-block-button__link wp-element-button\" href=\"https:\/\/graphormer.readthedocs.io\/en\/latest\/\" target=\"_blank\" rel=\"noreferrer noopener\">Documentation<\/a><\/div>\n<\/div>\n\n\n","protected":false},"excerpt":{"rendered":"<p>Graphormer is a deep learning package that allows researchers and developers to train custom models for molecule modeling tasks. It aims to accelerate the research and application in AI for molecule science, such as material discovery, drug discovery, etc. Now it supports various molecule simulation tasks, e.g., molecular dynamics and property prediction. In the near future, it will further support important applications in molecule science, such as reaction prediction, retrosynthesis, molecule generation, large-scale molecule (polymer, protein) modeling, drug-protein interaction (DPI), and so on.<\/p>\n","protected":false},"featured_media":783772,"template":"","meta":{"msr-url-field":"","msr-podcast-episode":"","msrModifiedDate":"","msrModifiedDateEnabled":false,"ep_exclude_from_search":false,"_classifai_error":"","footnotes":""},"research-area":[13556],"msr-locale":[268875],"msr-impact-theme":[],"msr-pillar":[],"class_list":["post-788837","msr-project","type-msr-project","status-publish","has-post-thumbnail","hentry","msr-research-area-artificial-intelligence","msr-locale-en_us","msr-archive-status-active"],"msr_project_start":"","related-publications":[796436],"related-downloads":[],"related-videos":[1004034],"related-groups":[],"related-events":[],"related-opportunities":[],"related-posts":[856401,945276,968301,994098],"related-articles":[],"tab-content":[],"slides":[],"related-researchers":[],"msr_research_lab":[199560,851467],"msr_impact_theme":[],"_links":{"self":[{"href":"https:\/\/newed.any0.dpdns.org\/en-us\/research\/wp-json\/wp\/v2\/msr-project\/788837","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/newed.any0.dpdns.org\/en-us\/research\/wp-json\/wp\/v2\/msr-project"}],"about":[{"href":"https:\/\/newed.any0.dpdns.org\/en-us\/research\/wp-json\/wp\/v2\/types\/msr-project"}],"version-history":[{"count":13,"href":"https:\/\/newed.any0.dpdns.org\/en-us\/research\/wp-json\/wp\/v2\/msr-project\/788837\/revisions"}],"predecessor-version":[{"id":988797,"href":"https:\/\/newed.any0.dpdns.org\/en-us\/research\/wp-json\/wp\/v2\/msr-project\/788837\/revisions\/988797"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/newed.any0.dpdns.org\/en-us\/research\/wp-json\/wp\/v2\/media\/783772"}],"wp:attachment":[{"href":"https:\/\/newed.any0.dpdns.org\/en-us\/research\/wp-json\/wp\/v2\/media?parent=788837"}],"wp:term":[{"taxonomy":"msr-research-area","embeddable":true,"href":"https:\/\/newed.any0.dpdns.org\/en-us\/research\/wp-json\/wp\/v2\/research-area?post=788837"},{"taxonomy":"msr-locale","embeddable":true,"href":"https:\/\/newed.any0.dpdns.org\/en-us\/research\/wp-json\/wp\/v2\/msr-locale?post=788837"},{"taxonomy":"msr-impact-theme","embeddable":true,"href":"https:\/\/newed.any0.dpdns.org\/en-us\/research\/wp-json\/wp\/v2\/msr-impact-theme?post=788837"},{"taxonomy":"msr-pillar","embeddable":true,"href":"https:\/\/newed.any0.dpdns.org\/en-us\/research\/wp-json\/wp\/v2\/msr-pillar?post=788837"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}