Model Garden
Featured Models
GPS++ Training
A hybrid GNN/Transformer for training Molecular Property Prediction using IPUs on the PCQM4Mv2 dataset. Winner of the Open Graph Benchmark Large-Scale Challenge.
GPS++ Inference
A hybrid GNN/Transformer for Molecular Property Prediction inference using IPUs trained on the PCQM4Mv2 dataset. Winner of the Open Graph Benchmark Large-Scale Challenge.
Distributed KGE - TransE (256) Training
Sharded knowledge graph embedding (KGE) for link-prediction training on IPUs using the WikiKG90Mv2 dataset. Winner of the Open Graph Benchmark Large-Scale Challenge.
GPT-J 6B Fine-tuning
GPT-J 6B fine-tuned using the GLUE MNLI dataset leveraging the Hugging Face Transformer library.
BERT-Large Fine-tuning
HuggingFace Optimum implementation for fine-training a BERT-Large transformer model.
TGN Training
TGN: Temporal Graph Networks is a dynamic GNN model for training on the IPU using TensorFlow 1.
ViT (Vision Transformer) Fine-tuning
HuggingFace Optimum implementation for fine-tuning a ViT (vision transformer) model.
Swin Fine-tuning
Swin: Hierarchical Vision Transformer model using Shifted Windows for fine-tuning in PyTorch.
Library
GPS++ Training
A hybrid GNN/Transformer for training Molecular Property Prediction using IPUs on the PCQM4Mv2 dataset. Winner of the Open Graph Benchmark Large-Scale Challenge.
GPS++ Inference
A hybrid GNN/Transformer for Molecular Property Prediction inference using IPUs trained on the PCQM4Mv2 dataset. Winner of the Open Graph Benchmark Large-Scale Challenge.
Distributed KGE - TransE (256) Training
Sharded knowledge graph embedding (KGE) for link-prediction training on IPUs using the WikiKG90Mv2 dataset. Winner of the Open Graph Benchmark Large-Scale Challenge.
Distributed KGE - TransE (256) Inference
Sharded knowledge graph embedding (KGE) for link-prediction inference on IPUs using the WikiKG90Mv2 dataset. Winner of the Open Graph Benchmark Large-Scale Challenge.
GPT-J 6B Fine-tuning
GPT-J 6B fine-tuned using the GLUE MNLI dataset leveraging the Hugging Face Transformer library.
GPT2-Large Training
GPT2-L training in PyTorch leveraging the Hugging Face Transformers library.
GPT2-Large Inference
GPT2-L inference in PyTorch leveraging the Hugging Face Transformers library.
GPT2-Medium Training
GPT2-M training in PyTorch leveraging the Hugging Face Transformers library.
GPT2-Medium Inference
GPT2-M inference in PyTorch leveraging the Hugging Face Transformers library.
GPT2-Medium Fine-tuning
HuggingFace Optimum implementation for fine-tuning a GPT2-Medium transformer model.
GPT2-Small Training
GPT2-S training in PyTorch leveraging the Hugging Face Transformers library.
GPT2-Small Fine-tuning
HuggingFace Optimum implementation for fine-tuning a GPT2-Small transformer model.
GPT2-Small Inference
GPT2-S inference in PyTorch leveraging the Hugging Face Transformers library.
BERT-Large Training
BERT-Large (Bidirectional Encoder Representations from Transformers) using PyTorch for NLP training on IPUs.
BERT-Large Training
BERT-Large (Bidirectional Encoder Representations from Transformers) using TensorFlow 1 for NLP training on IPUs.
BERT-Large Inference
BERT-Large (Bidirectional Encoder Representations from Transformers) for NLP inference on IPUs with TensorFlow 1.
BERT-Large Training
BERT-Large (Bidirectional Encoder Representations from Transformers) using TensorFlow 2 for NLP training on IPUs.
BERT-Large Inference
BERT-Large (Bidirectional Encoder Representations from Transformers) using PopART for NLP inference on IPUs.
BERT-Large Training
BERT-Large (Bidirectional Encoder Representations from Transformers) using PopART for NLP training on IPUs.
BERT-Large Pretraining
HuggingFace Optimum implementation for pre-training a BERT-Large transformer model.
BERT-Large Fine-tuning
HuggingFace Optimum implementation for fine-training a BERT-Large transformer model.
BERT-Base Training
BERT-Base (Bidirectional Encoder Representations from Transformers) using PyTorch for NLP training on IPUs.
BERT-Base Training
BERT-Base (Bidirectional Encoder Representations from Transformers) using TensorFlow 2 for NLP training on IPUs.
BERT-Base Training
BERT-Base (Bidirectional Encoder Representations from Transformers) using TensorFlow 1 for NLP training on IPUs.
BERT-Base Training
BERT-Base (Bidirectional Encoder Representations from Transformers) using PopART for NLP training on IPUs.
BERT-Base Inference
BERT-Base (Bidirectional Encoder Representations from Transformers) using PopART for NLP inference on IPUs.
BERT-Base Training
BERT-Base pre-training and SQuAD fine-tuning using Baidu's PaddlePaddle framework on IPUs.
BERT-Base Pretraining
HuggingFace Optimum implementation for pretraining a BERT-Base transformer model using bert-based-uncased datasets.
BERT-Base Fine-tuning
HuggingFace Optimum implementation for fine-tuning a BERT-Base transformer model using bert-base-uncased on the squad dataset.
RoBERTa-Large Training
HuggingFace Optimum implementation for training RoBERTa-Large - a transformer model for sequence classification, token classification or question answering.
RoBERTa-Base Fine-tuning
HuggingFace Optimum implementation for fine-tuning RoBERTa-Base on the squad dataset for text generation and comprehension tasks
RoBERTa-Base Fine-tuning
HuggingFace Optimum implementation for fine-tuning RoBERTa-Base on the squad_v2 dataset for text generation and comprehension tasks
LXMERT Fine-tuning
HuggingFace Optimum implementation for fine-tuning LXMERT on the gqa-lxmert dataset for learning vision-and-language cross-modality representations.
DeBERTa Training
HuggingFace Optimum implementation for training DeBERTa - a transformer models that improves BERT and RoBERTa models using disentangled attention and enhanced mask decoder.
LXMERT Fine-tuning
HuggingFace Optimum implementation for fine-tuning LXMERT on the vqa-lxmert dataset for learning vision-and-language cross-modality representations.
HuBERT Training
HuggingFace Optimum implementation for training HuBERT (Hidden-Unit BERT) for self-supervised speech representation learning approach.
BART Training
HuggingFace Optimum implementation for training BART - a transformer model for text generation and comprehension tasks
T5 Training
HuggingFace Optimum implementation for training T5 - a transformer based model that uses a text-to-text approach for translation, question answering, and classification.
GroupBERT Training
GroupBERT - an enhanced transformer architecture with efficient grouped structures in TensorFlow 1.
PackedBERT Training
New BERT packing algorithm that removes padding for more efficient training in PyTorch.
PackedBERT Training
New BERT packing algorithm that removes padding for more efficient training in PopART.
CLIP Training
CLIP (Contrastive Language-Image Pre-Training) - a neural network trained on a variety of (image, text) pairs using PyTorch.
Conformer-Medium Training
A variant of the conformer model based on WeNet (not ESPnet) using PyTorch which uses a hybrid CTC/attention architecture with transformer or conformer as an encoder.
ViT (Vision Transformer) Fine-tuning
ViT (Vision Transformer) fine-tuning in PyTorch using Hugging Face transformers.
ViT (Vision Transformer) Pretraining
ViT (Vision Transformer) pretraining in PyTorch using Hugging Face transformers.
ViT (Vision Transformer) Fine-tuning
HuggingFace Optimum implementation for fine-tuning a ViT (vision transformer) model.
YOLOv3 Training
YOLOv3 - You Only Look Once - a convolutional neural network model that performs object detection tasks on IPUs using TensorFlow 1.
YOLOv3 Inference
YOLOv3 - You Only Look Once - a convolutional neural network model that performs object detection tasks on IPUs using TensorFlow 1..
YOLOv4 Inference
YOLOv4 - You Only Look Once - a convolutional neural network model that performs object detection tasks on IPUs using PyTorch.
ResNet-50 Training
Image classification training on IPUs using the CNN (Convolutional Neural Network) model ResNet-50 with PyTorch.
ResNet-50 Inference
Image classification inference on IPUs using the CNN (Convolutional Neural Network) model ResNet-50 with PyTorch.
ResNet-50 Training
Image classification training on IPUs using the CNN (Convolutional Neural Network) model ResNet-50 with TensorFlow 2.
ResNet-50 Training
Image classification training on IPUs using the CNN (Convolutional Neural Network) model ResNet-50 with TensorFlow 1.
ResNet-50 Inference
Image classification inference on IPUs using the CNN (Convolutional Neural Network) model ResNet-50 with TensorFlow 1.
EfficientNet-B4 Training
CNN (Convolutional Neural Network) image classification training on EfficientNet with PyTorch for IPU.
EfficientNet-B0/B4 Inference
CNN (Convolutional Neural Network) image classification inference on EfficientNet with PyTorch for IPU.
EfficientDet (D0-D4) Inference
Efficient object detection model for inference using TensorFlow 2 on the IPU.
EfficientNet-B4 Training
CNN (Convolutional Neural Network) image classification training on EfficientNet with TensorFlow 1 for IPU.
Reference Evapotranspiration (ET0) Inference
Spatial interpolation analysis and prediction calculation using TensorFlow 1 for weather forecasting, drought forecasting, and smart irrigation.
ResNeXt-101 Training
Image classification training on IPUs using the CNN (Convolutional Neural Network) model ResNeXt-101 with TensorFlow 1.
ResNeXt-101 Inference
Image classification inference on IPUs using the CNN (Convolutional Neural Network) model ResNeXt-101 with PyTorch.
ResNeXt-101 Inference
Image classification inference on IPUs using the CNN (Convolutional Neural Network) model ResNeXt-101 with TensorFlow 1.
ResNeXt-101 Inference
Image classification inference on IPUs using the CNN (Convolutional Neural Network) model ResNeXt-101 with PopART.
Faster-RCNN Training
IPU implementation of Faster-RCNN detection framework using PopART.
Swin Pretraining
Swin: Hierarchical Vision Transformer model using Shifted Windows for pretraining in PyTorch.
MAE Training
Implementation of MAE computer vision model in PyTorch for the IPU based on the paper "Masked Autoencoders Are Scalable Vision Learners".
Frozen️ in Time Training
Implementation of Frozen in Time on the IPU in PyTorch for joint video and image encoder end-to-end retrieval.
Swin Fine-tuning
Swin: Hierarchical Vision Transformer model using Shifted Windows for fine-tuning in PyTorch.
UNet Medical Training
U-Net for biomedical image segmentation using TensorFlow 2 Keras for the IPU.
UNet Medical Inference
U-Net for biomedical image segmentation using TensorFlow 2 Keras for the IPU.
UNet Industrial Training
How to run a UNet Industrial training example with TensorFlow 1 for image segmentation.
Mini DALL-E Training
Mini DALL-E Text-to-Image Generation training example with PyTorch for the IPU.
TGN Training
TGN: Temporal Graph Networks is a dynamic GNN model for training on the IPU using TensorFlow 1.
GIN Training
GIN: Graph Isomorphism Network (GIN) - a simple graph neural network to show that its discriminative/representational power is equal to the power of the Weisfeiler-Lehman (WL) graph isomorphism test.
Cluster-GCN Training
An efficient algorithm for training deep and large Graph Convolutional Networks using TensorFlow 2.
SchNet Training (Preview)
GNN-based model in PyTorch developed for modelling quantum interactions between atoms in a molecule
Neural Image Fields Training
Training a neural network model for reconstructing / compressing images in TensorFlow 2.
Neural Image Fields Inference
Running inference on a neural network model for reconstructing / compressing images in TensorFlow 2.
MCMC Training
Markov Chain Monte Carlo (MCMC) training on IPUs using standard TensorFlow Probability.
Deep Voice 3 Training
Text-To-Speech training on IPUs with PopART using a Convolutional Sequence Learning technique.
FastSpeech2 Training
FastSpeech2: Fast and High-Quality End-to-End Text to Speech training on IPUs with TensorFlow 2.
FastPitch Training
FastPitch: Parallel Text-to-speech with Pitch Prediction using PyTorch.
FastSpeech2 Inference
FastSpeech2: Fast and High-Quality End-to-End Text to Speech inference on IPUs with TensorFlow 2.
Wav2Vec2 Training
HuggingFace Optimum implementation for training Wav2Vec2-Base - a speech recognition transformer model.
Transformer Transducer (RNN-T) Training
IPU implementation of the Speech Recognition Model with Transformer Encoders and RNN-T Loss in PopART.
DIEN Training
DIEN (Deep Interest Evolution Network) training on IPUs with TensorFlow 1 - a recommendation model for click-through rate prediction.
DIEN Inference
DIEN (Deep Interest Evolution Network) inference on IPUs with TensorFlow 1 - a recommendation model for click-through rate prediction.
DIN Training
DIN (Deep Interest Network) training on IPUs with TensorFlow 1 - a recommendation model for click-through rate prediction.
DIN Inference
DIN (Deep Interest Network) inference on IPUs with TensorFlow 1 - a recommendation model for click-through rate prediction.
DeepDriveMD Training
Deep-Learning Driven Adaptive Molecular Simulations for Protein Folding using TensorFlow 2.
CosmoFlow Training
A deep learning model for calculating cosmological parameters in TensorFlow 1. The model primarily consists of 3D convolutions, pooling operations, and dense layers.
Approximate Bayesian Computation (ABC) COVID-19 Inference
A representative implementation of ABC for Simulation-based Inference for observing data from COVID-19 infections to enable statistical inference using TensorFlow 2.
Deep Molecular Dynamics (DeePMD-kit) Training
DeePMD-kit - a deep learning package for many-body potential energy representation and molecular dynamics using TensorFlow 1.
Monte Carlo Ray Tracing Inference
Monte Carlo ray tracing application built in Poplar for neural rendering on the IPU.
MobileNetv2 Inference
MobileNetv2 - Convolutional neural network inference for classification, detection and segmentation using TensorFlow 1.
MobileNetv3 Training
MobileNetv3 - Convolutional neural network training for classification, detection and segmentation using PyTorch.
MobileNetv3 Inference
MobileNetv3 - Convolutional neural network inference for classification, detection and segmentation using PyTorch.
Autoencoder Training
Custom autoencoder model on the IPU using TensorFlow 1 to train collaborative filtering in recommender systems.
Autoencoder Inference
Custom autoencoder inference model on the IPU using TensorFlow 1 to perform collaborative filtering in recommender systems.
Contrastive Divergence VAE Training
Train a Variational Autoencoder / Markov Chain Monte Carlo hybrid model on IPUs with TensorFlow 1.
Reinforcement Learning Training
How to train a deep reinforcement learning model in TensorFlow 1 on multiple IPUs with synchronous data parallel training.
Sales Forecasting Training
How to train a sales forecasting machine learning model with TensorFlow 1 on Graphcore's IPUs.