trainium

Here are 3 public repositories matching this topic...

Foundation model benchmarking tool. Run any model on any AWS platform and benchmark for performance across instance type and serving stack options.

benchmarking benchmark p5 bedrock evaluation-metrics sagemaker g6 p4d g5 foundation-models inferentia generative-ai llama2 deepseek trainium llama3 g6e deepseek-r1

Community maintained hardware plugin for vLLM on AWS Neuron

aws inferentia aws-neuron trainium

AWS TorchNeuron Deep Learning Projects using Trainium1 Instances

aws ec2 pytorch trainium torch-neuron

Add a description, image, and links to the trainium topic page so that developers can more easily learn about it.

To associate your repository with the trainium topic, visit your repo's landing page and select "manage topics."