wowsuch ai
Live

Hugging FaceDeveloper platform

TorchTPU

TorchTPU adds a native TPU backend to PyTorch. It supports Pallas kernels, distributed training, and torch.compile integration.

What it does

Developers can run and train Hugging Face models on TPUs using PyTorch, and use TPU kernels to accelerate workloads.

Availability
Install on a TPU VM with pip install torch-tpu
Pricing model
Not established
Deployment
TPU VM; TPUs are available on Google Cloud
Privacy
Not established
Licence
Not established
Capability
training
Modality
code
Access
SDK
Deployment
hosted
Pricing
unknown
Target user
developerresearcherenterprise

Evidence

6 claims
  • TorchTPU adds TPU as a new backend to PyTorch. [1]
    TorchTPU adds TPU as a new backend to PyTorch.
    Hugging Face. Quoted text is outside CC BY 4.0 and keeps its original rights.
  • It includes Pallas kernels tuned for TPUs, distributed training support, and torch.compile integration. [1]
    It comes with Pallas kernels tuned for TPUs, support for distributed training, and a torch.compile integration for when you want more speed.
    Hugging Face. Quoted text is outside CC BY 4.0 and keeps its original rights.
  • The article provides a pip command to install TorchTPU on a TPU VM. [1]
    Install TorchTPU, grab a model from the Hub, and send it to "tpu" .
    Hugging Face. Quoted text is outside CC BY 4.0 and keeps its original rights.
  • Transformers models can be loaded on TPU with device_map="tpu". [1]
    Now that TorchTPU brings native support, Optimum TPU is not required anymore to run Hugging Face models with Transformers and Diffusers.
    Hugging Face. Quoted text is outside CC BY 4.0 and keeps its original rights.
  • Diffusers pipelines can run on TPU using pipe.to("tpu"). [1]
  • The article reports that 96.5% of the Transformers tests that run on TPU pass. [1]
    Of the tests that run on TPU, 96.5% pass.
    Hugging Face. Quoted text is outside CC BY 4.0 and keeps its original rights.

Sources

1
1
Hugging FaceOwner-controlled
https://huggingface.co/blog/hf-torchtpu Retrieved 2026-10-28 00:02 UTC
Verified

Versions

7
VersionEffectiveChangeChanged fieldsState
72026-10-28 00:02 UTCmaterial changecapability, modality, access, deploymentCurrent
62026-10-26 01:12 UTCmaterial changecapability, modality, access, deploymentCurrent
52026-10-25 01:09 UTCmaterial changeaccess, deploymentCurrent
42026-10-24 01:29 UTCmaterial changecapability, modality, accessCurrent
32026-10-23 01:10 UTCmaterial changecapability, modality, deploymentCurrent
22026-10-22 00:28 UTCmaterial changecapability, modality, access, deploymentCurrent
12026-10-20 17:18 UTCpublicationNoneCurrent

In briefs

2

Open in the catalog

Original catalog content is licensed under CC BY 4.0, attributed to wowsuchai. Source quotations and linked content keep their original rights.