📄 Other Resources

Learn how to use Hugging Face in Google Cloud by reading our blog posts, Google documentation and examples below.

Blog posts

• Hugging Face and Google partner for open AI collaboration
• Google Cloud TPUs made available to Hugging Face users
• Making thousands of open LLMs bloom in the Vertex AI Model Garden
• Deploy Meta Llama 3.1 405B on Google Cloud Vertex AI

Google Documentation

• Google Cloud Hugging Face Deep Learning Containers
• Google Cloud public Artifact Registry for DLCs
• Serve Gemma open models using GPUs on GKE with Hugging Face TGI
• Generative AI on Vertex - Use Hugging Face text generation models

Examples

• All examples

GKE

• Training

  • Fine-tune Gemma 2B with PyTorch Training DLC using SFT on GKE
  • Fine-tune Mistral 7B v0.3 with PyTorch Training DLC using SFT + LoRA on GKE

• Inference

  • Deploy Meta Llama 3 8B with TGI DLC on GKE
  • Deploying Llama3 8B with Text Generation Inference (TGI) on GKE
  • Deploy Snowflake’s Arctic Embed with TEI DLC on GKE
  • Deploy BGE Base v1.5 with TEI DLC from GCS on GKE

Vertex AI

• Training

  • Fine-tune Mistral 7B v0.3 with PyTorch Training DLC using SFT on Vertex AI
  • Fine-tune Gemma 2B with PyTorch Training DLC using SFT + LoRA on Vertex AI

• Inference

  • Deploy BERT Models with PyTorch Inference DLC on Vertex AI
  • Deploy Embedding Models with TEI DLC on Vertex AI
  • Deploy Gemma 7B with TGI DLC on Vertex AI
  • Deploy Gemma 7B with TGI DLC from GCS on Vertex AI
  • Deploy FLUX with PyTorch Inference DLC on Vertex AI
  • Deploy Meta Llama 3.1 405B with TGI DLC on Vertex AI

• Evaluation

  • Evaluating open LLMs with Vertex AI and Gemini

(Preview) Cloud Run

• Inference

  • Deploy Meta Llama 3.1 with TGI DLC on Cloud Run

< > Update on GitHub