Tag: Hugging Face
-
Deploy MusicGen with PyTorch on Blackwell GPU (2026 Guide)
Set up MusicGen on an NVIDIA RTX PRO 6000 Blackwell GPU with PyTorch 2.10.0+cu130 for AI-powered music generation from text prompts.
-
Impact of updated NVIDIA drivers on vLLM & HuggingFace TGI
If you are building a service that relies on LLM inference performance, you want to know how to get the most tokens per second. There…
-
Leverage Hugging Face’s TGI to Create Large Language Models (LLMs) Inference APIs – Part 2
Introduction – Multiple LLM APIs If you haven’t already, go back and read Part 1 of this series. In this guide we take a look…
-
Leverage Hugging Face’s TGI to Create Large Language Models (LLMs) Inference APIs – Part 1
Introduction Are you interested in setting up an inference endpoint for one of your favorite models? Have you been wanting to leverage the full unquantized…