-
Leverage Hugging Face’s TGI to Create Large Language Models (LLMs) Inference APIs – Part 2
Introduction – Multiple LLM APIs If you haven’t already, go back and read Part 1 of this series. In this guide we take a look at how you can serve…
-
Leverage Hugging Face’s TGI to Create Large Language Models (LLMs) Inference APIs – Part 1
Introduction Are you interested in setting up an inference endpoint for one of your favorite models? Have you been wanting to leverage the full unquantized version of models but found…
-
AutoGen with Ollama/LiteLLM – Setup on Linux VM
In the ever-evolving landscape of AI technology, Microsoft continues to push the boundaries with groundbreaking projects. Among these innovative endeavors is their AutoGen project. AutoGen provides multi-agent conversation framework as…
Post Tags
a6000 agents AI AI agents AI in business AI infrastructure AI training blackwell cloud computing Cloud GPU cost optimization data centers Enterprise AI fine tuning generative AI GPU GPU architecture GPU benchmarks h100 Hugging Face inference l40 l40s Llama LLM lora LTX machine learning minicpm multi gpu neocloud NVIDIA ollama pytorch qlora RAG research & HPC sglang SXM5 training tutorial ubuntu VFX vllm zero
Article Categories
AI AutoGen Cloud GPU & Infrastructure Company News Data Analytics How To Hugging Face LLM NVIDIA Ollama Open Source Recipes Uncategorized VFX