Author Archives: Massed Compute

Hacktoberfest is an annual event that runs throughout October, celebrating open-source projects and the community of contributors who make them possible. For the 10th consecutive year, DigitalOcean is hosting Hacktoberfest, offering a welcoming environment for developers, especially those who are just beginning their journey into open source. It’s the perfect time to dive into contributing, […]

When it comes to Artificial Intelligence (AI) models, there are two key processes that allow it to generate outputs and or perform predictions: AI training and AI inference.  Below we cover some common questions about the two. What is AI training? In the AI training phase of a machine learning model’s life cycle, you typically […]

While it may seem that AI is a recent phenomenon, the field of artificial intelligence has been developing for decades. However, now we’re seeing (and using) AI that can help us dramatically with our day-to-day tasks. What recent advancement caused this boom in AI technology?  The answer is generative AI. What is generative AI? As […]

Artificial Intelligence (AI) development has become a cornerstone of innovation across numerous industries, from healthcare to finance, automotive to entertainment. As AI models grow more complex, the computational demands increase exponentially. To meet these demands, developers require powerful hardware to handle the intensive tasks associated with AI development. Cloud GPUs Graphics Processing Units) have emerged […]

Figure: Generated from our Art VM Image using Invoke AI Previously we performed some benchmarks on Llama 3 across various GPU types. We are returning again to perform the same tests on the new Llama 3.1 LLM. On July 23, 2024, the AI community welcomed the release of Llama 3.1 405B, 70B and 8B models. […]

What’s a great piece of advice when you venture on a creative path that requires efficiency? Don’t reinvent the wheel. In a nutshell, that’s model merging.   Model merging in the context of AI is the practice of taking existing AI models, including Large Language Models (LLMs), and using them to create your own. Like in […]

NVIDIA’s CEO, Jensen Huang, revealed some of the most exciting technological innovations during his keynote presentation at Computex 2024 in early June.  Surpassing Apple to become the second most valuable company in the U.S., NVIDIA and their research team is working on finding breakthroughs that will drive further adoption of AI. Below we explain a […]

In the era of Artificial Intelligence (AI), Large Language Models (LLMs) are redefining our interaction with technology, work, and how we process and understand information.  Performing complex language-related tasks, LLMs are offering new possibilities for many industries, like healthcare, retail, finance and law. Have you considered how LLMs could help you in your day-to-day tasks? […]

Update: Looking for Llama 3.1 70B GPU Benchmarks? Check out our blog post on Llama 3.1 70B Benchmarks On April 18, 2024, the AI community welcomed the release of Llama 3 70B, a state-of-the-art large language model (LLM). This model is the next generation of the Llama family that supports a broad range of use […]

Often considered the “brain” of a computer, processors interpret and execute programs and tasks. In an ever-evolving tech landscape, it’s crucial to understand the instances in which various types of processors perform best. Below, let’s break down GPUs and CPUs, what they do and when to use one over the other for various workloads. What’s […]