Just a few weeks following Tenstorrent’s impressive $700 million funding round, developers can now explore Tenstorrent’s AI accelerators through Koyeb. Tenstorrent specializes in AI processors utilizing the RISC-V instruction set architecture and has created its own open-source neural network library, TT-NN, as well as a low-level programming model, TT-Metalium.
Positioned among several firms competing to provide alternatives to Nvidia’s GPUs and its CUDA library, Tenstorrent finds itself in a landscape that includes competitors like Axelera, Etched, Groq, and others.
Koyeb, established by former executives from Scaleway, is dedicated to creating a serverless cloud platform aimed at developers needing an abstraction layer at the cloud infrastructure level. It goes head-to-head with competitors such as Fly.io, Railway, and Render.
The Koyeb platform empowers developers to deploy applications across multiple virtual machines using a command line interface or via git push after synchronization with their code repositories. It supports Docker containers and a variety of popular programming languages.
A standout feature of Koyeb is its ability to automatically scale applications to hundreds of servers on demand, and to reduce server infrastructure during quieter periods.
In recent months, Koyeb has sharpened its focus on AI applications. Thanks to its serverless platform, it can deliver a low-latency environment suitable for AI workloads.
On the hardware side, Koyeb utilizes Tenstorrent’s PCIe boards within its data centers. Developers can access the low-level TT-Metalium SDK to create host and kernel programs.
Within Koyeb’s documentation and admin panels, developers will find two new types of instances:
- The TT-N300S instance features 24GB of GDDR6 memory, 192MB of SRAM, and offers up to 466 FP8 TFLOPS. It is complemented by 64GB of RAM and 4 virtual CPUs.
- The TT-Loudbox instance contains four N300S units, providing 96GB of GDDR6, 768MB of SRAM, and up to 1,864 FP8 TFLOPS. This instance has 256GB of RAM and 16 virtual CPUs.
With this launch, Koyeb is aiming to establish itself as a hardware-agnostic cloud platform. “This reminds us of ARM’s entry into the server market with their high-performance chips,” stated Koyeb’s co-founder and CEO, Yann Leger, in an interview with TechCrunch.
“Having introduced ARM to the market with Scaleway back in 2013-2014, where we provided fully customized servers, we come equipped with the experience to deploy various architectures and manage diverse hardware,” he remarked.
Looking ahead, Tenstorrent is actively seeking partners to cultivate a developer ecosystem around its open-source programming model, as creating a viable alternative to Nvidia’s AI stack will require collaborative efforts.
Compiled by Techarena.au.
Fanpage: TechArena.au
Watch more about AI – Artificial Intelligence
