Vollo SDK – low latency streaming inference of ML models on FPGA platforms

unprovable1 pts0 comments

Introduction - Vollo SDK User Guide

Light (default)

Rust

Coal

Navy

Ayu

Vollo SDK User Guide

Introduction

The Vollo SDK is designed for low latency streaming inference of machine learning (ML) models on FPGA platforms.

Evaluation

You can easily discover the latency Vollo can achieve for your models, without needing an FPGA or a Vollo license. Use the online Vollo Sandbox.

Alternatively, you can download and install the Vollo SDK on your own computer if you wish to evaluate Vollo offline. You won't need an FPGA or a Vollo license for this either. See Getting Started for details.

User Guide Overview

This document outlines the following:

Installation

Key features of Vollo

Steps to get started with Vollo

The Vollo Compiler API

The Vollo Runtime API

Hardware requirements and setup

vollo fpga latency models user guide

Vollo SDK – low latency streaming inference of ML models on FPGA platforms

Related Articles

Amazon, Facebook, FBI have access to a private intelligence-sharing network

SpaceX not the behemoth everyone thought

Elevated error rates on requests to multiple models

Donald Trump and sons to be 'forever' exempt from tax audits

PopuLoRA: Co-Evolving LLM Populations for Reasoning Self- Play