Sign in Subscribe
3 min read agentic ai

Google says LiteRT is almost there for any-device, edge agentic AI – and beats the pants off Llama

With increasing NPU support, Google argues it has the platform that makes it trivial to roll your own agents for Android, iOS and even Raspberry Pi, via what used to be TensorFlow Lite.
Share
Google says LiteRT is almost there for any-device, edge agentic AI – and beats the pants off Llama
Photo by Rayson Tan on Unsplash

Google says its framework for local AI inference, LiteRT, is getting closer to being able to run agentic workflows on edge devices cheaply, using the most popular open-source models.

Google rebranded its runtime system for local AI, TensorFlow Lite, as LiteRT in 2024 because it said at the time, the runtime was evolving beyond prior TensorFlow models.

With LiteRT, Google said it was not building a platform for one AI model, but creating a way for users to deploy the model of their choice on the edge device of their choice simply, without the friction common in cross-platform workflows.

Fast forward and – albeit with some bits still in preview – the Alphabet company says it is just about there, complete with agentic capabilities and even some NPU acceleration.

Oh, and it beats the pants off Meta's Llama.

This post is for subscribers only


Published by:

Phillip de Wet

You might also like...

15
May

Claude's new pricing policy: What is changing and why now?

3 min read
15
May

Over 10 threat groups are now feasting on your Cisco SD-WAN

4 min read
14
May

Everything you need to know from the expo floor of Gartner’s D&A Summit

5 min read
14
May

Cisco reports record revenue, slashes 4,000 jobs

3 min read
14
May

Alibaba will "overshoot" on AI spending plans despite losses

2 min read