Infinity: a runtime for extreme agent concurrency

Have you ever wanted to run 75k agents on a Raspberry Pi?

I know I have not, but evidently the nice people at UC Berkeley and AWS have.

That is why they created Infinity,an agentic framework written in Rust that allows you to concurrently run a ridiculous amount of agents.

Why is AWS collaborating on a project where you can more easily host agents on local hardware when they are in the business of renting CPUs?

Perhaps it's because there are better margins in selling tokens to those agents and renting GPUs.

Will I be migrating everything to infinity any time soon?

Not likely.

I do take solace that the various Raspberry Pi’s I have gathering dust around the house could be put to use hosting an army of agents to do my bidding.