Source: PermaDAO
The AI on AO conference introduced three significant technological breakthroughs: Web Assembly 64-bit support, WeaveDrive technology, and the integration of the Llama.cpp large language model inference engine. Additionally, two projects were highlighted: Llama Land and Apus Network. Let’s dive into the details.
On June 20th, the AI on AO conference concluded successfully. During this event, the AO protocol showcased three major technological updates, marking an exciting breakthrough in enabling smart contracts to run large language models in a decentralized environment.
Specifically, AO’s key breakthroughs in AI technology include the following three aspects:
Web Assembly 64-bit support
: Developers can now create applications with more than 4GB of memory, with Web Assembly 64-bit theoretically supporting up to 16 exabytes (approximately 17 billion GB) of memory. Currently, AO can execute 16GB models, which means that AO’s 16GB memory capacity is sufficient to run almost all models in the current AI field. The expansion of memory capacity not only enhances application performance but also promotes development flexibility and technological innovation.
WeaveDrive technology
: This technology simplifies the way developers access and manage data, allowing them to access Arweave data as if it were a local hard drive and efficiently stream data into the execution environment, accelerating development speed and application performance.
Llama.cpp large language model inference engine integration
: By porting the Llama.cpp system, AO supports directly running various open-source large language models such as Llama 3 and GPT-2 within smart contracts. This means that smart contracts can directly utilize advanced language models to process complex data and make decisions (including financial decisions), greatly expanding the functionality of decentralized applications.
These three important technological breakthroughs create more opportunities for developers to build AI applications on AO. As application examples, the conference introduced a new AI-driven project, Llama Land, and another decentralized GPU network project, Apus Network, which will provide the best AI model execution environment on AO in the most cost-effective way in the future.
Llama Land
Llama Land is a fully on-chain massively multiplayer online game built on AO, creating a virtual world entirely driven by AI (Llama 3 model). Llama Land features a system called Llama Fed, which is similar to the Federal Reserve but operated by the Llama model, responsible for monetary policy and minting Llama tokens.
Users can request Llama tokens by providing Arweave tokens (wAR), and Llama Fed will autonomously decide whether to grant the tokens based on the quality of the request (e.g., whether the project/proposal is interesting or valuable) without any human intervention.
Currently, Llama Land is not fully open to the public. Interested users can visit its website and join the waitlist to be among the first to experience it.
Apus Network
Apus Network is a decentralized, permissionless GPU network. It leverages Arweave’s permanent storage and AO’s scalability, and through economic incentives, provides a deterministic GPU execution environment for AI models. Specifically, Apus Network can offer an efficient, secure, and economical computing environment for AI applications on AO, further driving the development of decentralized AI.
The Apus Network project recently updated its website content to enhance user experience. Development of model evaluation and model fine-tuning features is ongoing and has achieved phased results. In the future, Apus Network plans to support AO ecosystem wallets and complete related development and testing in the Playground. Additionally, model evaluation functionality will be expanded and implemented on the AO platform to further enhance its application capabilities and performance.
Summary
The AI on AO conference not only showcased AO’s ability to support various advanced AI models but also significantly promoted the development of decentralized AI applications. As example projects following this technical upgrade, Llama Land demonstrated the prototype of autonomous AI agent applications. With the development of AI applications, the AO ecosystem will introduce more GPU resources to accelerate the execution speed of large language models. Apus Network has also become the first decentralized GPU network to be integrated with AO.
In the future, AO will further increase memory limits to support running larger-scale AI models based on demand. Additionally, AO will continue to explore the possibilities of building autonomous AI agents, further expanding the application scenarios of decentralized finance and smart contracts
