TOP Network Biweekly Report: July 10, 2024 -July 23, 2024

POC Design for AI Shard Is On The Way

We are excited to announce that the AI shard is currently in the Proof of Concept (POC) design phase, with a detailed roadmap planned for release in the third quarter.

As the first phase of the AI shard, the main goal of the POC is to provide flexible and efficient support for inference services of three types of models — text-to-image, small-scale Q&A, and speech-to-text — within a fixed computing resource cluster.

From the participants’ perspective, the POC can be specifically divided into:
**Platform-level shard core functions**: Responsible for model management and allocation of computing resources.
**Computing nodes**: Automatically manage node configuration and model task allocation.
**Validators**: Record node task processes and prevent malicious actions by nodes.
**Infrastructure**: Integration of decentralized storage and blockchain consensus mechanisms.

Breakdown Design of Shard Core Functions

Given the variety of models and inference services, we need a unified method to deploy and use model services. We use RayServer, Docker image technology, and Kubernetes management tools to establish a standardized deployment mechanism.

In simpler terms, this is like the catering department of a hotel: RayServer is the “chef” responsible for managing and handling various services; Docker is the “kitchen” where different model services are placed; Kubernetes is the “kitchen manager” responsible for segmenting and managing the resources each kitchen needs to ensure that every dish (i.e., each model task) can be completed smoothly. The advantage of this approach is that each model task runs in an independent environment without interference, ensuring they can all operate efficiently and stably.

Community Activity

We’re excited to share the highlights from our recent AMA with the Crypto Whale community! During the event, we introduced updates to our lightpaper, unveiled the AI Shard, and outlined our next steps. Stay tuned for more upcoming activities in our community.

If you are interested in collaborating, please send your information to contact@topnetwork.org.

Find More

Official Website | Telegram | Twitter | Medium | Reddit | Email