NuNet Public Alpha Countdown
Latest Edit March 28th, 2023 — Updating Issue Statues and Issue Links
Greetings NuNetopians,
As we move forward to the next stage of NuNets development we wanted to share this Countdown to Public Alpha with you to give an indication as to when public alpha will launch. Although we cannot commit to exact dates on this timeline because we may be overly optimistic or new issues may arise, please consider this for future developments.
We have created this countdown chart to see what tasks have been completed in relation to the launch of Public Alpha. Countdown Chart legend:
- Red Boxes 👉🏻 Critical Issues
- Purple Boxes 👉🏻 Open Issues
- Grey Boxes 👉🏻 Closed Issues
- Diamonds 👉🏻 Milestones
We will launch Public Alpha with the Decentralized GPU for ML use case which was funded by Project Catalyst Fund8. See the project scoping discussion with external stakeholders and full description as a Cardano Catalyst Fund8 proposal on the Catalyst platform
Unfortunately, work is still being carried out on our Decentralized SPO use case on Cardano. NuNet will enable SPOs to run Cardano Nodes on community-provisioned hardware, increasing resilience and aiding decentralization. The project is financed via a grant from Cardano Catalyst Fund7. See the project’s short summary and full proposal on Catalyst or GDrive. The main issue holding us back from fully launching this use case is P2P remote shell issue.
One of the main problems is the unreliability caused by multiple layers of communication and relay nodes. For instance, the VM created by the Compute Provider’s (CP) DMS behaves as if it is behind a Symmetric NAT or a firewall because of the virtual network interface on the host that allows the VM to have an internet connection. Due to this, it’s not certain whether the VM node would be visible in the network or not. To work around that, nodes in the network that are visible to other peers are used as relays for other nodes that are behind a symmetric NAT or a firewall.
These layers of communication such as the grpc services between the DMS and the Adapter on both sides (SPO and CP) along with relay nodes in the p2p network create unreliable messaging and out-of-order commands and responses.
For more information on this issue, you can see our GitLab.
We will continue to update this document with new developments and issue links that have been made in anticipation of Public Alpha.
Remaining Issues
The following is a list of remaining issues that are being worked on in anticipation of the release of Public Alpha.
Libp2p Milestone
libp2p is a library for building decentralized applications that allows devices to communicate with each other in a peer-to-peer network. It provides a set of network protocols, encryption mechanisms, and transport options that enable devices to find and communicate with each other without relying on a centralized server.
NuNet will integrate libp2p to DMS and replace the NuNet Adapter which currently uses py-ipv8 for peer-to-peer networking.
Main functionalities:
- List available peers (peer discovery)
- Allow nodes behind NAT to communicate
- Create Bootstrap Nodes for NuNet
- Implement DHT
- Implement Messaging (simple chat demo using CLI)
- Implement Stream (socket) connection
- Other Enhancements
Libp2p Issues
- Libp2p — List available peers (peer discovery) — Completed
- Libp2p — NAT Traversal — Completed
- Libp2p — Implement DHT — Completed
- Libp2p — Create Bootstrap Nodes for NuNet — Completed
- Libp2p — Implement Messaging (Simple chat demo using CLI) — Completed
Cardano Blockchain Integration
In order to build the economy of compute processes, NuNet will have to make sure that compute providers get compensated for correctly executed workflows as well as service providers’ users pay only for the correctly executed work. Agreements and settlements between users (currently compute provider’s users and service provider’s users) will be done via NuNet’s smart contract and using NTX token.
This section describes the issues outstanding to develop the integration between the Cardano blockchain and NuNet.
Cardano Blockchain Integration Issues
- Blockchain Integrations in Webapp via MeshJS — On Hold
- Design the Oracle component — Completed
- DMS integration with Oracle to get blockchain data — In Review
- New calls on DMS to interact with WebApp/Management Dashboard -Completed
- Management Dashboard (a simple WebApp integrated with the user’s wallet to withdraw tokens)
- Dashboard interface implementation — Completed
- DMS integration using REST API — Completed
- Blockchain integration via MeshJS — Completed
- Security analysis on DMS — Completed
- Security analysis on Oracle
- Security analysis on WebApp and Management Dashboard
DevOps
DevOps methodology aids to streamline the software development process and enables more frequent, reliable, and high-quality releases of software products. These are the outstanding issues in relation to DevOps within NuNet.
DevOps Issues
- Review of deploy stage to DMS, stats db, and oracle on the CI/CD pipeline — Completed
- Configuring cloud machines
- Monitoring availability of machines, DMS and stats db (three environments)
Use Cases
- Decentralized GPU ML Cloud milestone
- WebApp shows the compute job’s result — Completed
- ML job using a NuNet ML on GPU container — Completed
- Training job for PaLM+RLHF — Completed
- Fake news warning application — Delayed
- Dog demo application — Delayed
- ML job using CPU instead of GPU — Completed
Other Issues
- The program should track and report the health status of services deployed on the device — In Review
- Remote observation of DMS instances and logging — Completed
- DMS notification for update
- Security on DMS REST API calls
- Implementation of ntx_payment event on DMS/statsdb
- Create a parameter on WebApp to set the DMS IP address — Completed
- Package the WebApp and Management Dashboard — Completed
- Change DMS to run an ML job on machines with CPU — Completed
- Resume the ML jobs on DMS — Backlog
NuNet Is Hiring!
NuNet currently has a number of open positions for various roles within the team. If you have the skills and desire to join us in our journey, you can find more information and contact us through our career page.
About NuNet
NuNet lets anyone share and monetize their computing resources, turning cloud computing power from a centralized service into an open protocol powered by blockchain. Find out more via:
