NIGHTSHADE 2.0

The Next Evolution in NEAR Protocol’s Sharding Architecture

NEARWEEK
NEAR Protocol
7 min readAug 23, 2024

--

Introduction

NEAR Protocol has taken a significant step forward in its quest to enhance blockchain scalability and efficiency with the launch of Nightshade 2.0 on its mainnet. This advancement is a crucial milestone in NEAR’s sharding roadmap, introducing innovative concepts like stateless validation and fundamentally reworking the network’s sharding mechanism. These changes promise to unlock unprecedented levels of performance, scalability, and decentralization, positioning NEAR as a leader in the blockchain space.

Stateless Validation: A New Paradigm for State Management

One of the most groundbreaking features of Nightshade 2.0 is the introduction of stateless validation. In traditional blockchain architectures, validators are required to maintain the state of the network locally, which includes all the data that has been posted to the blockchain. This approach can be resource-intensive and limits the network’s scalability.

Nightshade 2.0 changes this by allowing validators to retrieve the necessary information to validate state changes, known as “state witness,” directly from the network. Validators no longer need to store the entire state locally. This innovation not only reduces the resource burden on validators but also enhances the overall efficiency of the network. By decentralizing state management, NEAR can now support a larger number of validators, driving further decentralization and robustness.

A Fundamental Reworking of NEAR’s Sharding Architecture

Nightshade 2.0 represents a fundamental reworking of NEAR’s sharding architecture, which is a critical component of its scalability strategy. Sharding allows the network to be divided into smaller, manageable pieces, known as shards, each capable of processing transactions independently. However, under the previous model, individual nodes still needed to track the entire state of the network.

With the new architecture, no single node is required to track the entire state anymore. This change unlocks even greater efficiency and scalability by reducing the overhead associated with maintaining and processing the state. As a result, the network can now support more shards, each functioning independently yet cohesively within the broader network, leading to opportunities for massive improvements in overall performance.

These improvements in overall performance are the following: NEAR’s advancements in block creation, data availability, and chunk validation represent significant leaps in overall network performance, scalability, and security. Here’s how:

  • Block Production: In NEAR’s Nightshade architecture, block producers and validators work together to maintain the network. With 100 block producers and 10,000 validators, the system ensures decentralization and security. Block producers download and process transactions for specific shards, creating chunks that are then added to the main blockchain. This division of labor allows the network to handle high volumes of transactions efficiently while maintaining a robust and decentralized structure.
  • Data Availability: To ensure that every chunk of data remains accessible, NEAR uses erasure coding, distributing parts of each chunk across block producers. This mechanism guarantees that even if some block producers fail, the network can still reconstruct the full data set, ensuring continuity and preventing data loss. This approach enhances reliability, making NEAR a trustworthy platform for developers and users alike.
Figure 17: Nightshade:Near Protocol Sharding Design 2.0, Skidanov, Polosukhin, Wang, 2024
  • Chunk Validation: NEAR’s innovative chunk validation process involves stateless validators who verify chunks using state witnesses. This design reduces the need for validators to maintain the full state of the blockchain locally, making the validation process more lightweight and scalable. As a result, the network can support a larger number of validators, further decentralizing the network and enhancing its security.

These improvements collectively drive NEAR’s ability to scale effectively while ensuring that the network remains secure and decentralized, even under heavy load. The enhancements in block creation, data availability, and chunk validation not only solve critical challenges faced by other blockchains but also position NEAR as a leader in providing a high-performance, scalable, and secure blockchain infrastructure.

Scalability and Decentralization: Key Benefits

The enhancements brought by Nightshade 2.0 are set to massively improve the scalability of the NEAR Protocol. By optimizing single-shard performance and expanding the network’s capacity to support additional shards, NEAR is now better equipped to handle a growing number of users and transactions.

This improved scalability has direct implications for the cost of operating validators. With reduced overhead, the cost of becoming a validator is likely to decrease, lowering the entry barriers for participation. This, in turn, is expected to lead to greater decentralization, as more individuals and entities can afford to run validator nodes, further securing the network.

Implications for NEAR’s Ecosystem

The advancements in NEAR’s sharding technology with Nightshade 2.0 are poised to have a significant impact across the ecosystem. The network’s enhanced ability to support millions of users with high performance and speed is particularly beneficial for decentralized applications (dApps), decentralized finance (DeFi), and emerging areas like user-owned AI.

Moreover, the modularity and chain abstraction enabled by Nightshade 2.0 will allow developers to build more complex and scalable solutions, unlocking new possibilities for innovation within the NEAR ecosystem. Nightshade 2.0 marks a major milestone in the evolution of the NEAR Protocol, setting the stage for greater scalability, efficiency, and decentralization. By introducing stateless validation and fundamentally reworking the sharding architecture, NEAR is well-positioned to support the next generation of decentralized applications and services. As the network continues to grow, these advancements will play a crucial role in ensuring that NEAR remains at the forefront of blockchain technology.

TL;DR: Sharding Fundamentals in Blockchain Systems

Sharding divides a blockchain into smaller, independent blockchains called shards, each with its own validators. This approach enhances efficiency but introduces security challenges, as fewer validators per shard reduce security. To counter this, validators are randomly assigned to shards, with a central “Beacon chain” managing coordination. Improvements in node performance lead to exponential gains in system throughput via quadratic sharding.

State sharding, a popular approach, spreads the network’s state across shards, reducing computational, storage, and bandwidth demands but complicating cross-shard transactions. These transactions can be handled either synchronously or asynchronously, with each method having its trade-offs. Sharding also introduces potential risks, like forks and invalid blocks, requiring robust mechanisms to ensure blockchain integrity.

Strategic Significance of NEAR Sharding and Protocol Advancement

The strategic significance of NEAR’s sharding and protocol advancements cannot be overstated. These innovations are not just technical upgrades; they are the foundation that underpins all of NEAR’s narratives of AI/R&D, superior resources for recruitment and development of AI, and multi-chain infrastructure plays through AI-centric rollups. With more than 20 million monthly active users already leveraging NEAR across a diverse range of use cases, the enhanced sharding mechanism ensures that they continue to experience a high-performance and highly secure Layer 1 (L1) blockchain. This capability is crucial not only for maintaining the current user base but also for scaling the network to support hundreds of millions of users in the future. By paving the way for such massive scalability, NEAR is positioning itself as a frontrunner in the blockchain space, ready to accommodate the growing demands of a rapidly expanding ecosystem.

Why NEAR’s Latest Innovations Matter to Developers, Community, Investors, and Founders

NEAR Protocol continues to push the boundaries of blockchain technology with its latest breakthrough: the integration of stateless validation with sharding. This innovation, initially proposed by Vitalik Buterin in 2017, has been realized by NEAR in a way that promises to redefine the landscape for developers, community members, investors, and founders alike.

For Developers: Stateless validation means you can build and deploy dApps on a platform that offers unprecedented performance and scalability. The need to manage the entire state locally is eliminated, making development more streamlined and allowing you to focus on innovation. With NEAR’s goal to expand to 10 shards by the end of 2024, the platform is poised to support a vast array of high-performance dApps, ensuring that your applications can scale with demand.

For the Community: NEAR’s advancements directly contribute to a more decentralized and resilient network. Stateless validation lowers the barrier to becoming a validator, enabling more community members to participate in securing the network. As NEAR grows and evolves, the community’s role in maintaining the network’s integrity will be more crucial and accessible than ever before.

For Investors: NEAR’s technical advancements are not just about innovation — they’re about creating real, sustainable growth. The shift to stateless validation and the expansion to 10 shards will significantly enhance the protocol’s scalability and efficiency, positioning NEAR as a leading contender in the blockchain space. For investors, this means a stronger, more competitive platform that’s capable of attracting a wide range of users and applications, driving value over the long term.

For Founders: As a founder, choosing the right platform for your project is critical. NEAR’s latest developments make it an ideal choice for building the next generation of decentralized applications. The protocol’s focus on performance, security, and scalability ensures that your project can grow without being constrained by the limitations of older blockchain architectures. With NEAR’s commitment to innovation, you can be confident that the platform will continue to evolve alongside your business, supporting your success in the ever-changing landscape of decentralized technology.

By integrating stateless validation with sharding, NEAR Protocol is setting new standards in the blockchain industry. This is a pivotal moment to engage with a network that is not just keeping pace with the future but actively shaping it. Whether you’re a developer, community member, investor, or founder, NEAR’s advancements offer significant opportunities to be part of a groundbreaking movement in decentralized systems.

For more information about Nightshade 2.0, watch Bowen Wang and Illia Polosukhin’s Whiteboard Series and/or read the whitepaper for technical insights, catch the replay from yesterday’s Nightshade 2.0 launch stream or get all the latest deets here!

✍️ Written by: @noahmajor1776

About NEARWEEK

NEARWEEK is the ultimate destination for all things related to NEAR. As the official NEAR Protocol newsletter and community platform, NEARWEEK goes beyond journalism in order to actively celebrate, participate in, and contribute to the NEAR ecosystem.

NEARWEEK.com | Twitter | Subscribe to The Official NEAR Newsletter

About NEAR Protocol

NEAR is on a mission to onboard a billion users to the limitless possibilities of Web3 with chain abstraction. Leveraging its high-performance, carbon-neutral protocol, which is swift, secure, and scalable, NEAR offers a common layer for browsing and discovering the Open Web.

NEAR.org | NEAR AI | NEAR Chain Abstraction | Twitter

--

--

NEARWEEK
NEAR Protocol

The Official NEAR Protocol Newsletter & Community Platform.