The Decentralized Power of Ethereum and IPFS

How to Create Immutable Files

Matt Ober
Pinata
5 min readNov 2, 2018

--

The Pinata team spent a week enjoying Prague for Devcon 4

Devcon 4 has me wanting to write about Ethereum. More specifically, how combining Ethereum with the Interplanetary File System (IPFS) creates a simple, yet powerful, system of immutable content.

This post will be a high level overview geared towards those who are just learning about Ethereum or IPFS. A more technical guide on how to utilize both of these technologies will be coming out in the near future.

The Limitation of Blockchains

Blockchains are terrible at storing large amounts of data. Seriously, they’re really bad at it. For example, depending on the cost of Ether, you’re looking at a cost of hundreds (if you’re lucky) to thousands of dollars per megabyte (MB) of data you put on Ethereum.

To put this in perspective, the average size of a photo taken on my iPhone 6 is 2–3MB. Buying a car could cost less than adding the data for one photo onto the Ethereum blockchain!

Why are blockchains so bad at storing lots of data?

It takes a lot to duplicate data across thousands of machines. When a piece of data gets added to Ethereum, the new data becomes part of a block. This means that thousands of computers around the world are working together to verify that data by coming to a “consensus”. In the context of a blockchain, consensus means that these computers agree that the data for a given block is valid, and it’s okay to move onto the next block.

Because new blocks of data have to be verified by so many different computers all at once, there’s a limit to how much new data can be processed in a given block. At Ethereum’s current rate of 15 seconds per block, the average amount of data that gets put into a new block is around 20 KB. If we refer back to our photo size of around 2MB, it would take roughly 100 blocks for me to add that data to Ethereum. Additionally, that’s assuming I somehow managed to reserve 100 blocks of data all to myself (which realistically isn’t going to happen).

The above explanation is an extreme simplification of how Ethereum works. For more in-depth explanation, check out this post by Preethi Kasireddy. It’s a great read.

What Blockchains Excel At

The consensus process is what makes Ethereum so powerful. While we can’t add a lot of data to Ethereum at once, the consensus process assures us that all data added to the chain is immutable. Once data gets put onto Ethereum, it’s there forever. You can change the “state” of a blockchain by sending tokens or executing a smart contract, but the records of all previous states still exist in previous blocks.

Ethereum allows us to timestamp data in a way that prevents data tampering.

A few examples of where tamper proof, timestamped data time can be useful:

  • Real world instrument measurements (telemetry data)
  • Signed documents
  • Security photos / video footage

But wait…if we think back to what we talked about earlier, these types of data would be incredibly expensive to store on a blockchain!

IPFS to the Rescue

IPFS helps solve a lot of problems on the modern web. It also solves a lot of problems for the new decentralized web! It turns out that by combining a blockchain with IPFS, we can timestamp much larger amounts of data than we’re able to using just the blockchain.

When data is added to IPFS, the protocol returns a hash of the data that was just added. This hash is cryptographically guaranteed to be unique to the content. If the same content is added to IPFS again, the same unique hash will be returned.

Content retrieval using IPFS works in the reverse. To retrieve content that has been stored on IPFS, the same cryptographic hash returned from the storage process is provided back to the IPFS network. Through this retrieval process, the requester of the content is cryptographically guaranteed to receive the same content that was initially uploaded to the IPFS network.

In other words, IPFS allows us to store data and then later retrieve it, with the knowledge that our data wasn’t tampered with. That’s pretty powerful.

What’s even more powerful is when we combine this with Ethereum.

Remember how blockchains allow us to timestamp data in a way that prevents data tampering? Also, remember how blockchains are really bad at doing this with large amounts of data? Well, now we can get around that limitation using IPFS.

Hashes provided back from IPFS are currently 46 bytes in size, which is 1/43478 the size of our 2MB photo from earlier. This means that an IPFS hash is magnitudes cheaper to store on Ethereum than the data itself.

So, if we wanted to timestamp a large piece of data, all we would have to do is upload that data to IPFS and then put the corresponding hash onto Ethereum.

A Real World Example

Let’s say that a company signed a rather large legal agreement. The signed PDF of that agreement was stored on IPFS and the corresponding hash was printed onto the Ethereum blockchain.

Now, let’s say there was a dispute where one party claimed the agreement had never been signed. This could easily be disproven by referencing the block where the hash of the agreement was added to the blockchain.

If all we had was the IPFS hash of the agreement, it could easily be claimed that the document was forged. After all, the document could have been added to the IPFS network at any time, not necessarily when the truthful party claimed it was. But, since the hash was added to the Ethereum blockchain at the time of upload to the IPFS network, the signed document was timestamped in a tamperproof way. And, because IPFS provides tamper-proof content retrieval, it can be proven that the content the hash points to hasn’t been altered in any way.

Conclusion

Blockchains like Ethereum and IPFS are both incredibly powerful tools. But, they both have their weaknesses.

Ethereum is really good at timestamping data but can only handle very small amounts of data at a given time.

IPFS is really good at storing data in a tamper proof way but there’s no way of proving when the data was added to the IPFS network.

When we combine Ethereum and IPFS, we gain the ability to timestamp any data we want, no matter how big the size.

--

--

Matt Ober
Pinata

CoFounder and CTO of Pinata — Building with IPFS