The Internet of Things (and the myth of the “Smart” Fridge)
As product designers, we live in exciting times. We are on the verge of another technological revolution that will change the way we live and interact with our surroundings. This technological revolution is called the Internet of Things (IoT)
The Internet of Things refers to uniquely identifiable objects or “things” that have a digital presence. There are two main categories of these objects: Identified Objects and Connected Devices. These objects or devices can be connected to one another (to create a digital ecosystem), as well as to the internet. Hence, the name, Internet of Things.
The networking giant Cisco predicts a world where 50 billion devices could be connected to the internet by 2020. Collectively, this Internet of Things will be able to provide cloud-enabled experiences that could profoundly change many aspects of everyday life, both in and out of the home. In this article, I will explore the opportunities this new world will present to us as designers. I will use the story of the mythical Smart Fridge of the future to illustrate how these devices may one day work, and to reveal insights about the tools we will need to apply as we design products for the Internet of Things.
To better understand how a future Smart Fridge may work, it’s important to distinguish between the categories of objects (the Things), and to explain their meaning.
Identified Objects
The first category is that of physical things with a digital presence, to which I will refer as “Barcode Objects” or Identified Objects, these objects will enable the future smart fridge. Let me explain. If you look in your refrigerator right now, you will find that just about every package you see has a UPC barcode printed on it. In fact, nearly every item that you purchase from a grocery store, department store and mass merchandiser has a barcode on it somewhere. A barcode, as we all know, is an optical machine-readable representation of data relating to the object to which it is attached. The retail industry uses barcodes to keep track of merchandise and to provide an easier, quicker and more accurate checkout. However, these barcodes have an obvious disadvantage in that they apply to all the same items on the shelf. So, for example, a certain brand’s shampoo contains the same barcode on all of its bottles.
Enter the radio frequency identification (RFID) tag. An RFID tag is a technology that will be embedded into retail products. For example, it could be embedded in the inside of a pair of shoes or printed on product packaging. Its purpose would be to track and identify products using radio waves. This technology will eventually replace the need for a barcode. Each RFID tag represents a unique number for each item individually, so absolute differentiation between products is possible. This number can be read by an RFID reader, which will then process the data through network connections and identify the product name, manufacturer, expiry date, etc. It’s important to note that the RFID tags I’m talking about here are passive. They would not transmit any data unless scanned by a RFID reader, which would then activate and read the RFID tags.
The appeal of the RFID technology is that it will be of massive benefit to retailers as a way to identify and track a product through its lifecycle… from the producer, through the storage, to the shop floor; It will be used to prevent theft and to maintain a real time inventory of all products in the store, sending alerts when it’s time to replace missing or expired products. Further, this technology will enable consumers to shop without standing in a checkout line. Simply by placing items into an RFID-enabled cart, the consumer will know the total cost of his groceries and will be able to pay with a swipe on a phone and a smile.
The art and science of using RFID technology is too far-reaching to go into details for the purpose of this article, but it is important to note that we already use RFID in our daily lives. For example, RFID is used in the keys that open your car door and start your engine, in the automatic payments you make as you speed through highway toll booths, in access systems in buildings, in our passports, payment cards, and even student ID cards. These items are uniquely identified and a part of the IoT ecosystem.
Just to recap, a Barcode Object (or Identified Object) is basically any retail item that uses a barcode for identification. In the future, these items will carry an RFID tag instead of a barcode, giving each item its own digital presence that will allow it to be connected to a network. Essentially, RFID technology is the conduit between the physical world and the digital world. It allows physical objects to be wirelessly identified and differentiated by computers.
Roadmap
The roadmap to a future where RFID tags replace barcodes on our food packaging is still a long way off. As of now, for one thing, the cost of RFID tagging needs to be lower than one cent per tag. Current cost averages around ten cents per tag. However, RFID technology is already in use in the retail fashion industry, as you can see in this video. The fashion industry is embracing RFID because it simply a better way to keep track of and manage inventory, specifically on higher value products like shoes or suits.
I asked Brian Hume, the Managing Director of Martec International, a leading retail research firm, when he thinks RFID tags will replace barcodes in our supermarkets and on our food packaging.
“Personally, I don’t see this happening for a long while. The reason is that the gross margin on a can of baked beans, for example, is perhaps 25c and the net margin 1c. With this kind of cost structure RFID would have to be almost free to make any sense financially. However, I do see RFID making progress in more expensive items. In Europe, for example, many supermarkets sell clothing (apparel not fashion!) and electricals like kettles, coffee machines, etc. and the margins can stand the cost. One thing that may change it though is these new Nanocircuits printers. They could print the RF coil inside laminated layers of paper and this may get the cost down to something much closer to the cost of printing a bar code.”
Connected Devices
The second category of objects in the Internet of Things is called Connected Devices. These devices inherently have a built-in network conductivity and usally require a power source to operate. We can already see these devices all around us today. For example, these are devices like a Smart Phone or a tablet, sensor-enabled devices like CubeSensors, a connected light bulb, a learning thermostat, or even a “Smart” Fridge.
These Connected Devices will become part of a digital grid that could affect every facet of our daily lives. For example, sensor devices will monitor our health, track our daily activity or remotely monitor an aging family member. A connected home will reduce our monthly utility bills, and tell us when to water our plants. Smart cities will light their streets more efficiently, receive instant reports on hazards, and even help residents find a nearby parking spot. Industries will optimize their operations and boost productivity by better tracking inventories and other assets while maintaining quality control and consistency in their products and services. The environment will be monitored for a better understanding and management of natural resources, or to send advance warnings of a pending disaster.
The myth of the “Smart” Fridge
Now for the fun part. To illustrate more clearly how Identified Objects and Connected Devices will work together in the Internet of Things, I will tell you about the Smart Fridge of the future.
In many homes the kitchen is considerd the center of the house. This is where we cook food and where our families get together to eat meals. The refrigerator is center of all that, and therefore plays an important role in our daily lives. Since 1998, when the first Smart Fridge was introduced (see the Evolution of the Fridge Computer), developers, designers and manufacturers have been imagining a future vision for the fridge and how it could change our lives. This vision, of course, is part of the greatest technological mythology of the last decade, the myth of the future Smart Fridge:
The future refrigerator will be semi-transparent, the opaque smart display will tell exactly what’s inside, so we never have to open the door if we don’t need to. Neatly organized food items will be recognized and categorized via sensors. We will be able to do things like place items on hold (e.g., reserving the carrots for Sunday dinner). As you see in the image above (from the productivity future vision video by Microsoft), leftovers will have clear expiration dates, the fridge will calculate the freshness of food and automatically create a shopping list when we’re missing or are low on essential items like milk. The Smart Fridge will even be able to order these items automatically. It will suggest recipes based on ingredients in the fridge, and will even help us maintain our diets.
A perhaps more realistic version of the future says that the Smart Fridge will manage and keep track of our food by scanning the barcodes of items (or of a shopping receipt) as we place items into the fridge. Alternatively, voice-recognition technology will enable the tracking of items by hearing us describe them. All we have to say is “three tomatoes,” “a dozen eggs,” or “cooked tomato pasta” when placing items into the fridge, which will then record the current date and add an expiration date, so we never eat stale food again (not that we would anyway!).
The Samsung T9000 “smart” refrigerator is a good example of a fridge which has software that can track its contents. It has a built-in grocery manager, which allows you to manually add food (with a drag-and-drop interface), and set a reminder and expiry date, so you never lose track of what’s in the fridge.
To read more fantastic stories about the Smart Fridge, visit LG Smart Appliances for 2012.
The Internet of Things and the Smart Fridge of the future
When I first saw the Future Vision video by Microsoft, released in 2011, in which they showcased the futuristic Smart Fridge, I thought, “It’s just a fantastic fantasy, a myth. How could something like this ever become reality?” I was then reminded of this 1957 movie which predicted that, by the year 2000, a glassed fridge would keep our food fresh for at least six months.
So what does the fridge of the future look like? Both the 1957 and the 2011 movies had it just about right. The door of the future fridge may be translucent. We won’t need to open the door to see what’s inside. The glass that could make this possible is called Smart Glass, and it’s already a reality, as you can see in this video.
What about the other part of this mythical fridge’s functionality? Will the Smart Fridge be able to manage and keep track of its contents, either manually by scanning the items, verbally with voice commands, or by using sensors? Will the Smart Fridge of the future be able to keep track of what’s inside?
Before I delve deeper into the future, I would like to pause for a moment to review some basic assumptions about how we use our fridge:
- We use it to store food and extend the food’s life span by keeping it cool.
- In an average household, members open the fridge door about 50 times a day, most often to retrieve food or place food inside.
- Interaction with the fridge is minimal and quick…open the door, close the door.
- Food is randomly placed inside a fridge, usually wherever there is an empty spot. Some food items have a spot where they are almost always placed, like a milk carton in the inside door.
So the question is, will consumers be willing to use a fridge that requires them to manually scan food or place items neatly in specific spots or in special canisters so that sensors can analyze and keep track of food? Probably not.
Convenience is a strong differentiator, and consumers will tend to adopt technology that is most convenient to their way of life. If Smart Fridge users have to scan items manually, or interact with a screen while placing food items into the fridge, the Smart Fridge will become a novelty and the added “smart” functionality will scarcely be used. That would be a shame.
So realistically, what could a Smart Fridge of the future do for us? The core functionality of the Smart Fridge, beyond the four assumptions I reviewed earlier, is to maintain, with minimum effort, an inventory list of perishable food items and their expiry dates. And when I say minimum effort, I mean no effort at all. In fact, users of the Smart Fridge will not have to change any behavior to maintain this inventory list. They would just keep using the fridge, as they've been doing for centuries since the first fridge was invented.
This is where RFID technology and the Internet of Things starts to kick in. RFID technology will eventually replace the barcode, therefore any product that has a barcode today will have an RFID tag in the future. This includes most of the food products we place in our fridge. Every product will have a unique identifier that will represent the product name and the expiry date. The smart fridge will have an RFID reader embedded in every shelf. This reader will scan for RFID tags every time the refrigerator door is opened and closed.
This technology is already here. Smart Cabinets or RFID Cabinets are used to keep track of high value products in a wide range of markets, including healthcare, medical device, biotechnology, and security. Smart Cabinet users first identify themselves with a personal key card card to open the door. Then they remove any item from the shelf. Of course, all items in the Smart Cabinet have RFID tags attached to them. Information is captured in real-time so managers always know what they have in stock.
What about fruits and vegetables or cooked food, you may ask? How can the Smart Fridge track these? And my answer is, it won’t. We don’t really need to track everything in our fridge. I also don’t think that we should rely so heavily on technology in every facet of our lives. The average person remembers when he cooked and placed leftover pasta in his fridge. If he needs to, he can always manually add this data or create a reminder about the expiry date for himself. Using the Smart Fridge should be effortless, and smart functionality should not try to change behaviors or take over our lives.
Similar to Nest, The Learning Thermostat, a thermostat that learns household users and their use patterns, the Smart Fridge of the future will also learn. This is what will make it smart. It will learn and record our average food consumption. So, for example, if we replace a milk carton every three days, the Smart Fridge will understand how much milk is left inside the carton, on average, and can send us alerts when we are low. Over time, we will be able to see the patterns of our food consumption, we can determine if we are eating healthy, or we can monitor food waste due to expired products. We will also be able to see how much we spend on our food and thus better manage our household budget.
The fun does not stop here. Mobile applications will be able to tell us in real time what we have in our fridge so we don’t have to create a shopping list before heading out to the supermarket. We will clearly see if we are low on yogurt, or we can run a search for that specialty jam we bought a few months ago but have since forgotten its name.
Durability
What else would the Smart Fridge do? In order to make it appealing to the broadest number of consumers, a Smart Fridge could have a tuch display and should be able to do everything else that smart devices are able to do today, including a media center, a photo viewer, or even a weather app. However, one thing should remain uppermost…it’s a fridge, and perhaps it should not have a built-in screen at all.
The average lifetime of a fridge is approximately fifteen years. The average lifetime of a smart device like a phone or a tablet is approximately three years. Any proposed solution should take durability of the components into account and allow future software updates and an easy way to replace or update the hardware in case of a failure. Over time, the Smart Fridge functionality will become ubiquitous. As the technology evolves, features that were once unique and useful in the early years of the device could become obsolete and/or useless. We must take into account the Kano model, which states that over time, original innovations become so widely accepted and appreciated that they become just another basic need of the consumer. Users will not surf the web or order items online while they are standing in front of a fridge. They have other devices and screens for that. Therefore, core functionality should remain the main focus of design. Maintaining an inventory of the food contents and their expiry dates. It will likely remain the Smart Fridge’s key feature for the duration of the product.
Conclusion
The story of the future Smart Fridge is just a case study, a way to illustrate how Identified Objects and Connected Devices will work together to create a new consumer product, in this case a new home appliance. Of course, the Internet of Things is much more far-reaching than just the tracking of food in our fridge. I believe that ultimately we as designers must always consider how this new technological era can benefit humanity, from reducing the ecological impact of mankind on the planet to helping people maintain healthier lifestyles. Also, as a way forward, we must be always wary and vigilant about users’ privacy and security issues. These factors are key to the marketplace’s acceptance of these new connected products and therefore will greatly advance the Internet of things.
This era will presents almost unlimited great opportunities to pioneer new territories, by innovating new products, and by creating rich interactions with technology. The work is not going to be easy, much of the road ahead is still unpaved, but it’s definitely going to be fun.
To learn more about future smart appliances, read Scott Jenson’s Deconstructing the Internet of Things.
