Information Theory. Why it Matters.

The broad application of Information Theory is perhaps the most astonishing aspect of this branch of knowledge. From language processing to data analysis, Information Theory is not simply limited to computer applications, but how is this so?

Aftab, Cheung, Kim, Thakkar, and Yeddanapudi (2001) explained that “In 1948, Shannon published his paper “A Mathematical Theory of Communication” in the Bell Systems Technical Journal. He showed how information could be quantified with absolute precision, and demonstrated the essential unity of all information media. Telephone signals, text, radio waves, and pictures, essentially every mode of communication, could be encoded in bits” (p. 3) . Claude Shannon has been called the father of the Information Age because he asserted this unity, and because an ability to transfer all communication to bits engendered something of a self-fulfilling prophecy.

Shannon’s paper actually contained four major concepts that shaped the impact of Information Theory. They are a bit technical and wordy for the scope of this piece, but his work dealt with compressing information, the speed limits of accurate data transmission, and the impact of “entropy” or unexpected data, in the transmission of information (Aftab et al., 2001, p. 6).

Shannon’s ideas provided something of a roadmap for where technology could go. Aftab, Cheung, Kim, Thakkar, and Yeddanapudi (2001) noted that Information Theory “has strongly influenced not only the development of wireless systems, CDs, and data storage, but also computer networks, satellites, optical communication systems, mobile phones, MP3s, JPEGs, and of course, the Internet” (p. 23). While Information Theory is obviously very technical for a laymen it is not that difficult to see why it is so impactful. The field’s implications for modern disciplines and technologies are apparent, but, his initial ideas helped people to understand the transferability of information. A message, a piece of entertainment, or any data could be transferred as 1s and 0s regardless of its original medium. It is almost hard to conceive of a world where this was not readily understood and this perhaps contributes to the difficulty in understanding the importance of Shannon’s ideas.

Works Cited

Aftab, O., Cheung, P., Kim, A., Thakknar, S., & Yeddanapudi, N. (2001) . Information theory and the digital revolution. Retrieved from http://web.mit.edu/6.933/www/Fall2001/Shannon2.pdf