Epistemes and Entropic Ensembles

Photo by Harald Arlander on Unsplash

There are symbolic, cybernetic and connectionist movements in the world of intelligent systems. Symbolic movements had their taste of success early on. It was more structured and semantic. Connectionist movements were more empirical and esoteric. Cybernetic movement was more strategic and dynamic and lost its sheen and sharpness over the due course of time. Despite the criticisms on the empirical nature, connectionist movement has gained popularity and practice over the period of time.

This is an attempt to decipher the deep representations of knowledge underneath languages and linguistic structures and come out with an understanding on the success of connectionist and complexity driven systems of intelligence. At this juncture, when we are encountering various complexities associated with Artificial General Intelligence, it is worth looking at the fundamental nature of knowledge and knowledge reasoning systems itself.

At the outset knowledge never gets centralized in any corpus of language. It just emerges through every act of reasoning and rationality. Knowledge just gets crystallized into symbols and signs. It goes through cycles of deterministic reasoning and randomized crystallization. The cycles of reasoning happens through implicit zones of culture. It is quite ephemeral and effervescent. We see the formation of symbols and signs more vividly. Due to…