Cooperation, Competition and the Emergence of Modularity

Photo by Vlad Tchompalov on Unsplash

“It’s something else. It has to do with organization, propagation of organization, work, and constraint construction. All of this has to be incorporated into some new theory of organization.” — Stuart Kauffman

Modularity is an essential artifact that exists in diverse ecosystems. How does it come into existence?

I don’t think we truly understand the process of evolution. If evolution did have a goal what is it? I don’t think it has a goal, but if this were the case then why does it create diversity and not uniformity? The Second Law of Thermodynamics drives towards randomness, where randomness is actually uniformity. Uniformity in the sense that you cannot distinguish one sample from another sample. It is not that the sample looks the sample, rather that the sample is equally random. Why does evolution drive in an opposite direction? With evolution, there is a richness in diversity in that a lot of stuff looks different, but not completely different. Every life form shares a common heritage. It’s not random and it is not uniform.

What I am further perplexed about is: why does evolution evolve higher level modular structures? Why does evolution evolve complex species? Why did evolution evolve you or even the parts that constitute you?

There is a related question that also arises in inanimate objects as found in physics. The universe is obviously non-uniform. Galaxies are formed and all kinds of celestial objects exists within galaxies. If it weren’t for mass (blame the Higgs boson) and gravity (blame the hypothetical graviton) then these galaxies and everything in them wouldn’t exist. If you were looking for the forces that ‘bind the universe together’, that is the fundamental forces of nature (i.e. gravity, electro-magneticism, strong nuclear and weak nuclear) you’ll find some forces that are exclusively attractive ( gravity and strong), some exclusively repulsive (weak) and both (elecgtro-magnetism). The universe consist of forces that bind and forces that repulse. The conjecture (i.e. Dark Matter) is that the sum total of the forces that bind exceeds the one than repulses.

In evolution, are there analogies to attractor and repulsive forces? What keeps things together and what breaks things up? What keeps things separated and encapsulated? There are forces in biology that lead to its diversity. These aren’t fundamental forces but something equivalent in its consequences. Could we consider cooperation and competition as a high level abstraction of these forces?

An animate object, one that is receiving stimulus to the environment and interacting with its environment, can either cooperate or compete with other animate objects. That’s the two extremes of how they can interact with other entities. It is easy to develop an intuition of why a competitive environment is the default context. That is ‘survival of the fittest’ seems to makes intuitive sense.

On the other hand, cooperation seems to be less intuitive in that it seems to require a level of sophistication that is hard to imagine for simple animate objects. Evolution however has evolved multi-cellular systems, where we have a diversity of cells cooperating together to create complex organizations. Why does evolution have the “intelligence” to create this kind of modularity? How does this kind of advanced complexity emerge?

I argue that evolution is also a learning process. Learning processes employ strategies that are a combination of either an optimization kind (sense making) or an exploratory kind (sense breaking). The evolution of modularity, whether that be a conceptual modularity or a biological modularity implies an optimization process. That is, a process that takes what currently exists and adds them together to create something newer and perhaps better. Exploration takes what currently exists, breaks them apart to create something newer and perhaps better. Perhaps creating a new modularity.

What are the benefits of modularity? Modularity is that organizational structure that encapsulates its members to act a single coordinate whole. It is the whole that is interacting with the environment and its members are cogs in the machinery of the whole. Memory fundamentally requires modularity. That is, memory requires a mechanism to persist over time. This requires an attractive and a repelling force (required for encapsulation). Therefore, modularity is what gives the evolution its memory.

Elisabeth Sahtouris has proposed a fusion of Darwin’s competitive theory and Kropotkin’s cooperative theory of evolution:

Where an evolutionary cycle of competition and cooperation leads towards more complex modularity structures. The interesting artifact of this model is in the transition between competition and cooperation (i.e. negotiation and resolution phases). This is where the costs of competition exceed the costs of cooperation. So, if evolution is a learning process, then it is a kind of learning process that involves a mechanism for switching between exploitation (competition) and exploration(cooperation). Furthermore, the notion of competition and cooperation can only make sense because of the presence of modularity.

One can get an intuitive sense of why a cooperative process may be less costly. Think of companies that acquire smaller companies with the goal of infusing newer capabilities or competing in newer markets. An acquisition strategy does make sense as a strategy for greater competitiveness. A strategy of cooperation can be perceived as a strategy of acquisition or a strategy of recruitment. In the complexity of biology, there are entities that avoid being acquired and there are entities (like viruses) that survive by being acquired.

The quest for modularity however isn’t the dominant strategy in evolution. It is rather just a niche strategy. There are many more less complex organisms that continue to exist today and have existed for eons. In fact new branches of life (phyla) are being discovered all the time:

The green section at the lower right (in the above diagram) is what we know as plants, animals and fungi. Our biosphere is teeming with extreme diversity.

Modular systems are more fragile that simpler systems. Species have over the eons have a propensity of going extinct. It is as if modularity is ultimately a non-viable and unsustainable experiment of evolution. It is as if this experiment is beating the odds and managing to persist, albeit for a very short period of time relative to the age of the universe. It is as if, modularity is just a glitch in the normal process. Cooperation that leads to modularity is a exploratory learning process. It is indeed surprising that in this exploratory process that more complex modular entities are created.

There is an alternative argument about the likelihood of complex life. The paper “Information Theory, Predictability and the Emergence of Complex Life” comes to the conclusion that “that the complexity of the guessers that can populate a given environment is determined by the complexity of the latter.” That is, prediction machines are more likely to survive in environments that match their complexity. It’s mysteriously kind of bootstrap environment where complexity begets complexity. It’s AlphaZero self-play at evolutionary scales. Evolution is the ultimate meta-learning algorithm!

Evolution and therefore advanced forms of life are just a anomaly and extremely unlikely if we were to use probability as our guide. But, unlikely does not imply impossible. In quantum mechanics, quantum tunneling is unlikely, but it does happen. This unlikely phenomena is in fact the basis of our transistor and therefore the basis of computers and the internet. In short, even the quantum unlikely has brought forth a diversity of innovation.

The massive advances in semiconductor and computer science are a consequence of modularity. The function of modularity is that it simplifies the design process in that you have modular parts that are designed for reusability. One can always design parts that are not modular and aren’t designed to easily integrate with anything. However, it is the modularity of technologies that accelerates innovation. When it becomes frictionless and permissionless to combine parts into a whole then these become the catalysts of innovation.

That is, an ecosystem that encourages rapid experimentation leads to greater innovation. The purpose of modularity is to reduce the effort of combining things. It is a cognitive construct that encapsulates complexity viewed from the exterior. It is a cognitive construct that supports adaptability originating from the interior. Innovation happens because experimentation can be done with less friction (as a consequence of loose coupling). This also implies that evolutionary creates solutions that are very messy and not necessary optimal or elegant. This reminds me of ‘worse is better’ in language design. Evolution makes use the components that are just good enough.

So let’s go back to biological evolution and use what we just learned. Biological modularity exits because it facilitates the combination of organisms to create more innovative complex organisms. It doesn’t exist because it is more probable. Biological modularity exists because it is more reusable. Evolutionary progress happens as a consequence of complexity reduction in the form of reusable and adaptable components. Modularity is that attractive force that manifests itself in biology. Modularity is evolution’s memory.

Further Reading

Multistability and metastability: understanding dynamic coordination in the brain

Learn more about Deep Learning:

Explore Deep Learning: Artificial Intuition: The Improbable Deep Learning Revolution


Exploit Deep Learning: The Deep Learning AI Playbook