Carlos E. Perez·Mar 27How Can a Book be Self-Generating?What happens when you ask GPT-4 to write about Design Patterns for prompting? There’s an idea known as semantic closure that is very difficult to grasp. It’s a notion that has its roots in the investigation of biological phenomena. The idea here is that organisms have peculiar complexity as of…3 min read3 min read
Carlos E. Perez·Mar 22The New Art Known As AI WhisperingImagine a future where a novel form of art emerges, intertwining the ancient practices of katas and meditation with the cutting-edge capabilities of artificial intelligence. What if we could tap into the essence of harmony, balance, and wholeness, to create works of art that resonate with the very core of…2 min read2 min read
Carlos E. Perez·Feb 16Deep Learning Modularity and Language ModelsModularity is essential for any disruptive technology. For years deep learning lacked sufficient remix functionality to quickly customize solutions. Everything had to either be trained from scratch or fine-tuned. The latest innovations are tearing down these restrictions. Modularity allows a developer to combine an existing module with others to generate…5 min read5 min read
Carlos E. Perez·Dec 12, 2022The False Equivalence of Categorization as ThoughtThe most glaring flaw of Deep Learning is masked because our entire society has been indoctrinated into an ontology based on substance metaphysics. We assume a feature about cognition that is simply non-existent but we think is real because of our metaphysics. Let me explain! The value of deep learning…4 min read4 min read
Carlos E. Perez·Dec 12, 2022The AI Teacher Student Distillation ExperimentFade in: INT. COMPUTER LAB — DAY We see JEN and MIKE working at their computers in a bustling lab. They are discussing the progress of their latest project, a distillation model using transformers. Jen: I think we’re making great progress with the model. It’s able to fine-tune a smaller…4 min read4 min read
Carlos E. Perez·Dec 11, 2022The Origami Brain and Cognitive DepthAre you ready to have your mind blown? The parallels between Transformer models (i.e., GPT-3) and Nick Chater’s “The Mind is Flat” are too intriguing to ignore. Chater’s thesis challenges the notion of cognitive depth, arguing that our minds are actually shallow and driven by a just-in-time fluency and improvisation…8 min read8 min read
Carlos E. Perez·Dec 11, 2022How Time Travel Boostrapping Accelerates AGI DevelopmentFor over four billion years, the global biosphere has been performing massive parallel computations that have ultimately led to the emergence of humans. This incredible feat of natural computation is a testament to the complexity and resilience of life on Earth. However, it also serves as a reminder of the…14 min read14 min read
Carlos E. Perez·Dec 11, 2022The Now or Never Nature of Human ThinkingIn my humble and somewhat comedic opinion, human cognition is a strange and wondrous thing! We are all equipped with a “now or never” form of understanding that allows us to rapidly funnel information into an information bottleneck and make sense of it in the moment. …5 min read5 min read
Carlos E. Perez·Dec 11, 2022Disinformation and Paper-Clip MaximizersCancer cells are our own cells that have become ineffective at sustaining the life of the entire body and instead have opted to prioritize growth over anything else. They are paperclip maximizers of our bodies. Imagine a group of friends who are planning a trip together. Most of the friends…5 min read5 min read
Carlos E. Perez·Dec 8, 2022Balancing AGI Pessimistic and Radical ViewsGary Marcus and Joscha Bach are both researchers in the field of artificial intelligence (AI), but they have different perspectives on the state and future of the field. Marcus is known for his more pessimistic views, often cautioning against overhyping the capabilities of current AI systems and advocating for a…10 min read10 min read
