Data Science

Redefine the way you work with spreadsheets. — The increasing number of plug-ins has illuminated the power of ChatGPT, or other LLMs. These plug-ins enable integration of the OpenAI API with a variety of tools, thereby facilitating the use of models that OpenAI offers, including GPT-3.5 and GPT-4. One of the tools that can be enhanced with the…

Five questions from an 1858 British school math exam — Recently I got my eyes on some examination questions from the first ever national exams set for schoolchildren by The University of Cambridge Local Examinations Syndicate in Britain in 1858. It is a source of constant debate whether school mathematics curricula and examinations are getting easier or harder, so I…

The Landscape Creating web apps entirely in Python is an enticing idea. Setting up a web app requires both frontend and backend skills such as HTML, CSS, JavaScript (and the numerous frameworks) together with Python or some other server-side language on the backend. It’s a lot of work! If instead everything could…

Ask GPT-4 to prove there are infinite prime numbers — while rhyming — and it delivers. But ask it how your company did last quarter, and it will fail miserably. This illustrates a fundamental challenge of large language models (“LLMs”): they have a good grasp of general, public knowledge, but…

How to use time series analysis and forecasting to tackle climate change — This is Part 6 of the series Time Series for Climate Change. List of articles: Part 1: Forecasting Wind Power Part 2: Solar Irradiance Forecasting Part 3: Forecasting Large Ocean Waves Part 4: Forecasting Energy Demand Part 5: Forecasting Extreme Weather Events Precision Agriculture Precision agriculture aims at improving agriculture management. To…

Quant approach to detect overfitting — Introduction to Overfitting in Trading Strategies: In the highly dynamic and unpredictable realm of financial markets, trading strategies often rely on advanced statistical models and machine learning algorithms. These powerful tools help traders to build a complex trading solutions. However, the very strength of these models — their ability to fit data — can also become…

There are so many ways you can build them… — Motivation Today, this is what I am selling: awesome_pipeline.fit(X, y) awesome_pipeline may look just like another variable, but here is what it does to poor X and y under the hood: Automatically isolates numerical and categorical features of X. Imputes missing values in numeric features. Log-transforms skewed features while normalizing the…

Shaping How AI Thinks — In the realm of human cognition, we often refer to two distinct systems of thinking: “System 1”, which is fast, instinctive, and emotional, and “System 2”, which is slower, more deliberative, and more logical. These two systems work in tandem to help us navigate the complexities of our world. Large…