Analytics Vidhya
Published in

Analytics Vidhya

Credit: EXIF Metadata
Figure 1: High-level scheme of exploration-exploitation mechanism. The model receives an instance to predict, then it decides whether to change itself (adapt itself to the drift) or to continue to exploit (predict) based on the already gained knowledge. Image credit: Author
Figure 2: The illustration exhibits the opposite phases of the exploration-exploitation concept. When the learning system is exploring, it obtains new knowledge that will serve it further on for efficient exploitation; in the phase of exploration, the exploitation process decreased since both instruments cannot be in a synchronic state. A-synchronicity underlines the suggestive to operate on both strata to gain optimality. Image credit: Author
Figure 3: Relation between the steepness of a curve and the level of the balance in the exploration-exploitation. Image credit: Author
Figure 5: The plot shows an optimal case where the balance between exploration and exploitation is 1. The optimal balance assures linearity in the riskiness curve and its stationary behavior. The fluctuations on the curve are bounded which means that there is bounded riskiness over a period. That would imply that the likelihood of the unbounded degradation on model performance is low. Image credit: Author




Analytics Vidhya is a community of Analytics and Data Science professionals. We are building the next-gen data science ecosystem

Recommended from Medium

Roadzen is Forbes Top AI Innovator Pick

Profiling and Critiquing Siri — Apple’s AI

Should we fear the rise of robots? A look at the future of AI

Emin Orhan: Learning Through the Eyes of a Child

How A Microfinance Institution Used Automation To Provide Free Healthcare To Rural Families

Think A ‘Bot’ It: Conversational AI, XR, and Fashion

background image: a woman stands in an H&M store with a mask, browsing the clothing racks and holding onto a blouse hanging before her. on the neighboring wall, shelves of handbags and shoes adorn the establishment. overlaying text: “conversational AI and fashion”

Beyond web 3.0 — Web 4.0

My talk at the inaugural Black in AI workshop dinner

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
Danny Butvinik

Danny Butvinik

Chief Data Scientist, NICE Actimize

More from Medium

Generating Business value using ALS, Cosine Similarity and Linear SVM — Part 1

Creating a Feature Store with Feast

Impact of Imbalance Data on ML Model: Fraud Transaction Case

Automatic Evidence Validation with Machine Learning