Typical Life Cycle of ML Model

Laxman Singh
Nov 22 · 3 min read

Cross industry standard process for Data Mining (CRISP-DM)

Crisp-DM suggests steps which will be iteratively implemented to have final model in production. Inside modeling there are some steps which is followed to and fro to get ready with your model. Once the model is ready, then only it can move to evaluation steps.

Crisp-DM — Basics to understand and follow to build perfect ML models
Crisp-DM — Basics to understand and follow to build perfect ML models
Crisp DM : Phases, can be correlated to other Software engineering life cycles

Phases of Crisp-DM
1. Business Understanding
As a name suggests, we should now the problem statement. And, we should have SME for the problem to guide.
2. Data Understanding
Once the problem statement is clear, most important phase starts with collecting data. When we collect data, we have to identify whether it correlates to our porblem statement or not.
3. Data preparation
Data preparation includes cleansing and transforming. You apply various techniques to finalize features like PCA / SVD etc. For PCA understanding, you can go through the below:

4. Modeling
Once our data is prepared and ready, time has come to put this data to train the model. Here we train the model, generate the model and save the model for further usage.
5. Evaluation
Evaluating the model is very important step. Here, we decide that trained model is good enough to prepare to go to production. We use different evaluation techniques to understand whether our model is good enough to be live. Confusion matrix is one of them, you can increase your understanding on confusion matrix and some of the important formulas to evaluate model:

6. Deployment
Finally, deployment to the production environment and maintenance will start. And, we end up reiterating steps from 3–6 over the period to outperform our old model with new model.

As we have overview of Crisp-DM phase, now time to go through the most important phase i.e, modeling. In simple words, we can say that there are set phases in Crisp-DM and inside this, one of the important steps is to do train the model. In my view, data preparation and train the model are both the backbone of data mining. So, I would like to brief down the steps or iterative steps to be followed to come up with more matured model to generalize better. So, we generally perform below steps iteratively to have final model prepared to be used for test data:

  1. Initialization the weights
    It could be any random initialization and training based on the data will take care to come up with the finalized weights required to generalize test data better.
  2. Forward Propagation
    a. Sum the production: Multiply weight vector with input vector
    b. Put the sum through activation function e.g, sigmoid
  3. Backward Propagation
    a. Compute the errors, i.e. difference between expected output and predictions
    b. Multiply the error with the derivatives to get the delta
    c. Multiply the delta vector with the inputs, sum the product
  4. Optimizer takes a step
    a. Multiply the learning rate with the output of step 3c
  5. Repeat Step 1–4, till it is desired or converge

So, above are the phases of Crisp-DM and then the steps followed to improve the model to converge. In my view, forward and backward propagation requires little more depth knowledge to understand the process of training the model. And, both are so important that they require a separate attention and I will come up with a blog for the same. In the meantime, you apply the above into practice and see the principles help to prove yourself better or not. Happy Coding!

Analytics Vidhya

Analytics Vidhya is a community of Analytics and Data…

Sign up for Analytics Vidhya News Bytes

By Analytics Vidhya

Latest news from Analytics Vidhya on our Hackathons and some of our best articles! Take a look

By signing up, you will create a Medium account if you don’t already have one. Review our Privacy Policy for more information about our privacy practices.

Check your inbox
Medium sent you an email at to complete your subscription.

Laxman Singh

Written by

Machine Learning Engineer with 15 years of Experience in IT and MTECH in AI from NUS, Sg

Analytics Vidhya

Analytics Vidhya is a community of Analytics and Data Science professionals. We are building the next-gen data science ecosystem https://www.analyticsvidhya.com

Laxman Singh

Written by

Machine Learning Engineer with 15 years of Experience in IT and MTECH in AI from NUS, Sg

Analytics Vidhya

Analytics Vidhya is a community of Analytics and Data Science professionals. We are building the next-gen data science ecosystem https://www.analyticsvidhya.com

Medium is an open platform where 170 million readers come to find insightful and dynamic thinking. Here, expert and undiscovered voices alike dive into the heart of any topic and bring new ideas to the surface. Learn more

Follow the writers, publications, and topics that matter to you, and you’ll see them on your homepage and in your inbox. Explore

If you have a story to tell, knowledge to share, or a perspective to offer — welcome home. It’s easy and free to post your thinking on any topic. Write on Medium

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store