Problem Formulation: Choosing Between AI/ML and Traditional Programming

Dr Lim Thou Tin
DataFrens.sg
Published in
3 min readMay 9, 2024
Photo by rivage on Unsplash

There is an increasing need to focus on the critical process of problem formulation in machine learning projects, emphasizing the importance of properly defining and structuring problems that can greatly enhance the feasibility and success of AI/ML initiatives. The objective is to make problems both “understandable” and “actionable” by breaking them down into clear, manageable components that align with business needs and can be tackled by project teams. The following are the key points in problem formulation in machine learning projects. A structured approach towards problem-solving within the realms of Business Context, AI Implementation, and addressing potential Unforeseen Effects could be derived:

By outlining these elements, organizations can better align their AI initiatives with broader business objectives, manage the implementation effectively, and proactively address potential challenges. This helps ensure that all team members and stakeholders remain well-informed and engaged throughout the development process.

Generally, the AI practitioner should often need to consider the importance of assessing whether a problem is best solved using AI/ML or traditional programming methods. While AI/ML may often appear as the preferred option due to its advanced capabilities, it comes with risks such as high costs, significant time requirements, and the need for substantial, high-quality data. These factors can sometimes outweigh the benefits. Therefore, it is crucial to consider whether simpler, more conventional programming solutions could effectively address the problem without the complexities associated with AI/ML. For instance, a rule-based algorithm could efficiently route help desk tickets without the need for more complex AI/ML techniques. The decision to use AI/ML should be grounded in whether it serves the business’s core needs and offers a justifiable advantage over simpler methods.

As such, the AI practitioner will need to have a good understanding of the development approaches in both Traditional IT and AI/ML based on factors affecting their probability of success based on the problem formulation. This comparison highlights key aspects that influence outcomes in each domain, emphasizing how success can be evaluated differently across these two fields.

Traditional IT projects often hinge on clear requirements and careful planning, whereas AI/ML projects require flexibility, a tolerance for uncertainty, and a heavy reliance on the iterative exploration of data-driven insights.

Conclusively, while AI/ML offers significant advancements and capabilities, it is essential to ground decisions in pragmatic business realities. The choice between AI/ML and traditional programming should be driven by the specific context of the problem, the strategic goals of the organization, and the overall impact on operational efficiency and effectiveness. Always start with the end in mind, ensuring that the chosen technology aligns with the broader business objectives and delivers tangible benefits.

--

--

Dr Lim Thou Tin
DataFrens.sg

An IT & business strategist with a doctorate in Knowledge Management & Intelligent Systems. Experienced in corporate IT & educator at global institutions.