Big Software needs more Software Intelligence

Valtteri Halla
Mar 12, 2019 · 4 min read

What is “Big Software”?

Is it just our imagination, or has software become massive? The prevalence and scale of software is growing exponentially in tandem with the massive expansion in power of computing and networking technology. As the size of this Big Software increases, so grows the scale of risks and the need for coordination and control which are already today beyond manual management.

Just as the word Big Data is used to mean a data set with size beyond the ability of commonly used computing tools, the definition of Big Software is a system with size, complexity and dynamics beyond the comprehension and control of traditional software organizations and their methods. Like Big Data, Big Software calls for a new paradigm of more intelligent processing tools and technology. Today we live in a world where a hybrid mobile Hello World application with all its open source dependencies is composed of more than a thousand open source components and million+ lines of code! Who really knows what happens when all that code evolves on weekly basis in the open source upstream like it does?

Modern Software Supply Chain Trends Driving Big Software

The emergence of Big Software is a result of multiple parallel trends which have been cross-pollinating for more than a decade. Today a critical mass of system size is being reached in the enterprises that are leading the digital transformation of their respective industries.

Cloud Infrastructure

A massive shift towards SaaS computing on public cloud services makes adoption of new software infrastructure a degree of magnitude easier than before. This increases the size of software systems fast.


The DevOps approach and processes linking development, QA and other departments to support cross-functional development continues to spread rapidly. Additionally, the examination of code iterations for efficiency with formerly manual processes are being automated as much as possible and this automation significantly increases the amount of software being included.

Open Source Software

OSS is the foundation of modern software and makes up 80–90% of all new projects & 95% of downloads are sourced from public repositories. Additionally, the OSS enablement market continues to grow rapidly alongside the broadening use of OSS in more than 95%+ of newly developed software projects across private and public organizations.

Software Security

The demand and expectation of continuous identification and fixing of vulnerabilities is now an absolute requirement and firms have established programs that will leverage a shift to automation across vulnerability detection, revert/shutdown, deployment fix processes.

Without comprehensive software visibility and control, a tier-1 enterprise is always just one systemic vulnerability away from a security disaster, wastes scarce developer resource and is not able to competitively harness the innovation and efficiency potential available through its software ecosystem.

Why Software Intelligence?

So Big Software essentially means that we have a situation of runaway expansion. But this is not OK. We need to regain control. We at Codescoop believe that this can be achieved through broad, deep and qualitative data about our software coupled with intelligent analysis that powers automated policy application and decision making. That’s why we have developed the Codescoop technology: to provide insight into your code and to regain control over your software which has turned Big. We call this technology Software Intelligence.

Image for post
Codescoop tackles the Big Software challenge by providing a 360 degree view of your software stacks.

Software Intelligence requires Big Data about software. This means a pervasive, non-intrusive and automated process to centrally track sourcing, creation and deployment of all pieces of enterprise software. All significant attributes of software modules need to be tracked, like for example vulnerabilities, origins, commits, fixes, IP rights and obligations. Upon this foundation an enterprise can establish complete analytical insight over its software. Insight enables efficient action, and subsequently requires the automatic enforcement of local/global policies that control mission critical operations.

Codescoop Software Intelligence Platform

Codescoop Enterprise continuously gathers all possible data about software from both public sources and private sources inside the enterprise. These include source code version control and binary repositories, CI/CD systems, issue trackers, discussion and Q&A sites, employee and organization catalogues, documentation databases and numerous other sources. By combining and correlating this data Codescoop is able to provide deep insights about how companies are using code.

Because software stacks have become so large and complex, companies struggle with them in multiple ways. They need to understand what their stacks consist of, to stay up to date about which components have changed and why, and to know what is the true cost of software and products and which code puts them at risk. Codescoop helps software developers and leaders to see all this and to make informed decisions for better code quality and time to market and lower cost.

Our customers often say: “There’s a ton of software related data inside our enterprise but getting to it and making sense of it in context with our R&D decisions is really hard”. Much in the same way that Business Intelligence software assembles the scattered business data and helps companies make business decisions, Codescoop Software Intelligence solution helps engineering leaders and developers make data-driven decisions about their code based on facts.

Take a look at for more information on our Software Intelligence solution.

About the Author:

Valtteri Halla is the CTO and co-founder of Codescoop. He is an entrepreneur, occasional developer and an executive veteran who has worked with applying Open Source Software in consumer and enterprise products for over 20 years. He served Nokia for over ten years during which he pioneered the use of Open Source Software and methods in its smartphone products there. Valtteri has worked as a Director of the Intel Open Source Technology Center and has been involved in a series of startups, always deeply involved in Open Source driven product creation. Valtteri holds M.Sc. in Computer and Information Science and M.Sc. in Economics of Technology and Innovation Management and Finance and has been a passionate student and advocate of Open Source since he heard the Big Bang of the Mozilla event in 1998.


Codescoop is a software intelligence solution that provides…

Valtteri Halla

Written by

CTO and Co-founder of Codescoop



Codescoop is a software intelligence solution that provides analytics and visualizations about your organization’s code, including both your open source and private repos. Learn more at

Valtteri Halla

Written by

CTO and Co-founder of Codescoop



Codescoop is a software intelligence solution that provides analytics and visualizations about your organization’s code, including both your open source and private repos. Learn more at

Medium is an open platform where 170 million readers come to find insightful and dynamic thinking. Here, expert and undiscovered voices alike dive into the heart of any topic and bring new ideas to the surface. Learn more

Follow the writers, publications, and topics that matter to you, and you’ll see them on your homepage and in your inbox. Explore

If you have a story to tell, knowledge to share, or a perspective to offer — welcome home. It’s easy and free to post your thinking on any topic. Write on Medium

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store