The Role of Data Collection and Big Data in Military War Planning

Simon Jang
CISS AL Big Data
Published in
7 min readNov 20, 2023
Fig. 1: President Obama and Vice President Biden hold a meeting with combatant commanders and military leadership in Cabinet Room, November 12, 2013 (White House/Pete Souza).

“There were 5 exabytes of information created between the dawn of civilization through 2003, but that much information is now created every two days.” — Eric Schmidt Executive Chairman at Google.

Data is constantly generated a collected in the modern era by everything. Data has become a crucial asset in various domains, including the military. The collection and analysis of data play a pivotal role in shaping military strategies and decision-making processes. This article explores the question of how data is collected in the military and delves into the utilization of Big Data for the military and its creation of war plans, as seen in Fig. 1.

Data Collection in the Military

Data collection in the military encompasses various sources and methods. One of the primary sources is intelligence gathering, which involves collecting information from multiple channels such as satellites, reconnaissance missions, human intelligence, and intercepted communications. These sources provide valuable insights into enemy capabilities, intentions, and vulnerabilities. For example, during the Gulf War in 1991, the U.S. military relied heavily on satellite imagery to gather intelligence on Iraqi military positions, infrastructure, and troop movements. Such as the data collected from the French SPOT satellite that was used to detect and monitor troops massing along an international border, near a demarcation line, or at key transportation nodes deep within a country (Gupta et al.). This data helped in planning airstrikes and ground operations with precision as well as the war planning that was involved later on.

Fig. 2: GCHQ in Cheltenham, Gloucestershire.

Additionally, military databases store vast quantities of data, including historical records, geographical information, and personnel files. These repositories allow for the retrieval and analysis of critical information that can shape military operations. Take the example of the NSA (National Security Agency) as of 2013 reported to contain at least 5 zettabytes of data storage at its data center in Utah (“Booting Up: New NSA Data Farm Takes Root in Utah”). Government Communications Headquarters (GCHQ), seen in Fig. 2, is an intelligence and security organization responsible for providing signals intelligence (SIGINT) and information assurance (IA) to the government and armed forces of the United Kingdom, can collect has access to 10 gigabits of data a second, or 21 petabytes a day (Kadhim Shubber).

Moreover, advancements in technology have revolutionized data collection in the military. A prime example would be the US Air Force E-8 Joint STARS (Surveillance Target Attack Radar System) which conducts airborne ground surveillance; collects data on enemy positions, vehicles, and aircraft, collects imagery, and relays tactical pictures to ground and air theater commanders. Additionally, unmanned aerial vehicles (UAVs) and reconnaissance drones equipped with sophisticated sensors enable real-time data acquisition, surveillance, and reconnaissance. These tools provide military planners with an up-to-date understanding of the battlefield, enhancing situational awareness. Such as the Northrop Grumman RQ-4 Global Hawk, a remotely piloted surveillance aircraft part of many air forces that provides a broad overview and systematic surveillance using high-resolution synthetic aperture radar (SAR) and electro-optical/infrared (EO/IR) sensors. Both manned and unmanned aircraft serve similar purposes, however, the UAV provides greater flexibility in terms of operational capability as well as the concern for the safety of the pilots and crewmen.

The Role of Big Data in Military War Planning

Big Data refers to the massive volume of structured and unstructured data that cannot be easily processed by traditional methods. In military war planning, Big Data analytics plays a vital role in converting raw data into actionable intelligence. Here are some key ways in which Big Data is utilized: Predictive Analysis, Situational Awareness, Threat Assessment, Decision Support, and Logistics Optimization.

Big Data enables military planners to identify trends, patterns, and anomalies. By analyzing historical data and real-time information, predictive models can be developed to anticipate enemy behavior, identify potential threats, and forecast outcomes of military operations. For instance, the U.S. Department of Defense utilizes Big Data analytics to predict insurgent activity in conflict zones. By analyzing a wide range of data, including social media feeds, communications intercepts, and local demographics, the military can identify areas at high risk of insurgent activity and allocate resources accordingly.

Additionally, it enhances situational awareness on the battlefield. By aggregating and analyzing data from various sources, military commanders gain a comprehensive understanding of the operational environment. This includes information about terrain, weather conditions, enemy movements, and friendly force locations. During the Battle of Fallujah in 2004, the U.S. Marines employed Big Data analytics to create a detailed 3D model of the city. By integrating data from satellite imagery, UAVs, and ground-based sensors, the Marines had a real-time, comprehensive view of the battlefield, allowing them to plan and execute operations with precision.

Also, Big Data analytics assists in assessing threats by extracting relevant information from vast amounts of data. It enables military planners to identify emerging threats, understand their capabilities, and develop countermeasures accordingly. This proactive approach helps in mitigating risks and enhancing operational effectiveness. In the realm of cybersecurity, Big Data analytics is used to detect and respond to cyber threats. By analyzing network traffic, system logs, and user behavior, military organizations can identify potential cyberattacks, detect anomalies, and take appropriate defensive measures.

Fig. 3: S. Army’s Command Post Computing Environment (CPCE).

Further, Big Data provides decision-makers with timely and accurate information for effective decision-making. By consolidating and analyzing diverse data sets, military leaders can evaluate multiple scenarios, assess risks, and make informed choices regarding troop deployments, resource allocation, and mission planning. The U.S. Army’s Command Post Computing Environment (CPCE) is an example of how Big Data analytics supports decision-making, as seen in Fig. 3. CPCE integrates data from various sources, including intelligence reports, sensor feeds, and logistical information, into a single platform. This allows commanders to have a real-time, holistic view of the battlefield and make data-driven decisions.

Lastly, it aids in optimizing military logistics. Logistics is the backbone of any military; without it, the military is rendered inoperable. Just looking at the Russian military during its invasion of Ukraine, most military analyst agrees that one of the major factors for its failure to capture Kyiv was Russia’s lack of a functioning logistical support system (“Institute for the Study of War”). By analyzing historical data on supply chains, transportation routes, and maintenance records, military planners can identify bottlenecks, streamline operations, and improve resource utilization. This optimization helps ensure that troops and supplies are deployed efficiently and effectively. The UK Ministry of Defence (MOD) utilizes Big Data analytics to optimize its logistics operations. By analyzing data on fuel consumption, maintenance schedules, and transportation routes, the MOD has been able to reduce costs, improve efficiency, and enhance the readiness of its forces.

Fig. 4: A Leer-3 command truck and drone pictured at a Russian military exhibition. (Vitaly Kuzmin)

During the Russo-Ukrainian War, there have been multiple applications of Big Data. The biggest application stemming from mobile networks, both sides of the conflict are utilizing a device called cell-site simulators to track phone calls and locate the position where the calls are being made. When they gather enough data, they can locate the position of high-ranking officers or headquarters of the enemy position and fire an artillery strike on that location (Devine), as seen in Fig. 4.

Challenges and Considerations

While Big Data offers significant advantages, it also presents challenges and ethical considerations. Data security and privacy remain paramount concerns as militaries collect and store vast amounts of sensitive information. Safeguarding this data against cyber threats and unauthorized access is crucial. Another challenge is the integration and interoperability of diverse data sources. Different military branches and agencies may use disparate systems, making it essential to establish data standards and frameworks for seamless data sharing and collaboration. Additionally, ethical considerations arise regarding the use of data in military operations. Questions of proportionality, accountability, and the potential for biased decision-making require careful attention to ensure the responsible and ethical use of Big Data in warfare.

Conclusion

Data collection and analysis are integral to modern military operations. The utilization of Big Data and advanced analytics provides militaries with unprecedented capabilities in war planning. By harnessing the power of data, military leaders can enhance situational awareness, predict enemy behavior, optimize logistics, and support decision-making processes. Real-life examples, such as satellite imagery in the Gulf War, the use of Big Data in predicting insurgent activity, and the optimization of logistics by the UK Ministry of Defence, illustrate the practical applications of data-driven approaches in the military. However, it is crucial to address challenges related to data security, interoperability, and ethical considerations to ensure responsible and effective utilization of Big Data for military purposes.

Citations:

1. “23 Must-Read Quotes about Data [& What They Really Mean].” CareerFoundry, 22 Apr. 2021, careerfoundry.com/en/blog/data-analytics/inspirational-data-quotes/. Accessed 16 Nov. 2023.https://www.sandia.gov/app/uploads/sites/148/2021/07/sand98-85973-2.pdf

2. Gupta, Vipin, et al. Detecting Massed Troops with the French SPOT Satellites a Feasibility Study for Cooperative Monitoring.https://www.sandia.gov/app/uploads/sites/148/2021/07/ sand98–85973–2.pdf

3. “Booting Up: New NSA Data Farm Takes Root in Utah.” NPR, 23 Sept. 2013, www.npr.org/sections/alltechconsidered/2013/09/23/225381596/booting-up-new-nsa-data-farm-takes-root-in-utah#:~:text=NSA%20whistle%2Dblower%20William%20Binney,yottabyte%2C%20or%20250%20trillion%20DVDs. Accessed 16 Nov. 2023. ‌

4. Kadhim Shubber. “A Simple Guide to GCHQ’s Internet Surveillance Programme Tempora.” WIRED UK, WIRED UK, 24 June 2013, www.wired.co.uk/article/gchq-temporal-101#:~:text=Interceptors%20have%20been%20placed%20on,or%2021%20petabytes%20a%20day. Accessed 16 Nov. 2023. ‌

5. “Institute for the Study of War.” Institute for the Study of War, 2022, understandingwar.org/backgrounder/russian-offensive-campaign-assessment-march-21. Accessed 16 Nov. 2023. ‌

6. Devine, Kieran. “Ukraine War: Mobile Networks Being Weaponised to Target Troops on Both Sides of Conflict.” Sky News, Sky, 29 Mar. 2022, news.sky.com/story/ukraine-war-mobile-networks-being-weaponised-to-target-troops-on-both-sides-of-conflict-12577595. Accessed 16 Nov. 2023. ‌

--

--