Simple Tutorial to install & use GNU Parallel

How to install GNU Parallel on Centos / RHEL servers.

Image Source : wikipedia.org

You are here because you know the power of GNU parallel.. here are simple steps to install & use it.

Download Latest version of GNU Parallel

$ wget http://ftp.gnu.org/gnu/parallel/parallel-latest.tar.bz2

Unzip it, it creates a new folder

$ sudo tar xjf parallel-latest.tar.bz2

Change to new folder

$ cd 

Build the software in your machine

$ sudo ./configure && make

Install it

$ sudo make install

Switch to home directory

$ cd

$ parallel

Press Ctrl D or Ctrl C to exit the parallel.

The common use case I have is to bzip a large file using Parallels. Files with 40 millions rows (8 GB) are compressed to 400MB bz2 files.

$ cat largefile.csv | /usr/local/bin/parallel --pipe -k bzip2 --best > largefile.bz2

Analytics Vidhya

Analytics Vidhya is a community of Analytics and Data…

Analytics Vidhya

Analytics Vidhya is a community of Analytics and Data Science professionals. We are building the next-gen data science ecosystem https://www.analyticsvidhya.com

Ganesh Chandrasekaran

Written by

Principal Eng@Comcast | Adjunct Professor@Rowan University | Tech Girlz Volunteer. Thoughts and opinions are my own and don’t represent the companies I work for

Analytics Vidhya

Analytics Vidhya is a community of Analytics and Data Science professionals. We are building the next-gen data science ecosystem https://www.analyticsvidhya.com