Simple Tutorial to install & use GNU Parallel

How to install GNU Parallel on Centos / RHEL servers.

Image Source : wikipedia.org

You are here because you know the power of GNU parallel.. here are simple steps to install & use it.

Download Latest version of GNU Parallel

$ wget http://ftp.gnu.org/gnu/parallel/parallel-latest.tar.bz2

Unzip it, it creates a new folder parallel-yyyymmdd

$ sudo tar xjf parallel-latest.tar.bz2

Change to new folder

$ cd parallel-yyyymmdd

Build the software in your machine

$ sudo ./configure && make

Install it

$ sudo make install

Switch to home directory

$ cd

How to Test Parallel ?

$ parallel

Press Ctrl D or Ctrl C to exit the parallel.

Use Case

The common use case I have is to bzip a large file using Parallels. Files with 40 millions rows (8 GB) are compressed to 400MB bz2 files.

$ cat largefile.csv | /usr/local/bin/parallel --pipe -k bzip2 --best > largefile.bz2

Ganesh Chandrasekaran

Written by

Sr. Engineer @ Comcast | Adjunct Professor @ Rowan University | Tech Girlz Volunteer. Thoughts and opinions are my own and don’t represent companies I work.

Analytics Vidhya

Analytics Vidhya is a community of Analytics and Data Science professionals. We are building the next-gen data science ecosystem https://www.analyticsvidhya.com

More from Analytics Vidhya

More from Analytics Vidhya

More from Analytics Vidhya

The Illustrated Word2vec

Welcome to a place where words matter. On Medium, smart voices and original ideas take center stage - with no ads in sight. Watch
Follow all the topics you care about, and we’ll deliver the best stories for you to your homepage and inbox. Explore
Get unlimited access to the best stories on Medium — and support writers while you’re at it. Just $5/month. Upgrade