Running hashcat in Amazon’s AWS new 16 GPU p2.16xlarge instance

Update: New article running on AWS’s p3.16xlarge.

Amazon just released a new GPU instance for computing, P2, that can use up to 16 Nvidia Tesla K80 GPUs.

Lets try to fire one up and see how hashcat performs.


Step 1: Launch an Ubuntu 14.04 TLS p2.16xlarge instance

Step 2: Set up server

sudo apt-get update && sudo apt-get install build-essential
sudo apt-get install linux-image-extra-virtual

create the file /etc/modprobe.d/blacklist-nouveau.conf and add:

blacklist nouveau
blacklist lbm-nouveau
options nouveau modeset=0
alias nouveau off
alias lbm-nouveau off

Finish up and reboot

echo options nouveau modeset=0 | sudo tee -a /etc/modprobe.d/nouveau-kms.conf
sudo update-initramfs -u

After reboot install Nvidia drivers

sudo apt-get install linux-source
sudo apt-get install linux-headers-`uname -r`
wget http://us.download.nvidia.com/XFree86/Linux-x86_64/352.99/NVIDIA-Linux-x86_64-352.99.run
chmod +x NVIDIA-Linux-x86_64–352.99.run
sudo ./NVIDIA-Linux-x86_64–352.99.run

Finetune GPUs

sudo nvidia-smi -pm 1
sudo nvidia-smi -acp 0
sudo nvidia-smi — auto-boost-permission=0
sudo nvidia-smi -ac 2505,875

Install hashcat

sudo apt-get install p7zip-full
wget https://hashcat.net/files/hashcat-3.10.7z
7za x hashcat-3.10.7z

Here are some numbers from the hashcat benchmark.

  • MD5: 73286.5 MH/s
  • SHA512: 3226.1 MH/s
  • WPA/WPA2: 1316.2 kH/s
  • NTLM: 136.4 GH/s

Full benchmark