How to import Kaggle data in Google Colab
Why do we need to use Kaggle dataset in google Colab when we can train model in Kaggle itself?
- To use GPU and TPU of Colab if we have completely used Kaggle quota.
- To use interactive IDE of Colab where we have excellent code auto-completion, latest versions of Tensorflow and other frameworks.
- To run many training processing as we can use only a limited number of notebooks in Kaggle.
Steps:
you can watch this video for proper explanation or read this full article
- Create Kaggle API key:
Go to Kaggle account section and click on create New API Token
it will download one json file kaggle.json which contains you api key, don’t share this file with anyone.
2. Upload kaggle.json in Google Drive:
In google drive create one folder named Kaggle in My Drive, inside that Kaggle folder upload kaggle.json file
3. Download Kaggle data in drive and use in colab:
in colab run following code
from google.colab import drive
drive.mount('/content/gdrive')
this will connect your colab with drive, to do that a pop-up will come and it will ask some permission, allow those permissions.
then run
import os
os.environ["KAGGLE_CONFIG_DIR"] = '/content/gdrive/MyDrive/Kaggle'
it will set Kaggle configure directory to your Kaggle folder in drive
Now go to Kaggle directory
%cd gdrive/MyDrive/Kaggle
Go to the kaggle dataset and copy kaggle api command
for example titanic data api
run following code
!kaggle competitions download -c titanic
it will dowaload kaggle data in zip format
unzip data
!unzip titanic.zip -d titanicDataset
here I have unzipped data in titanicDataset folder
go to titanicDatset folder
%cd titanicDataset
now you can read titanic data
import pandas as pd
df = pd.read_csv("train.csv")
df.head()
Using this method you can download any data i.e. image, video, audio..
But remember there is limit in google drive, in my case it is 15 GB so you can download large data
watch this tutorial on YouTube here
If you have used this tutorial to learn something than clap for this tutorial and give response, if you are getting any problem let me know.
Join our Telegram channel for more updates, study resources and discussion