Open in app

Sign In

Write

Sign In

Biswarup Banerjee
Biswarup Banerjee

64 Followers

Home

About

Jul 27, 2020

Connecting Spark Logs with Jupyter UI

I have successfully been able to show the kernel logs in realtime into the Jupyter front end. So basically I configured the Jupyter kernel to dump the logs in real-time in a log file. Then I created a new function that runs in a separate thread and pulls the content of the log file every 2 seconds. Then the fetched data is sent to the front end via sockets every two seconds ONLY when the user opens the log. So when the user is not in the logs page the socket communication and the reading of the log file do not happen.

Gsoc

1 min read

Gsoc

1 min read


Jul 13, 2020

1.5 months later

Time flies. It feels like yesterday that I joined DiRAC virtually and now that I look back, already a month and a half! It has been a really amazing journey so far and I have learned a lot, wrote a lot of code and have worked with some really nice people. The most challenging aspect was connecting everything and putting everything together. I was working on an Ipython kernel extension, a Jupyter Notebook Front end extension, and on a python backend extension.

Gsoc

1 min read

Gsoc

1 min read


Jun 29, 2020

Launching Version 1 of Start Spark

So after 4 weeks of planning and coding and debugging, the day came when I had to launch version 1.0 of the product!

Gsoc 2020

3 min read

Launching Version 1 of Start Spark
Launching Version 1 of Start Spark
Gsoc 2020

3 min read


Jun 20, 2020

2 Weeks at DiRAC

BiWeekly GSoC Updates Blog Post In all my previous internships/contract-work I have worked with only the web stack and that too on the web front end specifically. …

Gsoc

2 min read

2 Weeks at DiRAC
2 Weeks at DiRAC
Gsoc

2 min read


May 21, 2020

Tryst with Astronomy and Computer science

When I was very young, my dad used to tell me stories of how people can float in space because of zero gravity, how brave Indian astronauts like Kalpana Chawla gave their life for the pursuit of space science and that the stars we see in the night sky are…

Gsoc 2020

4 min read

Tryst with Astronomy and Space Science
Tryst with Astronomy and Space Science
Gsoc 2020

4 min read


Sep 10, 2018

The story of my summer 2018

The summer of 2018 in Koramangla, Bangalore was undoubtedly one of the most hapenning and exciting periods of my life! I had a ton of feelings and emotions that I wanted to vent out. …

Job Hunting

7 min read

The story of my summer 2018
The story of my summer 2018
Job Hunting

7 min read

Biswarup Banerjee

Biswarup Banerjee

64 Followers

Engineer @ Panalyt.com Singapore , Google summer of code @ OpenAstronomy.org

Following
  • Tim Denning

    Tim Denning

  • Nicklas Millard

    Nicklas Millard

  • Rohan Singh

    Rohan Singh

  • Shriom Tripathi

    Shriom Tripathi

  • Pirate Nation

    Pirate Nation

Help

Status

Writers

Blog

Careers

Privacy

Terms

About

Text to speech