GSoC 2024 students’ weekly reports #2 and #3
Two weeks ago, we shared the first week reports from our Google Summer of Code and Code4GovTech’s DMP program students. Here, we are sharing their updates on progress made over the past two weeks.
We’ve received the following reports, which are divided into the following sections: Music Blocks project reports, Sugarizer, Pippy, Chat, Math, and Raspberry Pi.
Music Blocks project reports
Make your own lesson plans
Khadar shared his latest work on Make Your Own Lesson Plans, a project to use generative AI to create lesson plans for Music Blocks. The past few weeks, he has been tuning the model to speak at a level that a kid would understand. The tests also exposed that the musical examples are too varied, and change quite often, so he is working to make those more focused.
Khadar created a repository specifically for this project, which can be found here: https://github.com/khadar1020/Musicblocks-AI
You can read his full post here: https://medium.com/@khadarvsk/week-2-update-in-the-coding-period-for-gsoc-with-sugar-labs-bdba4b45ee1f
Musical ideation through LLMs
Abhijeet Singh has made progress with his work to import ABC notation into Music Blocks, generating Music Blocks code. His latest work parses the code such that it can put repeats in the right places. https://medium.com/@vayuabhijeet/looking-at-repeat-block-in-music-block-code-coding-period-iii-8bb61209148d
Some test results were shared on Matrix, which, if you are on Matrix or sign up, you can read here: https://matrix.to/#/!leczFRLARMQIeUpVdG:matrix.org/$o2f25vZ4pZeEiMgbj3ED6rPxTiD0RI4qGpFaRFVcdRA?via=matrix.org&via=gitter.im&via=srev.in
Musical creation and transcription assistance via generative AI
Mubashir Shariq has been making progress on MIDI import into Music Blocks, which is similar to ABC import but, because MIDI handles data differently, is a different challenge.
You can read his week two progress here: https://medium.com/@mubashirsharik01/coding-period-2-leveraging-fastapi-and-basic-pitch-74b203e32594; and week three progress here: https://medium.com/@mubashirsharik01/google-summer-of-code-with-sugar-labs-week-3-9e99d1fe05b0
You can see his latest pull request here: https://github.com/sugarlabs/musicblocks/pull/2424
While doing research on this, we discovered a few notable references, which we’ll add here for anyone who is interested:
- https://mido.readthedocs.io/en/latest/meta_message_types.html#time-signature-0x58
- https://archives.ismir.net/ismir2016/paper/000105.pdf
Masonry for Music Blocks v4
Karan Palan shared his week 1 & 2 progress on the following blog: https://musicblocks.net/2024/06/19/gsoc-2024-with-sugar-labs-community-bonding-week-1-2-music-blocks-v4-project-updates/
Add real-time collaboration in Music Blocks
Ajeet is working on real-time collaboration of Music Blocks projects. You can read about his work on https://github.com/apsinghdev/DMP/blob/main/week-1.md and on https://medium.com/@apsinghdev/week-2-setting-up-the-server-66892f8626bf
Sugarizer GSoC Projects
3D Volume Activity
The following is the latest report from Samarth Bagga, which was sent to the Sugar Labs GSoC mailing list:
- https://lists.sugarlabs.org/archive/gsoc/2024/000428.html
- https://lists.sugarlabs.org/archive/gsoc/2024/000430.html
Migration to i18next-vue
The following is the latest report from Utkarsh Siddhpura, which was sent to the Sugar Labs GSoC mailing list:
Pippy, Chat, Math, and Raspberry Pi
And lastly, here are some bullets of the work done over the past couple weeks for the other projects this summer:
- Qixang Wang shares his work on AI-integration for our Chat activity: https://medium.com/@qxwang27/gsoc-weekly-update-an-attempt-to-integrate-with-google-gemma-de925979f8cb; and you can follow the testing here: https://docs.google.com/spreadsheets/d/1SjFMaEsKpth6p9Cfa9xMrgpQ2vzeYr_-SzmOIm4JRSg/edit?gid=0#gid=0
- Kshitij Shah shares his work on a Python assist here: https://github.com/kshitijdshah99/Pippy_Activity/blob/main/Weekly%20Blogs/Week%202.md; and you can see his RAG model here: https://colab.research.google.com/drive/1W_LH4tUg9LoCq_TDohXS0BTnhw-QRBuh#scrollTo=i_Hu3J54gzXd
- Vaibhav Shah is working on a Tower of Hanoi game. His week 2 blog post is here: https://github.com/vaibhav-sangwan/DMP/blob/main/week-2.md; and you can track the code here: https://github.com/vaibhav-sangwan/tower-of-hanoi
- Spandan Barve is working on a NIM game. You can read about the progress and watch some demonstration videos here: https://github.com/marsian83/GSoC-24-report/blob/main/week-2.md
- Anurag Singh is working on Raspberry Pi projects. We are currently awaiting a report, but you can see his code here: https://github.com/users/Ovalelephant35/projects/2
Live progress reports and demonstrations on YouTube
On June 7 and 14, we hosted all our GSoC students to show us what they will be working on this summer. These events are broadcast live, but you can still watch them here:
- https://www.youtube.com/live/PeIS3gXPFj0?feature=shared (Music Blocks projects)
- https://www.youtube.com/live/k7eY-tkl2zw?feature=shared (Sugarizer, Pippy, Chat, Math, and Raspberry Pi)
In July, we will be following up to this on July 5 and 12 with the students presenting their current progress. July 5 will be for Music Blocks and Sugarizer projects, and July 12 will be for Pippy, Chat, Math, and Raspberry Pi projects. We learned a lot from their presentations, and you hope you will, too.
More to come
As mentioned last week, we’re asking GSoC contributors to write regular blogs, send in reports, attend meetings, and even present for our series of online events on YouTube, as mentioned in the previous section.
We’re doing this so that the students can document their process and learn more about their own learning. We also expect that it will help others get involved in Sugar Labs, as well as to help future contributors, who may be building upon the work of this year’s students. Please join us in giving the students a big round of applause (i.e. smash that clap button).