Libraries.io March Progress Update
Continuing from last month with the regular progress updates on Libraries.io since securing a grant from both the Sloan Foundation and the Ford Foundation, here’s what we got up to in February 2017.
Notable Features
Documentation - The first week of March we be continued our documentation push, getting involved in Docathon.
Many improvements were made to our documentation repo, bringing the all the old wiki content over as well as adding new docs on Personas and documenting how to add support for a package manager to Libraries.io.
Upgraded infrastructure - We had two big projects start using the Libraries.io API this month, Visual Studio and Glitch, both of which utilize the unified package manager search functionality.
This started to put a strain on our already overloaded Elasticsearch cluster so this month we spent some time upgrading key pieces of infrastructure to handle the higher loads without slowing the site down.
This included upgrading ruby to 2.4.0 on all machines and elasticsearch from 1.7 to 2.4 on our cluster, all done automatically via the growing collection of ansible playbooks in our infrastructure repo.
Release and diff urls for versions and tags - For projects that have their source hosted on GitHub, GitLab or Bitbucket and push tags their when they release new versions we can do some cool things:
- Link to view the changelog or browse source for the tagged release: https://github.com/splitrb/split/releases/tag/v2.2.0
- Link to a diff between the current and previous version: splitrb/split@v2.1.0…v2.2.0
This month we added those links for versions and tags on projects and tags on repositories with a slightly redesigned list view:
Other Notable Changes
We started using Appsignal for performance monitoring which has already helped us improve the performance of many of the background jobs we run:
Ben added contribution notices around the site to encourage people to add support for other package managers if they can’t find what they are looking for.
Jon has been refactoring the code we use for monitoring the GitHub firehose and the many RSS/JSON feeds of new/updated packages to make it more efficient and less coupled to the sidekiq work names that we use.
Improvements to testing setup, removes a lot of boilerplate and recorded webmock requests, making it easier to add and change tests for everyone.
Switched from redcarpet to commonmarker for markdown rendering in readmes to support the official spec for GitHub Flavored Markdown.
Team page
A full list of all changes right across the Libraries.io org on GitHub is available in this gist, generated by: https://github.com/librariesio/org-pulse
Statistics
37,187 new libraries and 401,341 new versions found, bringing the total to 2,194,374 libraries indexed.
446 commits, 30 pull requests and 182 issues opened across all Libraries.io repositories on GitHub: https://github.com/librariesio
Contributors
This month we had a quite a few patches from outside contributors whom we would like to thank:
Plans for April
In April I’m planning on finishing up some last bits of GitLab and Bitbucket support, then revisiting the support we have for each package manage, documenting it and filling in the gaps where we’re missing bits.
As always, follow us on Twitter at @teabass, @benjam and @librariesio for more updates.
