Skip to content
@hsborges-msr

hsborges · MSR

Tools and datasets for mining software repositories.

hsborges / msr

Tools and datasets for mining software repositories.

Projects

Data collection

  • github-proxy-server: a proxy for collecting large amounts of data from the GitHub REST and GraphQL APIs. It rotates tokens so you stay under the rate limits.
  • github-token-donation: a small web app where people can donate GitHub tokens for our research.

Enrichment

  • geocoder: converts location text, like what people write on their GitHub profiles, into city, state and country. Available as a TypeScript library, an HTTP API and a CLI.
  • libpostal-rest-docker: libpostal address parsing as a REST service in Docker.
  • github-country-classifier: guesses a GitHub user's country from their public profile. Runs offline in Node or the browser. Demo.

Archived

  • repo-insights: a web app for exploring repository trends. No longer maintained.

Donate a token

Big studies run into GitHub's rate limits fast. If you'd like to help, you can donate a token through github-token-donation. You can see the requested scopes before authorizing, and revoke access anytime in your GitHub settings.

Contact

Maintained by Hudson Borges.

Pinned Loading

  1. github-proxy-server github-proxy-server Public

    A tool for massive data collection from GitHub APIs (Rest and GraphQL)

    TypeScript 20 6

  2. github-token-donation github-token-donation Public

    Aplicativo em NextJs para coletar tokens doados para analise de repositorios do github.

    TypeScript

  3. geocoder geocoder Public

    Turn free-form location text into structured places (city, state, country). TypeScript library, HTTP API, and bulk CLI over OpenStreetMap Nominatim, Photon, and LocationIQ.

    TypeScript

  4. github-country-classifier github-country-classifier Public

    Infer a GitHub user's country from their public profile, offline in Node or the browser. Fine-tuned multilingual-e5-small (ONNX int8, 45 MB, included): 98.8% accuracy on users with a location. Live…

    TypeScript

Repositories

Showing 7 of 7 repositories

Top languages

Loading…

Most used topics

Loading…