Title: Programming language keyword frequencies extracted from 16,000,000 public GitHub repositories (October 2016)

Type Dataset Markovtsev Vadim (2017): Programming language keyword frequencies extracted from 16,000,000 public GitHub repositories (October 2016). Zenodo. Dataset. https://zenodo.org/record/285293

Author: Markovtsev Vadim (source{d}) ;

Links

• Item record in Zenodo
• Digital object URL

Summary

Origin

16,000,000 repositories on GitHub as of October 2016, classified with github/linguist and parsed with Pygments. Token.Keyword tokens were filtered and MapReduce-d. Fuzzy duplicate repositories were discarded.

Some languages, e.g. Haskell, are parsed wrong, resulting in many keywords. Still they were not removed since we are not familiar with such languages.

Format

Triples [language name]\t[keyword]\t[frequency]

Tabs and new lines in keywords are escaped as \t and \n respectively.

More information

• DOI: 10.5281/zenodo.285293
• ISIDENTICALTO: https://data.world/vmarkovtsev/github-lng-keyword-frequencies

Subjects

• source code, github, open source, programming, compilers, programming language

Dates

• Publication date: 2017
• Issued: February 09, 2017

Rights

• https://creativecommons.org/licenses/by-nc/4.0/legalcode Creative Commons Attribution Non Commercial 4.0 International
• info:eu-repo/semantics/openAccess Open Access

Format

electronic resource

Relateditems