This is a limited proof of concept to search for research data, not a production system.

Search the MIT Libraries

Title: ropensci/arkdb: arkdb: Archive and Unarchive Databases Using Flat Files

Type Software Carl Boettiger (2018): ropensci/arkdb: arkdb: Archive and Unarchive Databases Using Flat Files. Zenodo. Software. https://zenodo.org/record/1476267

Author: Carl Boettiger (UC Berkeley) ;

Links

Summary

The goal of arkdb is to provide a convienent way to move data from large compressed text files (tsv, csv, etc) into any DBI-compliant database connection (e.g. MYSQL, Postgres, SQLite; see DBI), and move tables out of such databases into text files. The key feature of arkdb is that files are moved between databases and text files in chunks of a fixed size, allowing the package functions to work with tables that would be much to large to read into memory all at once.

v0.0.5 Changes ark()'s default keep-open method would cut off header names for Postgres connections (due to variation in the behavior of SQL queries with LIMIT 0.) The issue is now resolved by accessing the header in a more robust, general way.

More information

  • DOI: 10.5281/zenodo.1476267

Dates

  • Publication date: 2018
  • Issued: October 31, 2018

Rights

  • info:eu-repo/semantics/openAccess Open Access

Much of the data past this point we don't have good examples of yet. Please share in #rdi slack if you have good examples for anything that appears below. Thanks!

Format

electronic resource

Relateditems

DescriptionItem typeRelationshipUri
IsSupplementTohttps://github.com/ropensci/arkdb/tree/v0.0.5
IsVersionOfhttps://doi.org/10.5281/zenodo.1343942
IsPartOfhttps://zenodo.org/communities/zenodo