Title: ThingKing: Memory Mapping the World Wide Web

Type Software Turk, Matthew J., Skillman, Samuel W., Warren, Michael S. (2014): ThingKing: Memory Mapping the World Wide Web. Zenodo. Software. https://zenodo.org/record/10773

Authors: Turk, Matthew J. ; Skillman, Samuel W. ; Warren, Michael S. ;

Links

• Item record in Zenodo
• Digital object URL

Summary

ThingKing assigns a byte-for-byte correlation between a resource on the World Wide Web (WWW) identified by its Uniform Resource Locator (URL) and a Python virtual memory buffer. The PageCacheURL class defines an LRU mechanism for caching pages from a URL, with a default page size of 1 MB and an active pool of 1024 pages. The HTTPArray class extends this model to numpy arrays, while httpfile supplies a file-like interface.

Once the URL is mapped to an HTTPArray, an application may index the array as if it was present in main memory. The interface also enables "lazy loading", using a small amount of RAM even for very large resources.

More information

• DOI: 10.5281/zenodo.10773

Dates

• Publication date: 2014
• Issued: July 07, 2014

Rights

• http://www.opensource.org/licenses/bsd-license.php BSD licenses (New and Simplified)
• info:eu-repo/semantics/openAccess Open Access

Format

electronic resource

Relateditems