Title: huggingface/transformers: Patch v2.5.1: AutoTokenizer slow by default, bug fixes

Type Software Thomas Wolf, Lysandre Debut, Julien Chaumond, Victor SANH, Aymeric Augustin, Rémi Louf, Funtowicz Morgan, Stefan Schweter, Denis, erenup, Patrick von Platen, Matt, Piero Molino, Grégory Châtel, Sam Shleifer, Tim Rault, Bram Vanroy, MOI Anthony, Malte Pietsch, Catalin Voss, Bilal Khan, Julien Plu, Fei Wang, Louis Martin, Manuel Romero, Davide Fiocco, dhanajitb, Jinoo, Clement, Ananya Harsh Jha (2020): huggingface/transformers: Patch v2.5.1: AutoTokenizer slow by default, bug fixes. Zenodo. Software. https://zenodo.org/record/3686303

Authors: Thomas Wolf (@huggingface) ; Lysandre Debut (Hugging Face) ; Julien Chaumond (Hugging Face) ; Victor SANH (@huggingface) ; Aymeric Augustin (@canalplus) ; Rémi Louf ; Funtowicz Morgan (HuggingFace) ; Stefan Schweter ; Denis ; erenup ; Patrick von Platen ; Matt ; Piero Molino ; Grégory Châtel (DisAItek & Intel AI Innovators) ; Sam Shleifer (Huggingface) ; Tim Rault (@huggingface) ; Bram Vanroy (@UGent) ; MOI Anthony (Hugging Face) ; Malte Pietsch (deepset) ; Catalin Voss (Stanford University) ; Bilal Khan ; Julien Plu (Leboncoin Lab) ; Fei Wang (University of Southern California) ; Louis Martin ; Manuel Romero ; Davide Fiocco ; dhanajitb ; Jinoo ; Clement (@huggingface) ; Ananya Harsh Jha ;

Links

• Item record in Zenodo
• Digital object URL

Summary

AutoTokenizer

AutoTokenizer has been put back to False by default so as to not have a breaking change between 2.4.x and 2.5.x

Bug fixes

Bug fixes related to batch_encode_plus

More information

• DOI: 10.5281/zenodo.3686303

Dates

• Publication date: 2020
• Issued: February 24, 2020

Rights

• info:eu-repo/semantics/openAccess Open Access

Format

electronic resource

Relateditems