Title: huggingface/transformers: Bug fixes related to input shape in TensorFlow and tokenization messages

Type Software Thomas Wolf, Lysandre Debut, Victor SANH, Julien Chaumond, Rémi Louf, Denis, erenup, Matt, Stefan Schweter, Piero Molino, Grégory Châtel, Tim Rault, Catalin Voss, Fei Wang, Louis Martin, Malte Pietsch, Davide Fiocco, dhanajitb, Jinoo, Ananya Harsh Jha, Simon Layton, yzy5630, Yongbo Wang, Shijie Wu, Nikolay Korolev, Juha Kiili, Guillem García Subies, Joel Grus, Jade Abbott, Clement (2019): huggingface/transformers: Bug fixes related to input shape in TensorFlow and tokenization messages. Zenodo. Software. https://zenodo.org/record/3560969

Authors: Thomas Wolf (@huggingface) ; Lysandre Debut (Hugging Face) ; Victor SANH (@huggingface) ; Julien Chaumond (Hugging Face) ; Rémi Louf (@huggingface) ; Denis ; erenup ; Matt ; Stefan Schweter ; Piero Molino ; Grégory Châtel (DisAItek & Intel AI Innovators) ; Tim Rault (@huggingface) ; Catalin Voss (Stanford University) ; Fei Wang (@ShannonAI) ; Louis Martin ; Malte Pietsch (deepset) ; Davide Fiocco ; dhanajitb ; Jinoo ; Ananya Harsh Jha ; Simon Layton (@NVIDIA) ; yzy5630 ; Yongbo Wang (Red Hat) ; Shijie Wu ; Nikolay Korolev (@JetBrains) ; Juha Kiili (Juhakiili Oy) ; Guillem García Subies ; Joel Grus ; Jade Abbott (@RetroRabbit) ; Clement (@huggingface) ;

Links

• Item record in Zenodo
• Digital object URL

Summary

Input shapes

This patch fixes a bug related to the input shape in several models in TensorFlow.

A tokenization message was too present and overloaded the output, hiding the relevant information. It was removed.

More information

• DOI: 10.5281/zenodo.3560969

Dates

• Publication date: 2019
• Issued: December 03, 2019

Rights

• info:eu-repo/semantics/openAccess Open Access

Format

electronic resource

Relateditems