Tokenization Matters: Navigating Data-Scarce Tokenization for Gender Inclusive Language Technologies

Published in NAACL Findings, 2024

Recommended citation: A. Ovalle, N. Mehrabi, P. Goyal, J. Dhamala, K. Chang, R. Zemel, A. Galstyan, Y. Pinter, R. Gupta. (2024). "Tokenization Matters: Navigating Data-Scarce Tokenization for Gender Inclusive Language Technologies." NAACL Findings.
Download Paper