Paper at Tokshop

We have a paper accepted at Tokenization Workshop @ ICML 2025.

• Marco Cognetta, David Pohl, Junyoung Lee, and Naoaki Okazaki. Pitfalls, Subtleties, and Techniques in Automata-Based Subword-Level Constrained Generation. In Tokenization Workshop, pages (to appear), Vancouver, Canada, July 2025.

  c