yehaochen's picture Zhangyc02's picture
Adapt tokenization_interns1.py to transformers>=5.0.0 (#15)
66f5286