SARFTokenizer / requirements.txt
almaghrabima's picture
Upload requirements.txt with huggingface_hub
edaafcb verified
raw
history blame contribute delete
144 Bytes
# Requirements for running benchmark_pypi.py
deeplatent-nlp>=0.3.8
pyarrow>=14.0.0
tiktoken>=0.5.0
transformers>=4.36.0
huggingface-hub>=0.20.0