Great job! Thank you for providing an fp8 model. I would like to know what method you used to obtain this weight file.
#4
by
aaroncaozj - opened
I am learning model quantization. I tried torchao myself, and it is very convenient, but it seems that it only supports .pt saving at present, which is not suitable for distribution. I wonder what method you use.
thx！