Recommended sampler?

#3
by mratsim - opened

Do you have any recommended settings?

For now I'm using {"temperature": 1, "min_p": 0.03, "repetition_penalty": 1.03}, it seems like I can go down to min_p == 0.02 but curious if have other suggestions.

About there! I'd personally bump temp to 1.2 and reset rep_pen (i.e. no rep pen)

Min P can be left as-is :)

mratsim changed discussion status to closed

Sign up or log in to comment