Summary: Changes to the sampling temperature of an LLM from 0.0 to 1.0 have no statistically significant effect on its performance on MCQA problems.
Resources:
This paper was accepted for publication at the EMNLP 2024 conference in Miami, USA. A pre-print of the paper is available on arXiv.