Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models.
Abstract: This paper presents HPC-in-Containers, a novel containerized parallel computing environment using Docker. It is designed to facilitate learning parallel programming concepts, where users do ...