Jev vs LLMs for Legal Contract Inference Accuracy

An evaluation of Jev and nine language models on the ContractNLI dataset shows that while hosted LLMs achieve higher baseline accuracy, Jev provides lower cost and median response times. The study highlights that baseline accuracy rankings fluctuate significantly across repeated requests and varying output orders.