SCOTUS Simulator Using A Council of LLMs
Introduction
I recently had the idea to evaluate an LLM council's stance on contested legal questions in a Supreme Court style. In this post, I'll feed the LLM Council various hypotheticals and analyze the models' final, synthesized output as a fun thought experiment. Additionally, I'll record the final rankings that each model attributes to other models' responses.