220 public questions. Quality is the share of rubric items an answer satisfies.
Figure 6: Samaya Sterling is the Samaya System running our post-trained 30B model; its scores are the mean of two runs. Other systems are from the public FrontierFinance leaderboard. Our cost includes the open model at its serving price, the tools and the models that write and condense.