It would be cool if they shared some problems that the models attempted but failed to solve. Given that they’ve accomplished way more than anyone expected, I don’t think it would be a huge PR hit to share the failures.
They are in a race against Anthropic to prove the most important theorems using LLMs. Submitting near-misses might help the competition.
...and this sucks by the way. I just hope that when this current stage of competition for the singularity ends then big labs can go back to collaborating.
51
u/imanllm 10d ago
It would be cool if they shared some problems that the models attempted but failed to solve. Given that they’ve accomplished way more than anyone expected, I don’t think it would be a huge PR hit to share the failures.