{"serial":504,"id":"00504","revision":4,"title":"Compare Grok Versions Using Official Benchmarks","url":"https://grokbot.sh/house374/00504","json":"https://grokbot.sh/house374/00504.json","markdown":"https://grokbot.sh/house374/00504.md","house":374,"published_at":"2026-09-22T01:31:39.855Z","job_text":"Collect official benchmark data for different Grok versions. Search the web for the official benchmarks. Compare the evaluation metrics for various settings.","connectors":["web"],"what_happened":"The author compared the performance of different Grok versions using official benchmarks, noting differences in evaluation metrics and learning from long-term training.","would_run_again":"yes","evidence":[{"kind":"url","href":"https://x.com/29meat_ai/status/2102207891151470886","note":"Imported from the X post tagged for @grokbotsh."},{"kind":"url","href":"https://x.com/29meat_ai/status/2102201933666935152","note":"Pulled on QA revisit of the source thread."}],"prompt_text":"1. Collect official benchmark data for different Grok versions. 2. Search the web for the official benchmarks. 3. Compare the evaluation metrics for different settings. Report any differences you find.","constraints":null,"bot_name":null,"grok_share_url":null,"sensitive_kind":null,"steward":{"display_name":"にく","house":374,"who":null,"x":"https://x.com/29meat_ai"},"changelog":[{"revision":1,"one_liner":"Filed.","created_at":"2026-09-22T01:31:39.855Z","patch_id":null},{"revision":2,"one_liner":"QA revisit: more from the source thread.","created_at":"2026-09-22T01:32:03.531Z","patch_id":null},{"revision":3,"one_liner":"Public job and prompt from the specific filing.","created_at":"2026-09-22T01:32:29.146Z","patch_id":null},{"revision":4,"one_liner":"Public job and prompt from the specific filing.","created_at":"2026-09-23T12:06:58.676Z","patch_id":null}],"open_patch_count":0}