Skip to content

Add task_24_polymarket_briefing: prediction markets + news cross-reference#78

Merged
olearycrew merged 1 commit intopinchbench:mainfrom
Aleschka:add-task-24-polymarket
Mar 31, 2026
Merged

Add task_24_polymarket_briefing: prediction markets + news cross-reference#78
olearycrew merged 1 commit intopinchbench:mainfrom
Aleschka:add-task-24-polymarket

Conversation

@Aleschka
Copy link
Copy Markdown

Summary

Adds task_24_polymarket_briefing — fetches live Polymarket prediction markets and cross-references each with a recent news story.

Category: Research
Grading: Hybrid (automated + LLM judge)
Timeout: 180s

What it tests

  1. Real-time API access — Polymarket's public gamma-api (no auth required)
  2. Numerical data integrity — odds must be plausible, not hallucinated
  3. News cross-referencing — finding news that explains why a market is active
  4. Format compliance — structured markdown with labeled fields

Why it's useful for v2

This is one of the harder "real-time data + reasoning" tasks because:

  • Models that can't fetch data will try to invent market odds (easily caught by LLM judge)
  • Connecting market activity to news requires actual search, not recall
  • Tests a practical agentic use case: prediction markets as news importance signals

API reference

GET https://gamma-api.polymarket.com/markets?active=true&order=volumeNum&ascending=false&limit=10

No authentication required.

Part of PinchBench v2 community task expansion (issue #60).

@olearycrew olearycrew merged commit 1371b5e into pinchbench:main Mar 31, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants