DOCUMENTATION
Schema and timestamps
Archives may come from different collector versions. The actual columns, types and notes inside each archive take precedence.
Order-book files
| File | Common fields | Meaning |
|---|---|---|
| ticks.parquet | ts, ts_sec, datetime | Local collection time; verify the archive timezone |
| ticks.parquet | event_slug | Market identifier |
| ticks.parquet | poly_up_bid, poly_up_ask | Best UP bid and ask |
| ticks.parquet | poly_down_bid, poly_down_ask | Best DOWN bid and ask |
| ticks.parquet | window_start, window_end, interval | Market window |
| ticks.parquet | offset_s | Seconds from window start; negative values are pre-open |
| depth.parquet | outcome, side, level, price, size | Outcome, side, 1-based level, price, size |
| outcomes.parquet | winner_side, target | Settlement label; UP = 1, DOWN = 0 |
Newer versions may include exchange_ts_ms, received_ts_ms, book_hash and connection_generation. Do not assume these are present in every period or archive. Preserve original mapping and optional seen_markets files.
Predict.fun outcomes
The collected raw order book is YES. DOWN bid = 1 − YES ask and DOWN ask = 1 − YES bid. These are derived complements, not two independently observed order books. Join adjacent daily archives for windows spanning midnight.
Underlying prices
Keep the original channel, provider, source_ts_ms and receive time. RTDS full_accuracy_value is an E18 integer: divide by 10 to the power of 18 using decimal arithmetic. PolyBolt high-precision price fields express USD directly; check the channel semantics.
Use source time for price comparisons. In a backtest, receive time controls when a message becomes visible. Use a backward as-of join on messages already received; an earlier source timestamp does not make a late message available sooner.
Version checks
Inspect the archive README, actual schema and manifest before reading. Preserve missing fields and keep distinct feeds or price semantics separate.