Data Sources and References
Kibot's reference documentation, contract specifications, trading hours, expiration rules, holiday calendars, is compiled from official exchange sources and verified against broker documentation. This page is the provenance record: the primary exchange pages, broker resources, and calculation references used across the support pages, so that anyone reading a Kibot spec can independently verify it against the underlying authority.
Exchange Sources by Asset Class
Equity Index Futures
- CME Group Equity Index Products
- Covers E-mini S&P 500 (ES), E-mini Nasdaq-100 (NQ), E-mini Dow (YM), E-mini Russell 2000 (RTY), Micro E-mini contracts, and others.
Currency Futures
- CME Group FX Products
- Covers Euro FX (6E), Japanese Yen (6J), British Pound (6B), Australian Dollar (6A), Canadian Dollar (6C), Swiss Franc (6S), and others.
Energy Futures
- CME Group Energy Products (NYMEX division)
- Covers Crude Oil (CL), Natural Gas (NG), Heating Oil (HO), RBOB Gasoline (RB), and others.
Grain Futures
- CME Group Grains and Oilseeds (CBOT division)
- Covers Corn (ZC), Soybeans (ZS), Wheat (ZW), Soybean Oil (ZL), Soybean Meal (ZM), Oats (ZO), and others.
Metal Futures
- CME Group Metals Products (COMEX division)
- Covers Gold (GC), Silver (SI), Copper (HG), Platinum (PL), Palladium (PA), and Micro Gold/Silver contracts.
Treasury Futures
- CME Group Interest Rate Products (CBOT division)
- Covers 30-Year Bond (ZB), 10-Year Note (ZN), 5-Year Note (ZF), 2-Year Note (ZT), Ultra Bond (UB), and others.
Livestock Futures
- CME Group Livestock Products (CME division)
- Covers Live Cattle (LE), Feeder Cattle (GF), Lean Hogs (HE).
VIX Futures
- CBOE VIX Products
- Covers VIX futures and options traded on the CBOE Futures Exchange (CFE).
Trading Hours
- CME Group Trading Hours
- Comprehensive listing of electronic and pit trading sessions for all CME Group products across CME, CBOT, NYMEX, and COMEX divisions. See Trading hours for Kibot's consolidated view.
Holiday Calendar
- CME Group Holiday Calendar
- Lists all exchange holidays, early closes, and modified trading schedules by product group. See Market holidays for Kibot's US equity and futures calendar.
Broker Documentation
Kibot cross-references exchange specifications against broker documentation to confirm contract details, margin requirements, and symbol mappings.
- Interactive Brokers: https://www.interactivebrokers.com/, Extensive contract search tool with specifications for futures, options, stocks, and forex.
- Charles Schwab: https://www.schwab.com/, Formerly TD Ameritrade (the thinkorswim platform migrated to Schwab following their 2023-2024 merger). Futures specifications and educational resources.
- NinjaTrader: https://ninjatrader.com/futures/, Futures trading platform with detailed contract specifications and margin schedules.
Kibot References
- Kibot rollover rules: Futures rollover rules, Kibot's documentation of how continuous futures contracts are constructed, including rollover dates and methods for each product. See Continuous futures for the concept and Futures expirations for the underlying contract months.
Forex data providers
Forex has no central exchange. Unlike stocks, ETFs, and futures, which originate on a single identifiable venue, every currency pair is quoted independently by each institution that trades it, so there is no single official print to record. Kibot consolidates its forex archive from three providers, TenFore, Barclays, and FXCM, and selects one of them per pair: whichever carries the most trades for that pair becomes its source. Because each provider sees a different slice of the market, prices agree closely across the three but not exactly. A pair checked against an outside source should be expected to differ slightly rather than match row for row, and the comparison is only meaningful against the provider that actually supplies the pair. Volume in forex files is tick count rather than executed volume (Data format reference), because no centralised venue exists to report traded size.
Exchange symbol lists
Kibot publishes three parallel symbol rosters for stocks and ETFs, each refreshed once per week and distributed as tab-delimited text files so downstream code can parse without quoting quirks. The first line of each file is the column header row; the size and start-date columns describe the 1-minute file for that symbol rather than the daily file.
- Active only: http://www.kibot.com/files/2/allactive.txt
- Active + delisted (historical roll-up): http://www.kibot.com/files/2/all.txt
- Delisted only: http://www.kibot.com/files/2/alldelisted.txt
These URLs are what the Online link inside Kibot Agent downloads to refresh the symbol-list dropdown, and they are the fastest way for a scripted pipeline to enumerate what is currently available for purchase without having to sign in. A full consolidated list of stocks and ETFs with intraday coverage is also published at http://www.kibot.com/Files/2/All_Stocks_and_ETFs_Intraday.txt for workflows that want the intraday subset specifically. For per-exchange breakdowns (NYSE vs NASDAQ vs AMEX), Kibot does not publish its own split, and the NASDAQ listing pages are the place to get one.
When Kibot's daily or intraday prices appear to disagree with another vendor, the difference is most often a futures settlement-price vs. last-trade-close mismatch, or a different continuous-contract adjustment method (panama-canal-shifted, ratio-shifted, weighted-average, calendar-weighted) being applied by the other source (see the Faq). Cross-referencing against the exchange directly usually resolves the discrepancy.
Calculation References
- Easter Algorithm for Good Friday: Wikipedia, Computus, Good Friday (the Friday before Easter Sunday) is a market holiday for US equity and futures markets. Easter's date is calculated using the computus algorithm, which Kibot implements to generate holiday calendars programmatically.
- Old/New Crop Calendars: CME Grains Seasonality, Understanding old-crop vs. new-crop contract months is essential for correct futures continuous contract construction and spread analysis.
Key Takeaways
- Kibot's published specifications derive from CME Group and CBOE for futures, with Interactive Brokers, Schwab/thinkorswim, and NinjaTrader used as broker-side cross-references.
- Forex data is consolidated from TenFore, Barclays, and FXCM, with the best provider picked per pair by trade count, cross-vendor price comparisons for a single pair will be close but not bit-identical.
- Good Friday dates are generated programmatically using the computus (Easter) algorithm rather than being hardcoded.
- When Kibot data disagrees with another vendor, the difference is usually a settlement-vs-last-trade close distinction or a continuous-futures adjustment method chosen by the other vendor.
- Three parallel tab-delimited symbol roster URLs (
allactive.txt,all.txt,alldelisted.txt) underkibot.com/files/2/are refreshed weekly and drive Agent's Online symbol refresh. - Grain contract month selection requires awareness of old-crop vs. new-crop calendars, which CME publishes in its educational materials.
Related
- Data completeness, the quality-assurance process that uses these sources to define "expected" bar counts
- Market holidays, the calendar derived from CME Group's holiday schedule and the computus algorithm
- Trading hours, session definitions sourced from the CME Group Trading Hours page
- Continuous futures, how Kibot's rollover rules combine with these exchange sources
- Futures specifications, per-contract spec pages that cite this source registry