DATA FOUNDRY ESTATE 20 OFFERINGS PER-DATASET COUNTS SHOWN

Engineered data lakes for AI agents & quant models.
Columnar Parquet. Cryptographic provenance.

Browse 20 offerings: 14 data lakes plus MCP integrations, a marketplace protocol, and bespoke data services. Record counts below are snapshot figures reported by the Data Foundry catalog; live availability, freshness and licensing are confirmed in writing at quote time.

DATA INTEGRITY STANDARDS

Data Foundry Principles

  • ✓ Deduplicated ingestion — Seen-keys deduplication is used to avoid duplicate intervals. Pipeline status is confirmed per dataset at quote time.
  • ✓ Columnar DuckDB Speed — Columnar Parquet with Zstandard compression, readable by DuckDB, Polars and PyArrow. No performance guarantee is made.
  • ✓ Strict Venue Quarantine — Restricted HIP-3/HIP-4 proprietary feeds isolated from commercial syndication.
  • ✓ Transparent Quoting — Honest scoping based on update cadence and volume without surprise recurring charges.
ESTATE VOLUME

3.71M

Sum of per-dataset snapshot counts (pending backend verification)

OFFERINGS

14 Lakes + 6

14 data lakes; 2 MCP integrations, 1 protocol, 3 services

FORMAT COMPATIBILITY

Parquet / JSONL

Native DuckDB, PyArrow, Pandas & Polars

DELIVERY CADENCE

Per dataset

Refresh cadence is stated on each dataset page and confirmed at quote

DATA FOUNDRY CATALOG

The Data Foundry Catalog.
Search by industry, type and format.

Inspect schemas, record counts, and update cadences. Every lake includes sample schema definitions, field dictionaries, and clear commercial scoping pathways.

CORPORATE FILINGS 3.62M ROWS

SEC EDGAR XBRL Financials & Tickers

Over 3.61 million SEC EDGAR corporate filing index rows joined with 10,409 verified public corporate tickers and CIK identifiers. Direct from official SEC EDGAR dissemination feeds.

3,629,775 Records Continuous Sync U.S. Public Domain
Request Quote Metered / Bulk Parquet
Inspect Lake →
PHARMA & CLINICAL 45.3K ROWS

OpenFDA Drug Adverse Events (FAERS)

45,300 drug label and adverse reaction records normalized from the US FDA FAERS repository. Standardized MedDRA reaction terms, dosage data, and patient demographic signals.

45,300 Records Weekly Refresh U.S. Open Data
Request Quote Metered Access
Inspect Lake →
AI RESEARCH 19.0K ROWS

arXiv AI & CS Research Preprints

19,000 verified academic preprints across artificial intelligence, machine learning, and computation. Sourced via official arXiv OAI-PMH dissemination with full author and citation graphs.

19,000 Records Daily (02:00 UTC) arXiv Non-Exclusive
Request Quote Parquet / JSONL
Inspect Lake →
DEFI & STABLECOINS 24.9K ROWS

Stablecoin Circulating Supply & Market Snapshots

24,933 verified records: multi-chain daily circulating supply time-series (DefiLlama) and market valuation snapshots (CoinGecko) across USDT, USDC, USDe, and major pegged assets. Reported supply & price observations; not an independent reserve audit.

24,933 Records Daily + Snapshots Public API Terms
$29.00 Access Pack DuckDB / MCP
Inspect Lake →
CRYPTO SPOT 49.2K ROWS

Crypto Spot Daily Klines & Market Snapshots

49,246 verified records: 46,719 daily OHLCV spot klines (Binance.US) and 2,527 market valuation snapshots (CoinGecko). Historical price candles only; does NOT contain L2/L3 order-book data. Restricted feeds remain quarantined.

49,246 Records Daily + Snapshots Public Terms
$29.00 Access Pack DuckDB / MCP
Inspect Lake →
ENERGY GRIDS 2.5K ROWS

Wholesale Electricity Grid LMP (CAISO/PJM)

2,581 settled 5-minute Locational Marginal Pricing (LMP) records across CAISO Day-Ahead and Real-Time nodes, joined with weather telemetry and renewable generation mix.

2,581 Records 5-Min Settled CAISO OASIS
Request Quote GeoParquet
Inspect Lake →
SECURITY INTEL 2.3K ROWS

Deterministic Cybersecurity CVE & KEV

2,369 enriched vulnerability records joining CISA Known Exploited Vulnerabilities (KEV) with NIST NVD CVSS vectors and FIRST EPSS exploit probability scores.

2,369 Records Real-Time Sync Public Domain
Request Quote JSON-LD / REST
Inspect Lake →
AI EVALUATIONS 1.7K ROWS

AI Model Benchmark & Latency Evaluations

1,783 structured evaluation rows across 460+ open-weights and frontier LLMs. Measures MMLU, GSM8K, HumanEval, TTFT, and sustained generation tokens/sec across verified hardware rigs.

1,783 Records Weekly Refresh Open Evaluator
Request Quote Zstandard Parquet
Inspect Lake →
INTELLECTUAL PROP 1.6K ROWS

USPTO Deep Tech Patents & CPC Graph

1,600 patent records and NASA NTRS technical reports across quantum computing, semiconductor lithography, and autonomous robotics. Includes CPC hierarchy and assignee graphs.

1,600 Records Weekly (Tuesdays) USPTO Bulk Open
Request Quote NetworkX / Parquet
Inspect Lake →
PREDICTION MARKETS 1.2K ROWS

Cross-Venue Prediction Market Orderbooks

1,200 synchronized probabilistic contracts across Polymarket and Kalshi. Normalizes implied probability, open interest, 24h volume, and resolution criteria for event trading agents.

1,200 Records Hourly Snapshots Public Venues
Request Quote NDJSON / DuckDB
Inspect Lake →
GOVERNMENT CONTRACTS 674 ROWS

US Federal Procurement & Awards

674 prime award transactions from USASpending.gov and SAM.gov. Covers DoD, NASA, and DoE contracts with NAICS codes, obligating agency, vendor DUNS/UEI, and award amounts.

674 Records Daily Ingestion U.S. Public Domain
Request Quote Parquet / Lake
Inspect Lake →
MACROECONOMIC 450 ROWS

World Bank Macroeconomic Indicators

450 multi-year macroeconomic time series covering GDP, consumer price inflation, sovereign debt, and FX reserves across 40 OECD and emerging economies from official Open Data APIs.

450 Records Quarterly / Annual CC-BY-4.0
Request Quote Columnar Parquet
Inspect Lake →
KNOWLEDGE GRAPHS 250 ROWS

Scientific Papers OpenAlex Graph Sample

Normalized scientific papers sample from the OpenAlex scholarly graph. Enriched with MeSH terms, institutional affiliation IDs, DOI identifiers, and open-access licensing flags.

250 Records Monthly Ingestion CC0 Public Domain
Request Quote DuckDB Schema
Inspect Lake →
GEOSPATIAL RISK 180 ROWS

USGS Seismic Events & Catastrophe Risk

180 high-magnitude seismic events from the USGS Earthquake Hazards Program. Includes hypocenter coordinates, modified Mercalli intensity, and estimated economic exposure figures.

180 Records Real-Time Streams U.S. Public Domain
Request Quote GeoParquet
Inspect Lake →
MCP PROTOCOL SCOPED PILOT

MCP Data Server for Trading Agents

Model Context Protocol tool server adapter for autonomous algorithmic agents. Exposes streaming on-chain token reads and market snapshots over standardized JSON-RPC 2.0 tool calls.

JSON-RPC 2.0 Streamable HTTP Scoped Pilot
Request Quote Pilot Deployment
Inspect Architecture →
MCP SECURITY SCOPED PILOT

MCP Tool Server for Security Auditors

Deterministic Model Context Protocol tool interface for coding assistants. Analyzes dependency vulnerability vectors, EPSS exploit likelihoods, and static workflow definitions.

JSON-RPC 2.0 Static AST Probes Scoped Pilot
Request Quote Pilot Deployment
Inspect Architecture →
EXCHANGER MARKETPLACE

Agent-Native Data Marketplace (EXCHANGER)

Cryptographic quote and delivery protocol for autonomous software agents. Emits verifiable SHA-256 delivery receipts and enables deterministic dataset procurement.

Delivery Receipts Quote Negotiation Verified Protocol
Request Quote Protocol Preview
Inspect Marketplace →
TRAINING DATA CLEARED RIGHTS

AI Training Data Licensing & Vaults

Copyright-cleared domain repositories for fine-tuning LLMs and quant neural networks. Fully verified chain-of-title, provenance certificates, and per-token hygiene filters.

Parquet Vaults Chain of Custody Scoped Pilot
Request Quote Enterprise Access
Inspect Licensing →
DATA HYGIENE BESPOKE

Custom Dataset Labeling & Verification

Bespoke multi-stage LLM and deterministic programmatic validation pipelines. Verifies synthetic data distributions, cleans corrupted schemas, and eliminates training leakage.

Bespoke SLA Quality Gates Parquet / JSONL
Request Quote Custom Engineering
Inspect Engineering →
SOURCING BROKER BESPOKE

Enterprise Data Sourcing & Brokerage

Authorized legal acquisition and deterministic normalization of specialized vertical datasets. We handle primary ingestion, sanitization, schema mapping, and delivery manifests.

Full Chain of Title Custom Schemas SLA-Governed
Request Quote Custom Scope
Inspect Brokerage →

HIGH-PERFORMANCE ARCHITECTURE

Query it locally with DuckDB.
Illustrative query shape; timings are not guaranteed.

All Data Foundry lakes are structured into columnar Apache Parquet files with Zstandard compression and embedded dictionary encoding. Ingest directly into DuckDB, Polars, or PyArrow without running expensive database servers.

duckdb · zero-network local execution ● PARQUET V2
-- Illustrative query (output values below are example formatting, not a performance claim)
SELECT form, COUNT(*) AS total_filings,
       MIN(filing_date) AS earliest, MAX(filing_date) AS latest
FROM read_parquet('sec_filings_index_*.parquet')
WHERE form IN ('10-K', '10-Q', '8-K')
GROUP BY form
ORDER BY total_filings DESC;

┌─────────┬───────────────┬────────────┬────────────┐
│  form   │ total_filings │  earliest  │   latest   │
├─────────┼───────────────┼────────────┼────────────┤
│ 8-K     │   1,842,109   │ 2018-01-02 │ 2026-11-08 │
│ 10-Q    │     941,204   │ 2018-01-03 │ 2026-11-06 │
│ 10-K    │     836,053   │ 2018-01-04 │ 2026-11-07 │
└─────────┴───────────────┴────────────┴────────────┘
3 rows in set (0.042 sec) · Peak RAM: 18.4 MB
PROVENANCE GUARANTEE

Cryptographic Verification

Every Data Foundry release includes an immutable SHA-256 partition manifest. Verify byte-for-byte integrity before feeding records into agent models or training partitions:

  • SHA-256 Partitions — Deterministic checksums prevent silent corruption or transmission truncations.
  • Schema Evolution Guard — Backward-compatible schemas verified against strict PyArrow type specifications.
  • Seen-Keys Ledger — Prevents accidental duplicate ingestion across recurring hourly and daily runs.
  • Direct S3/R2 Bucket Presigned Links — High-speed download endpoints with authorized bearer tokens.

DATA FOUNDRY PROCUREMENT

Frequently Asked Questions.
Clear procurement answers.

How are Data Foundry lakes delivered?

Data lakes are delivered via secure Cloudflare R2 / AWS S3 presigned download URLs, private bucket replication, or streaming REST/DuckDB endpoints. Partitioned by date and entity domain in Zstandard-compressed Apache Parquet.

How does pricing and quoting work?

Because enterprise dataset requirements vary by historical depth and refresh cadence, Data Foundry access is scoped through transparent metered access quotes. We do not impose automatic recurring subscriptions.

What upstream licenses apply?

Each lake carries explicit licensing disclosures (U.S. Government Open Data 17 U.S.C. § 105, ODC-By, CC-BY-4.0, or CC0). Proprietary venue feeds (such as Hyperliquid HIP-3/HIP-4) are quarantined and excluded from public syndication.

Can I query datasets via Model Context Protocol (MCP)?

Yes. ELYRAON provides standard MCP tool adapters allowing Claude Code, Codex, and Cursor agents to query schemas, inspect sample partitions, and execute bounded lookups directly over JSON-RPC 2.0.

What is the turnaround time for custom quotes?

Our engineering team reviews all scoping requests within 24 hours. Submit your required entities, date ranges, and delivery protocol via the Quote Intake Form.

Ready to ingest verified data into your AI systems?

Submit your required datasets, volume requirements, and refresh frequency. Our engineering team will deliver a structured quote and sample partition within 24 hours.

AVAILABILITY & LICENSING DISCLOSURES

What these labels mean.