Docs & data dictionary

Everything you need to evaluate a DataForge dataset before buying: delivery format, update policy, provenance guarantees, and the key fields of each dataset. The complete data dictionary for every dataset ships with the free sample and every purchase.

Delivery & documentation

Formats

Every package ships as CSV and/or Parquet inside a ZIP, together with the full data dictionary, a datasheet (sources, method, known limitations) and the license text.

Delivery

Downloads are issued as signed, expiring links from dl.zalize.com. Free samples arrive instantly after email verification; paid packages are delivered automatically on payment or after a short approval step for gated editions.

Provenance

Records carry their source URL and collection timestamp. Collection is rate-limited, uses an identified User-Agent and touches publicly accessible endpoints only.

Updates

Subscription buyers receive refreshed packages on the dataset cadence (weekly or monthly). Schemas are additive — existing columns are never renamed or removed within a major version.

Developer API (machine-readable catalog)

The whole catalog is scriptable — no key, no auth, plain JSON over GET. Sizes, row counts and SHA-256 checksums come straight from the packaging pipeline, so you can verify every download.

GET /catalog.json

Site-level catalog — one entry per dataset with title, category, inventory summary (packageCount, totalBytes, totalRows, latestDate, hasOpenData, minPrice) and all acquisition channels (Hugging Face, Kaggle, GitHub Releases, Zenodo DOIs).

GET /datasets/<id>/packages.json

Full package inventory for one dataset — every catalog-registered package with id, size_bytes, sha256, rows, date, distribution (public / gated / b2b-only), price and open_data flag. Free open-data packages download at dl.zalize.com/open-data/<id>.

# Full site catalog: every dataset with inventory summary + channels
curl -s https://data.zalize.com/catalog.json | jq '.datasets[0]'

# Per-dataset package index: size / sha256 / rows / date / distribution
curl -s https://data.zalize.com/datasets/tech-job-postings-salary-dataset/packages.json \
  | jq '.packages[0]'

Data dictionaries

Key fields per dataset. Jump to a dataset:

Job Postings with Parsed Salaries

390,000+ postings · Monthly refresh · CSV + Parquet · from $99

Field definitions for Job Postings with Parsed Salaries
field	type	description
job_id	string	Stable unique identifier for the posting
company_name	string	Hiring company name
title	string	Job title as posted
location	string	Normalized location (city, region, country)
remote_policy	string	remote / hybrid / onsite
salary_min	float	Parsed lower bound of salary range
salary_max	float	Parsed upper bound of salary range
salary_currency	string	ISO 4217 currency code
seniority	string	junior / mid / senior / staff+ (derived)
tech_stack	array<string>	Extracted technology tags
ats_source	string	greenhouse / lever / ashby / workable / smartrecruiters
source_url	string	Public URL the record was collected from
collected_at	timestamp	UTC collection timestamp

App Store Data + Review Sentiment

6,700+ apps · Monthly refresh · CSV + Parquet · from $149

Field definitions for App Store Data + Review Sentiment
field	type	description
app_id	string	Store-native app identifier
store	string	ios / google_play
app_name	string	App display name
category	string	Store category
developer	string	Developer / publisher name
rating_avg	float	Average star rating (0–5)
rating_count	int	Total number of ratings
price_usd	float	List price in USD (0 = free)
sentiment_score	float	Derived review sentiment (−1 to 1)
top_topics	array<string>	Derived complaint/praise topic tags
rank_in_category	int	Category rank at collection time
source_url	string	Public URL the record was collected from
collected_at	timestamp	UTC collection timestamp

Shopify Products + Price History

500,000+ records · Weekly snapshots · CSV + Parquet

Field definitions for Shopify Products + Price History
field	type	description
product_id	string	Store-native product identifier
store_domain	string	Shopify store domain
title	string	Product title
vendor	string	Brand / vendor name
product_type	string	Store-assigned product type
variant_id	string	Variant identifier (size/color/etc.)
price	float	Variant price at snapshot time
compare_at_price	float	Pre-discount price if on sale
currency	string	ISO 4217 currency code
available	bool	In-stock flag at snapshot time
snapshot_date	date	Weekly snapshot date
source_url	string	Public URL the record was collected from
collected_at	timestamp	UTC collection timestamp

Company Tech DNA

3,171 company profiles · 93,965 evidence rows · Monthly refresh (subscription) · CSV + Parquet · from $199

Field definitions for Company Tech DNA
field	type	description
company_domain	string	Company website domain (join key across all sources)
ai_maturity	float	0–100 composite: JD AI-skill share + LLM-labeled adoption + AI team building + AI API usage + AI patents
primary_cloud	string	aws / gcp / azure with the most hiring evidence, plus cloud_mix_* shares
tech_debt	float	Share (%) of the company's techs in a documented legacy list (with legacy_techs naming them)
top_cpc_subclasses	string	Top-5 patent CPC subclasses = in-research directions (877 companies)
differentiation	float	100 × (1 − mean top-5 peer similarity): how unlike its closest peers the stack is
tech_matrix.evidence_count	int	Per company × technology × source observations, with a detail field naming the basis
peer_similarity.similarity	float	TF-IDF-weighted cosine similarity, top-10 peers per company

Patent Tech Analytics

· Snapshot (one-time) · Parquet + CSV · from $299

Field definitions for Patent Tech Analytics
field	type	description
cpc_subclass	string	4-char CPC technology field (IPC fallback)
publications_total	int	Publications per field-year across six offices
cagr_recent_pct	double	3-year CAGR of publications ending in year t
acceleration_pp	double	Recent CAGR minus prior CAGR (percentage points)
docdb_avg_citations_3y	double	Citation velocity: mean citations within 3 years (DOCDB scope)
status	string	accelerating / growing / stable / declining / collapsing
citation_edges	int	Flow matrix: deduplicated citation edges citing-office → cited-office
influence_rank	double	Company rank by citations received (per scope)
signal_ratio	double	Cohort citation velocity vs 2010–2017 subclass baseline

China Macro & Trade Monthly

284,000+ observations · Monthly refresh · CSV + Parquet · from $149

Field definitions for China Macro & Trade Monthly
field	type	description
dataset	string	Source dataset code (IMF SDMX dataflow or World Bank WDI)
indicator_code	string	Indicator code as published by the source
dims	string	Extra SDMX dimensions (e.g. COICOP category) serialized as key=value pairs
period	string	Observation period — YYYY-MM for monthly tables, YYYY for the World Bank annual table
value	number	Observation value exactly as published; no imputation
partner	string	Partner economy (trade_partners_monthly table only)
_collected_at	timestamp	Collection timestamp for provenance

US Aircraft Registry & Airmen

3,200,000+ records · Monthly refresh · CSV + Parquet · from $99

Field definitions for US Aircraft Registry & Airmen
field	type	description
n_number	string	Aircraft registration (tail) number
serial_number	string	Manufacturer serial number
mfr_mdl_code	string	Manufacturer/model reference code (joins the aircraft reference table)
registrant_name	string	Registered owner name as published by the FAA
registrant_region	string	Owner state/region from the registry
status_code	string	Registration status code
airman_cert	string	Airman certificate type and ratings (airmen tables)
_collected_at	timestamp	Snapshot collection timestamp for provenance

Other datasets

Full dictionaries for these datasets ship with the free sample — grab one from the dataset page, or ask us for the field list.

Questions about a schema, joins across datasets, or a custom slice? Email data@zalize.com or use the inquiry form.