Data lake

All of baseball, in one place.

A personal data lake behind every project on this site: every game since 1871, every tracked pitch, every roster move, and my own swings and guesses, joined on one set of ids. This page is the plan and the catalog. Most of it isn't built yet, and each dataset says so.

Datasets
41
On hand
8
Rows on hand
3.9M
Seasons on hand
1901–2026
Ideas ready now
2 of 23

Roadmap

Ordered by the ideas each phase makes buildable
  1. P0Now

    Foundations

    Storage, the catalog, and every existing cache moved into the lake.

    Game results · Standings · Relief pitching · Best stretches · Every pitch · The show's questions · Read the Swing plays · Read the Swing guesses

    Ideas ready now27 on-air asks behind them
  2. P1Up next

    The spine

    One id for every person, team, park and game since 1871, plus season stats and game logs.

    People · Teams and franchises · Ballparks · The game key · Rules timeline · Game logs · Player seasons

  3. P2Planned

    Every pitch

    Pitch tracking back to 2008 with every column, plus fielding, running, umpires and video links.

    Pitch flight · Fielding · Running game · Umpires · Video index

    Ideas it makes ready40 on-air asks behind them
  4. P3Planned

    Every play

    Play-by-play and box scores across history, full game feeds, the Negro Leagues, weather and travel.

    Box scores · Play-by-play · Negro Leagues · Full game feeds · Weather · Rest and travel

    Ideas it makes ready38 on-air asks behind them
  5. P4Planned

    Front office

    Transactions, the injured list, rosters, the draft, contracts and payroll.

    Transactions · Injured list · Daily rosters · The draft · Contracts · Payroll

    Ideas it makes ready25 on-air asks behind them
  6. P5Planned

    The pipeline

    The minors, other leagues and amateurs.

    Minor leagues · Triple-A tracking · Other leagues · College and amateur

    No idea waits only on this yet
  7. P6Planned

    Personal

    Cage sessions, games I've been to, a ledger of takes, fantasy history and gear.

    Cage sessions · Games I've been to · Take ledger · Fantasy league · Gear specs

    Ideas it makes ready
  8. P7Planned

    Open it up

    A query console on this page for the tables whose terms allow sharing.

    A site feature, no new data

Coverage

Seasons each dataset covers, 1871–2026
On handPlannedSelect a row for its catalog entry

Catalog

41 datasets in 8 domains

Identity

The spine: who, where and when, on one set of ids.

  • People

    P1 · The spineSpine

    Every player, manager, coach and umpire, with the ids MLB, Retrosheet, Baseball-Reference and FanGraphs use for them, so any two sources can be joined.

    Seasons
    1871–2026, planned
    Grain
    One row per person
    Source
    Chadwick Bureau register
    Terms
    Open data
    FeedsEvery dataset joins through it
  • Teams and franchises

    P1 · The spineSpine

    Every team-season tied to its franchise, league and division, Negro Leagues included, so the 1901 Milwaukee Brewers and the 2026 Orioles line up as one franchise.

    Seasons
    1871–2026, planned
    Grain
    One row per team-season
    Source
    Lahman, Retrosheet and the MLB Stats API
    Terms
    Open data
  • Ballparks

    P1 · The spineSpine

    Every park with its location, elevation, roof and fence distances, season by season as the fences move.

    Seasons
    1871–2026, planned
    Grain
    One row per park-season
    Source
    Retrosheet park codes, MLB venues, dimensions checked by hand
    Terms
    Hand-built
  • The game key

    P1 · The spineSpine

    One id per game that links Retrosheet's game ids to MLB's, so a game from 1923 and a game from last night join the same way.

    Seasons
    1871–2026, planned
    Grain
    One row per game
    Source
    Matched from Retrosheet and MLB schedules
    Terms
    Open data
    FeedsEvery dataset joins through it
  • Rules timeline

    P1 · The spine

    Every rule change that moved the numbers, with its effective date: the lower mound in 1969, the DH, the extra-innings runner, the 2023 pitch clock, shift limits and bigger bases, and the 2026 ABS challenges.

    Seasons
    1871–2026, planned
    Grain
    One row per rule change
    Source
    Official Baseball Rules and league announcements
    Terms
    Hand-built

History

Games, seasons and plays back to 1871.

  • Game results

    On hand

    Every regular-season game since 1901: date, teams and final score, checked against the official standings.

    Seasons
    1901–2026
    On hand
    224,791 games
    Grain
    One row per game
    Source
    MLB Stats API
    Terms
    Personal use
  • Standings

    On hand

    Official final standings for every season since 1903.

    Seasons
    1903–2026
    On hand
    2,704 team-seasons
    Grain
    One row per team-season
    Source
    MLB Stats API
    Terms
    Personal use
  • Relief pitching

    On hand

    Each team's bullpen totals for every season since 1974.

    Seasons
    1974–2026
    On hand
    1,498 team-seasons
    Grain
    One row per team-season
    Source
    MLB Stats API
    Terms
    Personal use
  • Best stretches

    On hand

    Every team-season's best 30, 36 and 50-game runs, built from the game results.

    Seasons
    1901–2026
    On hand
    3,087 team-seasons
    Grain
    One row per team-season
    Source
    Built from game results
    Terms
    Personal use

    Published on this site as Claim Check's data file, the lake's first published table.

  • Game logs

    P1 · The spine

    Every major league game since 1871 with starting lineups, umpires, attendance, game length and the line score.

    Seasons
    1871–2026, planned
    Grain
    One row per game
    Source
    Retrosheet
    Terms
    Open data

    Retrosheet publishes each season after it ends.

  • Player seasons

    P1 · The spine

    Batting, pitching and fielding lines for every player-season, plus awards and the Hall of Fame.

    Seasons
    1871–2026, planned
    Grain
    One row per player, season and team
    Source
    Lahman database (SABR), with the MLB Stats API for the current season
    Terms
    Open data
  • Box scores

    P3 · Every play

    Every player's line in every game: the source for game logs, pitch counts and rest.

    Seasons
    1901–2026, planned
    Grain
    One row per player-game
    Source
    Retrosheet box scores and the MLB Stats API
    Terms
    Personal use

    Pitcher lines for 2018–24 are already on disk from an older project.

  • Play-by-play

    P3 · Every play

    Every plate appearance with the count, runners, outs and result, for as much of history as was scored.

    Seasons
    1910–2026, planned
    Grain
    One row per play
    Source
    Retrosheet event files and MLB game feeds
    Terms
    Personal use

    Coverage follows Retrosheet, complete for recent decades and thinner in the early years.

  • Negro Leagues

    P3 · Every play

    The Negro Leagues seasons MLB recognizes as major league, with games, players and stats on the same ids.

    Seasons
    1920–1948, planned
    Grain
    Games, players and seasons
    Source
    MLB Stats API and Retrosheet; Seamheads with permission
    Terms
    Terms to confirm

Tracking

Pitch, swing, fielding and running measurements from the tracking era.

  • Every pitch

    On hand

    Pitch-level Statcast: speed, spin, movement, location, the count and the result, plus bat speed and swing length since mid-2023.

    Seasons
    2022–2026 on hand, aiming for 2008–2026
    On hand
    3.63M pitches · 70 columns
    Grain
    One row per pitch
    Source
    Baseball Savant
    Terms
    Personal use

    Phase 2 backfills to 2008, when pitch tracking began, and keeps every column Savant offers.

  • Pitch flight

    P2 · Every pitch

    The full measured flight of every pitch: release point, velocity and acceleration in three dimensions, enough to redraw any pitch's path.

    Seasons
    2008–2026, planned
    Grain
    One row per pitch
    Source
    Baseball Savant
    Terms
    Personal use
  • Fielding

    P2 · Every pitch

    Outs above average, catch probability, outfield arm strength, and catcher framing, blocking and pop time.

    Seasons
    2016–2026, planned
    Grain
    One row per player-season, and per play where published
    Source
    Baseball Savant leaderboards
    Terms
    Personal use

    Other defensive systems have stricter terms, so Glove Consensus may only be able to link to them.

  • Running game

    P2 · Every pitch

    Sprint speed, runners' leads and jumps, pitchers' times to the plate, and baserunning runs.

    Seasons
    2015–2026, planned
    Grain
    One row per player-season, and per attempt where published
    Source
    Baseball Savant leaderboards
    Terms
    Personal use
  • Full game feeds

    P3 · Every play

    MLB's complete record of each game, with every play, pitch, fielder, substitution and umpire, kept exactly as published.

    Seasons
    2008–2026, planned
    Grain
    One file per game
    Source
    MLB Stats API
    Terms
    Personal use

    Kept raw; the play-by-play and box score tables are built from it.

Front office

Rosters, transactions, contracts and money.

  • Transactions

    P4 · Front office

    Trades, signings, releases, call-ups and options, each with its date.

    Seasons
    1900–2026, planned
    Grain
    One row per transaction
    Source
    MLB Stats API and Retrosheet transactions
    Terms
    Personal use

    Older transactions are less complete.

  • Injured list

    P4 · Front office

    Every injured-list stint, from placement to return, with the injury where it was reported.

    Seasons
    2005–2026, planned
    Grain
    One row per stint
    Source
    Built from MLB Stats API transactions
    Terms
    Personal use
  • Daily rosters

    P4 · Front office

    Who was on every active roster on every day of the season.

    Seasons
    2008–2026, planned
    Grain
    One row per player, team and day
    Source
    MLB Stats API
    Terms
    Personal use
  • The draft

    P4 · Front office

    Every pick since the first draft in 1965, and what became of each player.

    Seasons
    1965–2026, planned
    Grain
    One row per pick
    Source
    MLB Stats API
    Terms
    Personal use
  • Contracts

    P4 · Front office

    Contract terms and payment schedules, including deferred money, options and opt-outs, starting with the largest active deals.

    Seasons
    2010–2026, planned
    Grain
    One row per contract-year
    Source
    Public reporting, cited per contract
    Terms
    Hand-built
  • Payroll

    P4 · Front office

    Each team's opening-day payroll by season.

    Seasons
    1985–2026, planned
    Grain
    One row per team-season
    Source
    Lahman salaries, then public reporting
    Terms
    Hand-built

    Lahman has player salaries through 2016; later seasons are compiled by hand.

Development

The minors, amateurs and other leagues.

  • Minor leagues

    P5 · The pipeline

    Games and season stats for every affiliated level, from Triple-A down to the complex leagues.

    Seasons
    2005–2026, planned
    Grain
    One row per player, season and level
    Source
    MLB Stats API
    Terms
    Personal use
  • Triple-A tracking

    P5 · The pipeline

    Pitch-level tracking for Triple-A, the last test before the majors.

    Seasons
    2023–2026, planned
    Grain
    One row per pitch
    Source
    Baseball Savant
    Terms
    Personal use

    Savant publishes it for recent seasons only.

  • Other leagues

    P5 · The pipeline

    Season stats from the top leagues in Japan, Korea and Taiwan, plus the World Baseball Classic, for translating numbers between leagues.

    Seasons
    2000–2026, planned
    Grain
    One row per player-season
    Source
    League sites and the MLB Stats API
    Terms
    Terms to confirm
  • College and amateur

    P5 · The pipeline

    College and summer-league season stats, for players before the draft.

    Seasons
    2010–2026, planned
    Grain
    One row per player-season
    Source
    NCAA and league sites
    Terms
    Terms to confirm
    FeedsNo project yet

Environment

Weather, umpires and travel.

  • Weather

    P3 · Every play

    First-pitch weather for every game, and hourly temperature, wind and humidity from the weather station nearest each park.

    Seasons
    1973–2026, planned
    Grain
    One row per game, and per park-hour
    Source
    MLB game feeds and NOAA station records
    Terms
    Open data

    NOAA records are public domain; station coverage thins before 1973.

  • Umpires

    P2 · Every pitch

    Who worked every game, and the called zone of each plate umpire, measured pitch by pitch.

    Seasons
    1871–2026, planned
    Grain
    One row per umpire-game
    Source
    Retrosheet game logs and Statcast called pitches
    Terms
    Personal use

    Called zones start in 2008, with pitch tracking.

  • Rest and travel

    P3 · Every play

    Miles traveled, time zones crossed and days of rest before every game, worked out from the schedule and park locations.

    Seasons
    1901–2026, planned
    Grain
    One row per team-game
    Source
    Built from game logs and ballparks
    Terms
    Open data

Media

The show's questions, game clips and video links.

  • The show's questions

    On hand

    Every question the Talkin' Baseball hosts asked on air, transcribed and sorted, grouped into the 44 questions on the board.

    Seasons
    2025–2026
    On hand
    849 questions · 155 episodes
    Grain
    One row per question
    Source
    Talkin' Baseball episodes
    Terms
    Private

    Transcripts stay private. The question board on this site is the published part.

  • Read the Swing plays

    On hand

    The plays behind Read the Swing, each with its Statcast record and a trimmed clip.

    Seasons
    2024
    On hand
    200 plays · 176 clips
    Grain
    One row per play
    Source
    Baseball Savant video and Statcast
    Terms
    Personal use
  • Video index

    P2 · Every pitch

    A link from every tracked pitch to its public video on Baseball Savant, so any study can pull clips.

    Seasons
    2017–2026, planned
    Grain
    One row per pitch
    Source
    Baseball Savant
    Terms
    Personal use

    Links only. No video is stored.

Personal

Data I collect myself.

  • Read the Swing guesses

    On hand

    Every guess made in the game: the play, how early the video froze, the call and how long it took. Visitors' guesses are anonymous.

    Seasons
    2026
    On hand
    Collecting
    Grain
    One row per guess
    Source
    This site
    Terms
    Mine
  • Cage sessions

    P6 · Personal

    Every ball hit in front of the homemade tracker: exit speed, launch angle, spray, spin and a slow-motion clip.

    Seasons
    Starts when it's built
    Grain
    One row per ball
    Source
    The Cage Cam tracker, once its cameras are bought
    Terms
    Private

    Other hitters' sessions stay private; only my own swings could be published.

  • Games I've been to

    P6 · Personal

    A ledger of every game I've attended, joined to its box score and play-by-play, so each ticket opens the whole game.

    Seasons
    Starts when it's built
    Grain
    One row per game attended
    Source
    Me, joined through the game key
    Terms
    Mine
  • Take ledger

    P6 · Personal

    Predictions and claims, mine and ones heard on the show, logged with a date and graded when the answer comes in.

    Seasons
    Starts when it's built
    Grain
    One row per take
    Source
    Me
    Terms
    Mine
  • Fantasy league

    P6 · Personal

    Drafts, rosters, trades and matchups from my fantasy league, season by season.

    Seasons
    Starts when it's built
    Grain
    One row per roster move and matchup
    Source
    My Yahoo league
    Terms
    Private

    League-mates' names stay private.

    FeedsNo project yet
  • Gear specs

    P6 · Personal

    Bats and gloves measured: length, weight, balance point, pocket depth and break-in, with notes over a season.

    Seasons
    Starts when it's built
    Grain
    One row per item and measurement
    Source
    Measured by hand
    Terms
    Mine

Solid: the project needs it. Faint: the project could use it later.

How it's built

Parquet files, queried with DuckDB
  1. Surface

    Published

    Small extracts this site serves, cleared against each source's terms. Claim Check's streaks file is the first.

  2. −1

    Marts

    Tables ready for analysis: games, plays, pitches, player seasons, rosters.

  3. −2

    Clean

    Typed, de-duplicated and joined to the lake's ids for people, teams, parks and games.

  4. Floor

    Raw

    Every file exactly as downloaded, never edited, with where and when it came from.

  • Keep every raw file. Any table can be rebuilt from what was downloaded.
  • One id for everything. Each person, team, park and game gets one lake id, mapped to every source's ids.
  • Every number traces back. Each table records the files and steps that built it.
  • Check before publishing. Rows against the schedule, totals against official records, keys that must be unique.
  • Terms decide what's public. Open data can be shared. MLB data is for personal use, so the site shows analysis, not copies. Private data stays in the lake.
  • Refresh on a schedule. Daily in season for pitches, games and transactions; yearly for the historical releases.

Terms

What each label in the catalog means
Open data 7
Openly licensed. Can be shared with credit.
Personal use 20
MLB data, for individual, non-commercial use. The site shows analysis built on it, not copies of it.
Hand-built 4
Compiled by hand from public sources, with each fact cited.
Mine 4
Data I create.
Private 3
Kept off the site.
Terms to confirm 3
Not used until the source's terms are checked.

MLB data is used under MLB Advanced Media's terms, which allow individual, non-commercial use. When Retrosheet data arrives, its required notice will appear here and on every page that uses it.