How to Run Umpire Evaluations Without Making It Weird

Quick answers

• What should an umpire evaluation form cover? Keep it to four things scored 1-5: positioning, rules knowledge, game management, and hustle.
• Who should evaluate umpires? Your commissioner or a trusted veteran ump — never coaches acting alone, since they have a stake in the calls.
• How often should you evaluate? A couple of quick observations per ump per season is plenty; you’re building a picture, not filing a performance review.
• What are evaluations actually for? Development and fair playoff assignments — not gotchas or building a case to fire someone.

Why most rec leagues skip this — and why that backfires

Most small leagues never evaluate their umpires. I get it. The word “evaluation” sounds like a corporate HR ritual, complete with a form nobody reads and an awkward sit-down that makes a good volunteer feel like they’re on trial. So we skip it. We tell ourselves we “just know” who our good umps are.

Then playoffs arrive, and you have to decide who works the plate for the championship. You give it to Dave. And now half the umpire pool quietly assumes Dave got it because he’s your buddy — because there’s no visible reason he got it instead of them. You didn’t play favorites, but from the outside it looks exactly like favoritism, because you never showed your work.

That’s the real problem evaluations solve. Not “catching” bad umpires. Making your best decisions legible — the same reason we care so much about rotating crews fairly. Fairness that nobody can see isn’t doing you any good.

So here’s how to run evaluations that are genuinely useful and don’t make anybody feel weird.

The rubric: four things, scored 1-5

Resist the urge to build a 30-line umpire evaluation form. Nobody fills those out honestly, and the detail creates a false sense of precision. You want something you can complete in the parking lot from memory. Four categories, each scored 1 (needs work) to 5 (excellent):

1. Positioning

Are they in the right place to make the call? Plate ump working the slot and staying down through the pitch. Base ump getting angles instead of guessing from where they happened to be standing. Bad positioning is the single most common thing separating a raw ump from a solid one, and it’s the most coachable.

2. Rules knowledge

Do they get the calls right — and, just as important, do they handle the weird ones without panicking? Anybody can call a routine grounder. You’re watching for the dropped third strike, the appeal play, the timing on obstruction. A 3 here is fine. A 2 tells you where to point your new-umpire training.

3. Game management

This is the one that separates umpires who last from umpires who burn out. Do they hustle a heated moment back down? Do they sell the tough call with confidence instead of apologizing for it? Do they keep the game moving? An ump who nails the rulebook but escalates every argument is a bigger problem than one who misses a call and calmly moves on.

4. Hustle

Effort. Are they running to get the angle, or coasting? Are they engaged, or checked out between innings? Hustle covers a lot of sins with players and coaches — people forgive a blown call from someone who was clearly trying.

That’s it. Sixteen possible points, one line of notes at the bottom. If you want to add a single freeform “one thing to work on” field, do it. Anything more and you’ve built something you’ll never actually use.

Who does the evaluating

This is where leagues get it wrong. The two failure modes:

• Coaches evaluate. Never let coaches evaluate umpires as your primary source. It’s not that coaches are dishonest — it’s that they have a direct stake in the calls that went against their team, and they were watching their kid, not the umpire’s footwork. A coach who lost a close game will rate the plate ump lower, every time. If you want coach input, use it as a loose sanity check, aggregated, never as a single coach’s verdict.
• Nobody evaluates. Which is where we started.

The right answer is you — the commissioner — or a veteran umpire you trust to watch mechanics without ego. A good senior ump can stand behind the backstop for twenty minutes and tell you more than a season of coach complaints. They’re watching the things coaches can’t even see. Bonus: being asked to evaluate is a form of respect, and it keeps your best veterans invested. That ties right into the mid-season check-in — retention is mostly about people feeling seen.

One rule: whoever evaluates should have watched at least a few innings live. No rating umpires off a rumor or one bad text from a parent.

Use it for development, not gotchas

Here’s the framing that keeps this from feeling like a trap. Tell your umpires, up front, exactly what the umpire rating system is for and what it isn’t.

It is for:

• Knowing who’s ready for the plate in a big game
• Pointing your training at real, specific gaps (“you’re guessing on plays at first — let’s work angles”)
• Giving newer umps a path to grow into better assignments

It is not for:

• Building a paper trail to push someone out
• Reacting to a single loud coach
• Ranking people publicly

Share the rubric with everyone before the season. There’s nothing secret about it. When an ump knows they’re graded on positioning, rules, management, and hustle — and knows those scores open the door to better games — the evaluation stops feeling like surveillance and starts feeling like a ladder. That’s the whole difference between “we’re watching you” and “here’s how you move up.”

Tie ratings to playoff plates — visibly

Now the payoff. When championship weekend comes, you’re not guessing and you’re not defending a hunch. Your top plate umpires by rules and game management get the plate. Base spots go to your solid, hustling crew. And if someone asks why they didn’t get the plate, you have a real, non-personal answer: “Your positioning and management scored strong this year — the plate assignments went to the two highest there, and here’s what gets you into that group next season.”

That conversation is night-and-day better than “because I said so.” It’s the same principle behind everything we bang the drum about here — visible fairness beats invisible good intentions. UmpCrew’s fairness dashboard already shows every ump exactly how many games they’ve worked so game counts are never a mystery; a light evaluation habit does the same thing for game quality. Between the two, “why did they get that assignment” basically stops being a question anyone can ask in bad faith.

Keep the notes somewhere simple — a shared sheet is fine. The tool doesn’t matter. The habit does.

Frequently asked questions

Should I show umpires their own scores?

Yes, one-on-one and privately, framed as development. “Here’s where you’re strong, here’s the one thing to work on.” Never post a ranked list — that’s the fastest way to make evaluations feel like public shaming and lose people.

What if I only have a handful of umpires?

The rubric still helps, but you may not need formal scores — you need the habit of watching for those four things and giving specific feedback. Small pools live or die on retention, so lean development-heavy. If recruiting is your real bottleneck, we wrote about finding and keeping umpires separately.

Can an ump’s rating cost them games mid-season?

It shouldn’t. Mid-season, a low score means a coaching conversation, not benching — pulling assignments over a rough stretch is how you lose a volunteer for good. Ratings inform the high-stakes assignments like playoff plates, not your week-to-week schedule.

How is this different from just tracking complaints?

Complaints are reactive and skewed toward whoever yelled loudest, usually a coach who lost. An evaluation is proactive and watches the things that actually predict a good umpire — footwork, timing, temperament — most of which coaches never notice.

If you’d rather spend your season watching umpires instead of chasing spreadsheets, start a free 14-day trial — no credit card — and let the scheduling run itself while you focus on the ones behind the backstop.