MIRAGE MMST and MMMT leaderboards

University of Illinois Urbana-Champaign (AIFARMS and Center for Digital Agriculture) with Amazon

Before trusting an AI system on a farming or food task you need a way to check it. Ranks models on single-turn and multi-turn agricultural consultation tasks using identification accuracy, reasoning quality and management recommendation metrics.

Models, data & tools
Research & scientific knowledge
Free
Cloud-hosted
Visit provider site
QUICK INFO
SOLUTION TYPE
Models, data & tools
TECHNOLOGY CATEGORY
Benchmarks & evaluations
AREA OF WORK
Research & scientific knowledge
ACCESS
Free
DEPLOYMENT
Cloud-hosted
SOURCE REVIEWED
August 17, 2026

What it helps with

  • Compare models on farm consultation tasks
  • Which model identifies crop problems better
  • Rankings for multi turn farm advice
  • Check management recommendation scores
  • Leaderboard for farm vision language models

Scope & audience

WHO IT'S FOR

Scientist / researcher · Developer / AI builder

AREA OF WORK

Research & scientific knowledge

COMMODITY / SCOPE

Cross-commodity

Access & technical details

ACCESS

Anyone can get it

INTERFACE

Hosted leaderboard

DEPLOYMENT

Hosted by the publisher

LANGUAGES

Not stated by provider

Source information

This listing was compiled from publicly available source material. Verify current details with the provider.

PROVIDER DOCUMENTATION
Reviewed August 2026

Explore more like this

AgReason

BGLab
Models, data & tools
It is hard to tell whether a model really reasons about farming or just repeats textbook lines. This is a small test set of open-ended agricultural questions written by specialists, used to compare how models answer.
Free · Open source
Self-hosted / on-premise · Downloadable
Benchmarks & evaluations
View listing
AgReason
research-develop
research-and-scientific-knowledge
buildable-or-downloadable-component
benchmarks-and-evals
Free · Open source
Self-hosted / on-premise · Downloadable
August 17, 2026
  • Does this model really reason about farming
  • Compare how models answer farming questions
  • Expert written agricultural test questions
  • Score open ended farm answers
  • Check a model beyond textbook recall
  • Small test set for agronomy reasoning

SmartKisan-Finance Held-Out Eval Set

solokingM
Models, data & tools
Lending and insurance questions from small farmers need answers you can sanity check before going live. This is a small held-back question set shipped alongside a fine-tuned add-on for smallholder farm finance, for testing its replies.
Free · Open source
Self-hosted / on-premise · Downloadable
Benchmarks & evaluations
View listing
SmartKisan-Finance Held-Out Eval Set
trade-finance-move-goods
agricultural-markets-and-farm-finance
buildable-or-downloadable-component
benchmarks-and-evals
Free · Open source
Self-hosted / on-premise · Downloadable
August 17, 2026
  • Test a bot on farm loan questions
  • Check answers about crop insurance for small farms
  • Held back questions for farm finance models
  • Smallholder lending questions with answers
  • Sanity check a farm finance assistant before launch
Is this your Resource?

Contact us to claim this listing and add details, screenshots or a demo.