Benchmarks

Head-to-head evaluations and dataset validations, with the data, task, baseline, method, and outputs disclosed.

July 2026

Reproducibility

Sutrix vs. Claude API

Three synthetic ground-truth studies · 5 runs per arm

Exact reproducibility of the primary numerical result

Sutrix returned an identical primary statistic in all 15 runs. Claude’s exact result varied across repeated runs.

2026

Head-to-head

Sutrix vs. Julius AI

De-identified concussion-knowledge survey · 348 participants × 152 columns

Instrument-aware data preparation and scoring

Sutrix scored 31/31. Julius scored 18/31 and reversed 305 of 309 recorded gender values.

2026

Head-to-head

Sutrix vs. ChatGPT (GPT-4o)

De-identified concussion-knowledge survey · 348 participants × 152 columns

Research-data preparation and instrument scoring

Sutrix scored 31/31. ChatGPT scored 2/31 and did not produce an analysis-ready dataset.

Let’s talk about your study

What do you want
your data to answer?

Bring your research question and where the analysis is getting stuck. We’ll discuss the data you have, the work you need, and whether Sutrix is a fit.

Book a study call

30 minutes with Supratik, co-founder · Google Meet

How is my project priced?

We scope the work around your data, instruments, research questions, and the materials you need. We agree the deliverables, timing, project price, and included follow-up before analysis begins. The call is where we establish what your study needs.

Who checks the analysis?

Sutrix is a managed service with human review. Our team checks scoring, analytical choices, and interpretation; your team supplies the study context. The delivered methods and code let you inspect the work. Meet the founders.

What should I bring to the call?

Your research question, the kind of data you collected, where you’re stuck, and any deadline. No account or dataset is needed. We agree on data-sharing arrangements before requesting de-identified study data. Read about data handling.