Commits

Breadcrumbs

History for

onmain

User selector

All users

All time

Commit history

Commits on Apr 21, 2026

• ci(evals): collapse failure analysis and reorder after results (#2852)

  Show description for 0a53aab
  mdrxy

  authored
  0a53aabView commit details

  Copy full SHA for 0a53aab

  View code at this pointBrowse repository at this point

Commits on Apr 18, 2026

• fix(evals): various eval fixes (#2812)

  Show description for 15e7163
  

  maahir30

  and

  mdrxy

  authored
  15e7163View commit details

  Copy full SHA for 15e7163

  View code at this pointBrowse repository at this point

Commits on Apr 9, 2026

• ci(infra): drop `claude-sonnet-4`, enable release integration test (#2612)

  Show description for 0cc27b1
  mdrxy

  authored
  0cc27b1View commit details

  Copy full SHA for 0cc27b1

  View code at this pointBrowse repository at this point

• fix(ci): use explicit None checks for eval metrics in aggregate_evals.py (#2442)

  Show description for 510c68f
  

  MilesQLi

  and

  mdrxy

  authored
  510c68fView commit details

  Copy full SHA for 510c68f

  View code at this pointBrowse repository at this point

• docs(infra): backfill package labels and restructure `AGENTS.md` (#2606)

  Show description for 0b6eca6
  mdrxy

  authored
  0b6eca6View commit details

  Copy full SHA for 0b6eca6

  View code at this pointBrowse repository at this point

Commits on Apr 8, 2026

• style(evals): improve CI summary layout and harden inline Python (#2550)

  Show description for 3b341f8
  mdrxy

  authored
  3b341f8View commit details

  Copy full SHA for 3b341f8

  View code at this pointBrowse repository at this point

• feat(evals): add LLM-powered failure analysis to eval CI (#2454)

  Show description for 668414f
  

  maahir30

  and

  mdrxy

  authored
  668414fView commit details

  Copy full SHA for 668414f

  View code at this pointBrowse repository at this point

• chore(evals): add nemotron back to `open` (#2545)

  mdrxy

  authored
  56590feView commit details

  Copy full SHA for 56590fe

  View code at this pointBrowse repository at this point

Commits on Apr 7, 2026

• feat(ci): label release-please PRs with package scope (#2539)

  Show description for a59cf0d
  mdrxy

  authored
  a59cf0dView commit details

  Copy full SHA for a59cf0d

  View code at this pointBrowse repository at this point

• release(modal): 0.0.3 (#2525)

  mdrxy

  authored
  9a95426View commit details

  Copy full SHA for 9a95426

  View code at this pointBrowse repository at this point

• feat(evals): add glm-5.1 via ollama and openrouter (#2513)

  Show description for 1f406d9
  mdrxy

  authored
  1f406d9View commit details

  Copy full SHA for 1f406d9

  View code at this pointBrowse repository at this point

• feat(ci): convert working-directory to validated dropdown (#2495)

  Show description for 441781c
  mdrxy

  authored
  441781cView commit details

  Copy full SHA for 441781c

  View code at this pointBrowse repository at this point

Commits on Apr 1, 2026

• ci(evals): per-provider concurrency and category dropdown (#2420)

  Show description for 8c51f4f
  mdrxy

  authored
  8c51f4fView commit details

  Copy full SHA for 8c51f4f

  View code at this pointBrowse repository at this point

• chore(evals): switch nemotron back to openrouter (#2409)

  mdrxy

  authored
  179ad33View commit details

  Copy full SHA for 179ad33

  View code at this pointBrowse repository at this point

• docs(evals): note `N/A` conditions (#2406)

  mdrxy

  authored
  10ede11View commit details

  Copy full SHA for 10ede11

  View code at this pointBrowse repository at this point

• ci(evals): consolidate experiment links and add dynamic run-name (#2392)

  Show description for cbe560d
  mdrxy

  authored
  cbe560dView commit details

  Copy full SHA for cbe560d

  View code at this pointBrowse repository at this point

Commits on Mar 31, 2026

• feat(evals): surface langsmith experiment URLs in reports and CI summaries (#2365)

  Show description for 04a4b39
  mdrxy

  authored
  04a4b39View commit details

  Copy full SHA for 04a4b39

  View code at this pointBrowse repository at this point

• refactor(evals): add section headings to model groups (#2371)

  Show description for d4447b7
  mdrxy

  authored
  d4447b7View commit details

  Copy full SHA for d4447b7

  View code at this pointBrowse repository at this point

Commits on Mar 26, 2026

• chore(evals): remove duplicate models from set1 (#2233)

  Show description for 1d69c27
  mdrxy

  authored
  1d69c27View commit details

  Copy full SHA for 1d69c27

  View code at this pointBrowse repository at this point

Commits on Mar 25, 2026

• chore(evals): switch nemotron 3 to ollama (#2226)

  mdrxy

  authored
  f459a23View commit details

  Copy full SHA for f459a23

  View code at this pointBrowse repository at this point

• feat(evals): add frontier and fast model group presets (#2221)

  Show description for 1bfef38
  mdrxy

  authored
  1bfef38View commit details

  Copy full SHA for 1bfef38

  View code at this pointBrowse repository at this point

• chore(evals): switch minimax 2.7 from openrouter to ollama (#2211)

  mdrxy

  authored
  4f0af9dView commit details

  Copy full SHA for 4f0af9d

  View code at this pointBrowse repository at this point

• chore(evals): switch nemotron from openrouter to baseten (#2209)

  mdrxy

  authored
  fefbfbaView commit details

  Copy full SHA for fefbfba

  View code at this pointBrowse repository at this point

Commits on Mar 24, 2026

• chore(evals): make model set dropdown optional, clean up ci summary (#2197)

  Show description for 0495d86
  mdrxy

  authored
  0495d86View commit details

  Copy full SHA for 0495d86

  View code at this pointBrowse repository at this point

• chore(evals): sort model registry alphabetically, etc. (#2196)

  Show description for 5c004dc
  mdrxy

  authored
  5c004dcView commit details

  Copy full SHA for 5c004dc

  View code at this pointBrowse repository at this point

• docs(evals): housekeeping (#2195)

  Show description for c410b74
  mdrxy

  authored
  c410b74View commit details

  Copy full SHA for c410b74

  View code at this pointBrowse repository at this point

• chore(evals): extend timeout, remove deepseek 3.2 from open (#2185)

  mdrxy

  authored
  c10d6cbView commit details

  Copy full SHA for c10d6cb

  View code at this pointBrowse repository at this point

• ci(evals): unify model group presets across eval and harbor workflows (#2176)

  Show description for 0f2fa32
  mdrxy

  authored
  0f2fa32View commit details

  Copy full SHA for 0f2fa32

  View code at this pointBrowse repository at this point

• ci(evals): expand harbor model coverage to match evals workflow (#2175)

  Show description for 90ec75e
  mdrxy

  authored
  90ec75eView commit details

  Copy full SHA for 90ec75e

  View code at this pointBrowse repository at this point

Commits on Mar 20, 2026

• fix(cli-gha): fix skill counter crash and add missing PR scopes (#2094)

  Show description for ddf9841
  mdrxy

  authored
  ddf9841View commit details

  Copy full SHA for ddf9841

  View code at this pointBrowse repository at this point

• fix(harbor): prevent command injection in workflow run blocks (#2085)

  Show description for d320649
  mdrxy

  authored
  d320649View commit details

  Copy full SHA for d320649

  View code at this pointBrowse repository at this point

• feat(harbor): add terminal bench workflow (#1765)

  Show description for 67f91b8
  

  eyurtsev

  and

  mdrxy

  authored
  67f91b8View commit details

  Copy full SHA for 67f91b8

  View code at this pointBrowse repository at this point

Commits on Mar 19, 2026

• ci: skip excluded files when applying package labels in `pr-labeler` (#2074)

  Show description for 9f1528f
  mdrxy

  authored
  9f1528fView commit details

  Copy full SHA for 9f1528f

  View code at this pointBrowse repository at this point

• fix(evals): add open-weight providers, per-model radar charts, and fix relational tool eval (#2065)

  Show description for 18d1cce
  mdrxy

  authored
  18d1cceView commit details

  Copy full SHA for 18d1cce

  View code at this pointBrowse repository at this point

• fix(evals): fix aggregate job and add per-category reporting (#2040)

  Show description for 307e883
  mdrxy

  authored
  307e883View commit details

  Copy full SHA for 307e883

  View code at this pointBrowse repository at this point