Tool tree
gradeNot graded
page: Home
describeAnswer
Describe the Jev Bench results page, its selected experiment, and available controls.
View tool JSON
{
"name": "describe",
"kind": "answer",
"impl": "imperative",
"description": "Describe the Jev Bench results page, its selected experiment, and available controls.",
"inputSchema": {
"type": "object",
"properties": {},
"required": [],
"additionalProperties": false
},
"page": "/"
}list_runsAnswer
List the published classification experiments available in the page's experiment selector.
View tool JSON
{
"name": "list_runs",
"kind": "answer",
"impl": "imperative",
"description": "List the published classification experiments available in the page's experiment selector.",
"inputSchema": {
"type": "object",
"properties": {},
"required": [],
"additionalProperties": false
},
"page": "/"
}get_resultsAnswer
Read the selected experiment's latency, accuracy, error counts, and returned model names.
View tool JSON
{
"name": "get_results",
"kind": "answer",
"impl": "imperative",
"description": "Read the selected experiment's latency, accuracy, error counts, and returned model names.",
"inputSchema": {
"type": "object",
"properties": {},
"required": [],
"additionalProperties": false
},
"page": "/"
}select_runAction
Select a published experiment and return the results now displayed on the page.
View tool JSON
{
"name": "select_run",
"kind": "act",
"impl": "imperative",
"description": "Select a published experiment and return the results now displayed on the page.",
"inputSchema": {
"type": "object",
"properties": {
"run_id": {
"type": "string"
}
},
"required": [
"run_id"
],
"additionalProperties": false
},
"page": "/"
}set_metricAction
Change the latency chart to median, mean, or p95 and return the updated displayed results.
View tool JSON
{
"name": "set_metric",
"kind": "act",
"impl": "imperative",
"description": "Change the latency chart to median, mean, or p95 and return the updated displayed results.",
"inputSchema": {
"type": "object",
"properties": {
"metric": {
"type": "string",
"enum": [
"median_ms",
"mean_ms",
"p95_ms"
]
}
},
"required": [
"metric"
],
"additionalProperties": false
},
"page": "/"
}get_accuracyAnswer
Read the selected model’s classification accuracy, per-class scores, and every incorrect prediction against the dataset labels.
View tool JSON
{
"name": "get_accuracy",
"kind": "answer",
"impl": "imperative",
"description": "Read the selected model’s classification accuracy, per-class scores, and every incorrect prediction against the dataset labels.",
"inputSchema": {
"type": "object",
"properties": {},
"required": [],
"additionalProperties": false
},
"page": "/"
}select_accuracy_modelAction
Choose a model in the selected experiment and return the accuracy and mistakes now displayed on the page.
View tool JSON
{
"name": "select_accuracy_model",
"kind": "act",
"impl": "imperative",
"description": "Choose a model in the selected experiment and return the accuracy and mistakes now displayed on the page.",
"inputSchema": {
"type": "object",
"properties": {
"model_name": {
"type": "string"
}
},
"required": [
"model_name"
],
"additionalProperties": false
},
"page": "/"
}page: Test sets
describeAnswer
Describe the test-sets page and the decision test sets it shows.
View tool JSON
{
"name": "describe",
"kind": "answer",
"impl": "imperative",
"description": "Describe the test-sets page and the decision test sets it shows.",
"inputSchema": {
"type": "object",
"properties": {},
"required": [],
"additionalProperties": false
},
"page": "/test-sets.html"
}list_test_setsAnswer
List the published test sets with their question type, labels and case count.
View tool JSON
{
"name": "list_test_sets",
"kind": "answer",
"impl": "imperative",
"description": "List the published test sets with their question type, labels and case count.",
"inputSchema": {
"type": "object",
"properties": {},
"required": [],
"additionalProperties": false
},
"page": "/test-sets.html"
}get_test_setAnswer
Read one test set's instructions, labels, criteria, cases and expected answers.
View tool JSON
{
"name": "get_test_set",
"kind": "answer",
"impl": "imperative",
"description": "Read one test set's instructions, labels, criteria, cases and expected answers.",
"inputSchema": {
"type": "object",
"properties": {
"set_id": {
"type": "string"
}
},
"required": [
"set_id"
],
"additionalProperties": false
},
"page": "/test-sets.html"
}