Implementation
gradeNot graded
gradeNot graded
get_releasesAnswer
List QA releases available in TestPilot, including version, name, lifecycle status, and creation time.
View tool JSON
{
"name": "get_releases",
"kind": "answer",
"impl": "imperative",
"description": "List QA releases available in TestPilot, including version, name, lifecycle status, and creation time.",
"inputSchema": {
"type": "object",
"properties": {},
"required": [],
"additionalProperties": false
}
}get_release_detailsAnswer
Get release metadata and its current computed readiness assessment for an exact version.
View tool JSON
{
"name": "get_release_details",
"kind": "answer",
"impl": "imperative",
"description": "Get release metadata and its current computed readiness assessment for an exact version.",
"inputSchema": {
"type": "object",
"properties": {
"version": {
"type": "string",
"description": "Exact release version, for example 2.4.",
"minLength": 1
}
},
"required": [
"version"
],
"additionalProperties": false
}
}get_requirementsAnswer
List all requirements for a release with priority, coverage status, and linked test case IDs.
View tool JSON
{
"name": "get_requirements",
"kind": "answer",
"impl": "imperative",
"description": "List all requirements for a release with priority, coverage status, and linked test case IDs.",
"inputSchema": {
"type": "object",
"properties": {
"version": {
"type": "string",
"description": "Exact release version, for example 2.4.",
"minLength": 1
}
},
"required": [
"version"
],
"additionalProperties": false
}
}get_test_casesAnswer
List test cases, optionally filtered to one requirement, including creator and latest result.
View tool JSON
{
"name": "get_test_cases",
"kind": "answer",
"impl": "imperative",
"description": "List test cases, optionally filtered to one requirement, including creator and latest result.",
"inputSchema": {
"type": "object",
"properties": {
"requirement_id": {
"type": "string",
"description": "Optional requirement ID such as REQ-003.",
"pattern": "^REQ-[0-9]{3}$"
}
},
"required": [],
"additionalProperties": false
}
}get_coverage_gapsAnswer
Find release requirements that have no linked test cases and return targeted test recommendations.
View tool JSON
{
"name": "get_coverage_gaps",
"kind": "answer",
"impl": "imperative",
"description": "Find release requirements that have no linked test cases and return targeted test recommendations.",
"inputSchema": {
"type": "object",
"properties": {
"version": {
"type": "string",
"description": "Exact release version to analyze.",
"minLength": 1
}
},
"required": [
"version"
],
"additionalProperties": false
}
}create_test_caseAction
Create a requirement-linked test case. Use this to close a discovered coverage gap; agent-created tests are visibly attributed in the UI.
View tool JSON
{
"name": "create_test_case",
"kind": "act",
"impl": "imperative",
"description": "Create a requirement-linked test case. Use this to close a discovered coverage gap; agent-created tests are visibly attributed in the UI.",
"inputSchema": {
"type": "object",
"properties": {
"title": {
"type": "string",
"description": "Concise test title.",
"minLength": 3,
"maxLength": 140
},
"description": {
"type": "string",
"description": "Scenario and setup details.",
"minLength": 3,
"maxLength": 1000
},
"requirement_id": {
"type": "string",
"description": "Requirement to cover, such as REQ-003.",
"pattern": "^REQ-[0-9]{3}$"
},
"expected_behavior": {
"type": "string",
"description": "Observable assertions that define success.",
"minLength": 3,
"maxLength": 1000
},
"created_by": {
"type": "string",
"enum": [
"AI Agent",
"Human"
],
"default": "AI Agent",
"description": "Creator attribution."
}
},
"required": [
"title",
"description",
"requirement_id",
"expected_behavior"
],
"additionalProperties": false
}
}run_testAction
Execute one deterministic QA test and persist its result, duration, failure details, and structured evidence.
View tool JSON
{
"name": "run_test",
"kind": "act",
"impl": "imperative",
"description": "Execute one deterministic QA test and persist its result, duration, failure details, and structured evidence.",
"inputSchema": {
"type": "object",
"properties": {
"test_id": {
"type": "string",
"description": "Test case ID such as TC-004.",
"pattern": "^TC-[0-9]{3}$"
}
},
"required": [
"test_id"
],
"additionalProperties": false
}
}run_release_regressionAction
Execute every current test case linked to a release and return a pass/fail summary with execution IDs.
View tool JSON
{
"name": "run_release_regression",
"kind": "act",
"impl": "imperative",
"description": "Execute every current test case linked to a release and return a pass/fail summary with execution IDs.",
"inputSchema": {
"type": "object",
"properties": {
"version": {
"type": "string",
"description": "Exact release version to test.",
"minLength": 1
}
},
"required": [
"version"
],
"additionalProperties": false
}
}get_execution_resultsAnswer
Retrieve one persisted test execution with result, timing, failure details, evidence, and test context.
View tool JSON
{
"name": "get_execution_results",
"kind": "answer",
"impl": "imperative",
"description": "Retrieve one persisted test execution with result, timing, failure details, evidence, and test context.",
"inputSchema": {
"type": "object",
"properties": {
"execution_id": {
"type": "string",
"description": "Execution ID such as EXE-004.",
"pattern": "^EXE-[0-9]{3}$"
}
},
"required": [
"execution_id"
],
"additionalProperties": false
}
}inspect_failureAction
Analyze a failed execution and return its root cause, impact, recommendation, and supporting evidence.
View tool JSON
{
"name": "inspect_failure",
"kind": "act",
"impl": "imperative",
"description": "Analyze a failed execution and return its root cause, impact, recommendation, and supporting evidence.",
"inputSchema": {
"type": "object",
"properties": {
"execution_id": {
"type": "string",
"description": "Failed execution ID to diagnose.",
"pattern": "^EXE-[0-9]{3}$"
}
},
"required": [
"execution_id"
],
"additionalProperties": false
}
}create_defectAction
Create a traceable defect with severity and optional execution evidence. Use critical severity for release-blocking safety failures.
View tool JSON
{
"name": "create_defect",
"kind": "act",
"impl": "imperative",
"description": "Create a traceable defect with severity and optional execution evidence. Use critical severity for release-blocking safety failures.",
"inputSchema": {
"type": "object",
"properties": {
"title": {
"type": "string",
"description": "Concise defect title.",
"minLength": 3,
"maxLength": 160
},
"description": {
"type": "string",
"description": "Observed behavior, impact, and relevant context.",
"minLength": 3,
"maxLength": 2000
},
"severity": {
"type": "string",
"enum": [
"low",
"medium",
"high",
"critical"
],
"description": "Defect severity."
},
"execution_id": {
"type": "string",
"description": "Optional failed execution providing evidence.",
"pattern": "^EXE-[0-9]{3}$"
},
"evidence": {
"type": "object",
"description": "Optional structured evidence when no execution is supplied.",
"additionalProperties": true
},
"created_by": {
"type": "string",
"enum": [
"AI Agent",
"Human"
],
"default": "AI Agent",
"description": "Creator attribution."
}
},
"required": [
"title",
"description",
"severity"
],
"additionalProperties": false
}
}link_defect_to_testAction
Link an existing defect to the test that exposed it, completing requirement-to-test-to-defect traceability.
View tool JSON
{
"name": "link_defect_to_test",
"kind": "act",
"impl": "imperative",
"description": "Link an existing defect to the test that exposed it, completing requirement-to-test-to-defect traceability.",
"inputSchema": {
"type": "object",
"properties": {
"defect_id": {
"type": "string",
"description": "Defect ID such as DEF-001.",
"pattern": "^DEF-[0-9]{3}$"
},
"test_id": {
"type": "string",
"description": "Test case ID such as TC-004.",
"pattern": "^TC-[0-9]{3}$"
}
},
"required": [
"defect_id",
"test_id"
],
"additionalProperties": false
}
}get_release_readinessAnswer
Compute the authoritative READY, AT RISK, or NOT READY recommendation from live coverage, latest results, and open defects.
View tool JSON
{
"name": "get_release_readiness",
"kind": "answer",
"impl": "imperative",
"description": "Compute the authoritative READY, AT RISK, or NOT READY recommendation from live coverage, latest results, and open defects.",
"inputSchema": {
"type": "object",
"properties": {
"version": {
"type": "string",
"description": "Exact release version to assess.",
"minLength": 1
}
},
"required": [
"version"
],
"additionalProperties": false
}
}reset_demoAction
Restore TestPilot to its deterministic initial competition-demo state for version 2.4.
View tool JSON
{
"name": "reset_demo",
"kind": "act",
"impl": "imperative",
"description": "Restore TestPilot to its deterministic initial competition-demo state for version 2.4.",
"inputSchema": {
"type": "object",
"properties": {},
"required": [],
"additionalProperties": false
}
}