Skip to main content

CLI Commands

The executable is testbench-ai-service. All commands support --help for detailed usage.

testbench-ai-service [COMMAND] [OPTIONS]

Commands overview

CommandDescription
initGenerate a default configuration file and prompt files.
startStart the TestBench AI Service.
--version, -vPrint the installed version.
--helpShow top-level help.

init

Generate a default configuration file and copy built-in prompt files.

testbench-ai-service init [OPTIONS]

What it does

  1. Copies built-in prompt YAML files to the specified prompts directory (default: ./prompts).
  2. Generates a config.toml with default settings, including the prompts_dir path.

Options

OptionDescriptionDefault
--path PATHPath to the configuration file to generate.config.toml
--force, -fOverwrite the configuration file and prompts directory if they exist.
--prompts-dir PATHCopy default prompt files to PATH and set prompts_dir in the config. Pass an empty string to skip.prompts

Examples

# Create config.toml and copy prompts to ./prompts
testbench-ai-service init

# Custom paths
testbench-ai-service init --path my_config.toml --prompts-dir ./my-prompts

# Overwrite existing files
testbench-ai-service init --force

# Skip prompt copy
testbench-ai-service init --prompts-dir ""

start

Start the TestBench AI Service.

testbench-ai-service start [OPTIONS]

Options

OptionDescriptionDefault
--config PATHPath to the app configuration file.config.toml
--host HOSTHost to bind to.127.0.0.1
--port PORTPort to listen on.8010
--devRun in development mode (debug logging + auto-reload).
--tb-server-url URLBase URL of the TestBench REST API Server.from config

Command-line arguments take precedence over configuration file settings.

Examples

# Start with defaults
testbench-ai-service start

# Start with a specific config file
testbench-ai-service start --config my_config.toml

# Override host and port
testbench-ai-service start --host 0.0.0.0 --port 9000

# Development mode (with auto-reload)
testbench-ai-service start --dev

# Override TestBench server URL
testbench-ai-service start --tb-server-url https://testbench.example.com/api/

Getting help

# General help
testbench-ai-service --help

# Help for a specific command
testbench-ai-service start --help
testbench-ai-service init --help