CLI Command Reference
Icho includes a powerful CLI utility to search, inspect, replay, format, and audit your stored AI execution cassettes.
1. AI Test Datasets & Suite Runner (`icho test`) 🧪
Run batch test suites across domain directories, parallel workers (-j), and regression suites:
# Run batch test suite across a domain directory icho test tests/customer_support/ # Run multi-domain dataset with parallel worker pool icho test tests/ -j 4 # Run regression suite across datasets against reference cassettes icho test tests/customer_support/ --mode regression --threshold 0.85 --fail-on-drift
2. Search Executions (`icho search`)
Search recorded executions using TF-IDF cosine similarity and time/metadata filters:
icho search "refund" --since yesterday --provider groq --top-k 5 --interactive
2. Replay Specific Execution (`icho replay`)
Inspect cassette payload and generate a ready-to-use Python replay code snippet:
icho replay a1f7d9e4
3. Execution Log (`icho log`)
Git-like chronological log of recorded AI executions:
icho log -n 10
4. Get Cache Statistics (`icho stats`)
Calculate total cassettes, total size on disk, and estimated API latency saved:
icho stats --path ./tests/cassettes
5. List Stored Cassettes (`icho inspect`)
Display a formatted summary table of all cassettes, models, and timestamps:
icho inspect --path ./tests/cassettes
6. Clean & Format Cassettes (`icho clean`)
Format cassettes and strip volatile fields (such as latency or timestamps) to prevent noisy git diffs:
icho clean --path ./tests/cassettes --remove-latency --remove-timestamps