mcpField
A
alicloud-observability-pts-test

alicloud-observability-pts-test

github.com/cinienceTesting & quality396157 installsUpdated 11w ago
Repository

About alicloud-observability-pts-test

A smoke-test skill for the Alibaba Cloud PTS skill. It checks script compilation, discovers API metadata, and can optionally run a bounded read-only scene query while saving the outputs.

Key features

  1. 01Offline script compilation check
  2. 02PTS API metadata discovery
  3. 03JSON and Markdown output checks
  4. 04Optional bounded scene query
  5. 05Test evidence capture

Use cases

  1. 01Validate the PTS skill scripts
  2. 02Generate and inspect the PTS API list
  3. 03Check a read-only PTS scene response

Install

Copy the command and run it in a terminal.

$npx skills add https://github.com/cinience/alicloud-skills --skill alicloud-observability-pts-test

After installing, type/alicloud-observability-pts-testin Claude Code to confirm it loaded.

Details

From the project README

Category: test

OBSERVABILITY PTS Smoke Test

Prerequisites

  • Configure credentials with least privilege (ALIBABACLOUD_ACCESS_KEY_ID / ALIBABACLOUD_ACCESS_KEY_SECRET / optional ALIBABACLOUD_REGION_ID) if you plan to execute real PTS APIs.
  • Target skill: skills/observability/pts/alicloud-observability-pts/.
  • Optional online SDK test dependency:
python -m pip install -U alibabacloud_pts20201020 alibabacloud_tea_openapi

Test Steps

  1. Run offline script compilation check (no network needed):
python3 tests/common/compile_skill_scripts.py \
  --skill-path skills/observability/pts/alicloud-observability-pts \
  --output output/alicloud-observability-pts-test/compile-check.json
  1. Run metadata API discovery script:
python3 skills/observability/pts/alicloud-observability-pts/scripts/list_openapi_meta_apis.py \
  --product-code PTS \
  --version 2020-10-20 \
  --output-dir output/alicloud-observability-pts-test
  1. Verify generated files and API count:
test -f output/alicloud-observability-pts-test/PTS_2020-10-20_api_docs.json
test -f output/alicloud-observability-pts-test/PTS_2020-10-20_api_list.md
rg -n "API count: [1-9][0-9]*" output/alicloud-observability-pts-test/PTS_2020-10-20_api_list.md
  1. Save request summary, response summary, and raw output under output/alicloud-observability-pts-test/.
  2. If the call fails, record exact error code/message without guessing.

Optional Online Read-only Check

Run one bounded read-only scene query:

python3 skills/observability/pts/alicloud-observability-pts/scripts/list_pts_scenes.py \
  --region "${ALIBABACLOUD_REGION_ID:-cn-hangzhou}" \
  --page-number 1 \
  --page-size 10 \
  --json \
  --output output/alicloud-observability-pts-test/list-scenes.json

Then verify output contains response metadata:

rg -n '\"RequestId\"|\"Success\"|\"Code\"' output/alicloud-observability-pts-test/list-scenes.json

Pass Criteria

  • Script compilation check passes (compile-check.json.status=pass).
  • Metadata API discovery succeeds and produces both JSON and markdown output files.
  • API list markdown shows a positive API count.
  • Evidence files exist in output/alicloud-observability-pts-test/.
  • Optional online read-only check returns a valid PTS response structure.

Result Template

  • Date: YYYY-MM-DD
  • Skill: skills/observability/pts/alicloud-observability-pts
  • Conclusion: pass / fail
  • Notes:

Comments

Markdown supported