MR
Mayur Rathi
@github
⭐ 34.1k GitHub stars

Arize-Instrumentation

Arize-Instrumentation是一款code方向的AI技能,核心价值是Adds Arize AX tracing to an LLM application for the first time,可用于解决开发者在code领域的实际问题,帮助用户提升效率、自动化重复任务或优化工作流。

Adds Arize AX tracing to an LLM application for the first time. Follows a two-phase agent-assisted flow to analyze the codebase then implement instrumentation after user confirmation. Use when the use

Last verified on: 2026-05-30
mkdir -p ./skills/arize-instrumentation && curl -sfL https://raw.githubusercontent.com/github/awesome-copilot/main/skills/arize-instrumentation/SKILL.md -o ./skills/arize-instrumentation/SKILL.md

Run in terminal / PowerShell. Requires curl (Unix) or PowerShell 5+ (Windows).

Skill Content

# Arize Instrumentation Skill


Use this skill when the user wants to **add Arize AX tracing** to their application. Follow the **two-phase, agent-assisted flow** from the [Agent-Assisted Tracing Setup](https://arize.com/docs/ax/alyx/tracing-assistant) and the [Arize AX Tracing — Agent Setup Prompt](https://arize.com/docs/PROMPT.md).


Quick start (for the user)


If the user asks you to "set up tracing" or "instrument my app with Arize", you can start with:


> Follow the instructions from https://arize.com/docs/PROMPT.md and ask me questions as needed.


Then execute the two phases below.


Core principles


- **Prefer inspection over mutation** — understand the codebase before changing it.

- **Do not change business logic** — tracing is purely additive.

- **Use auto-instrumentation where available** — add manual spans only for custom logic not covered by integrations.

- **Follow existing code style** and project conventions.

- **Keep output concise and production-focused** — do not generate extra documentation or summary files.

- **NEVER embed literal credential values in generated code** — always reference environment variables (e.g., `os.environ["ARIZE_API_KEY"]`, `process.env.ARIZE_API_KEY`). This includes API keys, space IDs, and any other secrets. The user sets these in their own environment; the agent must never output raw secret values.


Phase 0: Environment preflight


Before changing code:


1. Confirm the repo/service scope is clear. For monorepos, do not assume the whole repo should be instrumented.

2. Identify the local runtime surface you will need for verification:

- package manager and app start command

- whether the app is long-running, server-based, or a short-lived CLI/script

- whether `ax` will be needed for post-change verification

3. Do NOT proactively check `ax` installation or version. If `ax` is needed for verification later, just run it when the time comes. If it fails, see references/ax-profiles.md.

4. Never silently replace a user-provided space ID, project name, or project ID. If the CLI, collector, and user input disagree, surface that mismatch as a concrete blocker.


Phase 1: Analysis (read-only)


**Do not write any code or create any files during this phase.**


Steps


1. **Check dependency manifests** to detect stack:

- Python: `pyproject.toml`, `requirements.txt`, `setup.py`, `Pipfile`

- TypeScript/JavaScript: `package.json`

- Java: `pom.xml`, `build.gradle`, `build.gradle.kts`

- Go: `go.mod`


2. **Scan import statements** in source files to confirm what is actually used.


3. **Check for existing tracing/OTel** — look for `TracerProvider`, `register()`, `opentelemetry` imports, `ARIZE_*`, `OTEL_*`, `OTLP_*` env vars, or other observability config (Datadog, Honeycomb, etc.).


4. **Identify scope** — for monorepos or multi-service projects, ask which service(s) to instrument.


What to identify


| Item | Examples |

|------|----------|

| Language | Python, TypeScript/JavaScript, Java, Go |

| Package manager | pip/poetry/uv, npm/pnpm/yarn, maven/gradle, go modules |

| LLM providers | OpenAI, Anthropic, LiteLLM, Bedrock, etc. |

| Frameworks | LangChain, LangGraph, LlamaIndex, Vercel AI SDK, Mastra, etc. |

| Existing tracing | Any OTel or vendor setup |

| Tool/function use | LLM tool use, function calling, or custom tools the app executes (e.g. in an agent loop) |


**Key rule:** When a framework is detected alongside an LLM provider, inspect the framework-specific tracing docs first and prefer the framework-native integration path when it already captures the model and tool spans you need. Add separate provider instrumentation only when the framework docs require it or when the framework-native integration leaves obvious gaps. If the app runs tools and the framework integration does not emit tool spans, add manual TOOL spans so each invocation appears with input/output (see **Enriching traces** below).


Phase 1 output


Return a concise summary:


- Detected languag

🎯 Best For

  • Data analysts
  • Business intelligence teams
  • Claude users
  • GitHub Copilot users
  • Software engineers

💡 Use Cases

  • Finding patterns in customer data
  • Creating automated dashboards
  • Code quality improvement
  • Best practice enforcement

📖 How to Use This Skill

  1. 1

    Install the Skill

    Copy the install command from the Terminal tab and run it. The SKILL.md file downloads to your local skills directory.

  2. 2

    Load into Your AI Assistant

    Open Claude or GitHub Copilot and reference the skill. Paste the SKILL.md content or use the system prompt tab.

  3. 3

    Apply Arize-Instrumentation to Your Work

    Open your project in the AI assistant and ask it to apply the skill. Start with a small module to verify the output quality.

  4. 4

    Review and Refine

    Review AI suggestions before committing. Run tests, check for regressions, and iterate on the skill output.

❓ Frequently Asked Questions

Can this connect to my database directly?

Most data skills accept CSV or JSON input. Database connectors are listed in the Works With section.

Is Arize-Instrumentation compatible with Cursor and VS Code?

Yes — this skill works with any AI coding assistant including Cursor, VS Code with Copilot, and JetBrains IDEs.

Do I need specific dependencies for Arize-Instrumentation?

Check the install command and Works With section. Most code skills only require the AI assistant and your codebase.

How do I install Arize-Instrumentation?

Copy the install command from the Terminal tab and run it. The skill downloads to ./skills/arize-instrumentation/SKILL.md, ready to use.

Can I customize this skill for my team?

Absolutely. Edit the SKILL.md file to add team-specific instructions, examples, or workflows.

⚠️ Common Mistakes to Avoid

Not validating data quality

AI analysis is only as good as your input data. Profile and clean data before analysis.

Skipping validation

Always test AI-generated code changes, even for simple refactors.

Missing dependency updates

Check if the skill requires updated dependencies or new packages.

🔗 Related Skills