add APIs for llm obs

[gary-huang]

What Does This Do

Motivation

Additional Notes

Contributor Checklist

• Format the title according the contribution guidelines
• Assign the type: and (comp: or inst:) labels in addition to any usefull labels
• Don't use close, fix or any linking keywords when referencing an issue.
  Use solves instead, and assign the PR milestone to the issue
• Update the public documentation in case of new configuration flag or behavior

Jira ticket: [PROJ-IDENT]

[pr-commenter]

Benchmarks

Startup

Load

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	gary/add-llm-obs-api
git_commit_date	1735830355	1735844010
git_commit_sha	1951e6f	dd637fd
release_version	1.45.0-SNAPSHOT~1951e6f72e	1.45.0-SNAPSHOT~dd637fd91f

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1735846845	1735846845
ci_job_id	753033935	753033935
ci_pipeline_id	52043800	52043800
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant	appsec	appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.45.0-SNAPSHOT~dd637fd91f, baseline=1.45.0-SNAPSHOT~1951e6f72e
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.466 s) : 15466000, 15466000
.   : milestone, 15466000,
appsec (14.963 s) : 14963000, 14963000
.   : milestone, 14963000,
iast (18.888 s) : 18888000, 18888000
.   : milestone, 18888000,
iast_GLOBAL (18.069 s) : 18069000, 18069000
.   : milestone, 18069000,
profiling (14.796 s) : 14796000, 14796000
.   : milestone, 14796000,
tracing (15.008 s) : 15008000, 15008000
.   : milestone, 15008000,
section candidate
no_agent (15.469 s) : 15469000, 15469000
.   : milestone, 15469000,
appsec (14.8 s) : 14800000, 14800000
.   : milestone, 14800000,
iast (18.946 s) : 18946000, 18946000
.   : milestone, 18946000,
iast_GLOBAL (17.624 s) : 17624000, 17624000
.   : milestone, 17624000,
profiling (15.204 s) : 15204000, 15204000
.   : milestone, 15204000,
tracing (15.087 s) : 15087000, 15087000
.   : milestone, 15087000,

Loading

• baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.466 s [15.466 s, 15.466 s]	-
appsec	14.963 s [14.963 s, 14.963 s]	-503.0 ms (-3.3%)
iast	18.888 s [18.888 s, 18.888 s]	3.422 s (22.1%)
iast_GLOBAL	18.069 s [18.069 s, 18.069 s]	2.603 s (16.8%)
profiling	14.796 s [14.796 s, 14.796 s]	-670.0 ms (-4.3%)
tracing	15.008 s [15.008 s, 15.008 s]	-458.0 ms (-3.0%)

• candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.469 s [15.469 s, 15.469 s]	-
appsec	14.8 s [14.8 s, 14.8 s]	-669.0 ms (-4.3%)
iast	18.946 s [18.946 s, 18.946 s]	3.477 s (22.5%)
iast_GLOBAL	17.624 s [17.624 s, 17.624 s]	2.155 s (13.9%)
profiling	15.204 s [15.204 s, 15.204 s]	-265.0 ms (-1.7%)
tracing	15.087 s [15.087 s, 15.087 s]	-382.0 ms (-2.5%)

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.45.0-SNAPSHOT~dd637fd91f, baseline=1.45.0-SNAPSHOT~1951e6f72e
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.474 ms) : 1463, 1486
.   : milestone, 1474,
appsec (2.359 ms) : 2317, 2401
.   : milestone, 2359,
iast (2.106 ms) : 2052, 2159
.   : milestone, 2106,
iast_GLOBAL (2.155 ms) : 2101, 2209
.   : milestone, 2155,
profiling (1.989 ms) : 1945, 2033
.   : milestone, 1989,
tracing (1.94 ms) : 1898, 1981
.   : milestone, 1940,
section candidate
no_agent (1.47 ms) : 1459, 1482
.   : milestone, 1470,
appsec (2.362 ms) : 2319, 2404
.   : milestone, 2362,
iast (2.095 ms) : 2041, 2148
.   : milestone, 2095,
iast_GLOBAL (2.152 ms) : 2098, 2206
.   : milestone, 2152,
profiling (1.966 ms) : 1923, 2008
.   : milestone, 1966,
tracing (1.936 ms) : 1895, 1978
.   : milestone, 1936,

Loading

• baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.474 ms [1.463 ms, 1.486 ms]	-
appsec	2.359 ms [2.317 ms, 2.401 ms]	884.834 µs (60.0%)
iast	2.106 ms [2.052 ms, 2.159 ms]	631.59 µs (42.8%)
iast_GLOBAL	2.155 ms [2.101 ms, 2.209 ms]	680.784 µs (46.2%)
profiling	1.989 ms [1.945 ms, 2.033 ms]	514.912 µs (34.9%)
tracing	1.94 ms [1.898 ms, 1.981 ms]	465.533 µs (31.6%)

• candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.47 ms [1.459 ms, 1.482 ms]	-
appsec	2.362 ms [2.319 ms, 2.404 ms]	891.503 µs (60.6%)
iast	2.095 ms [2.041 ms, 2.148 ms]	624.969 µs (42.5%)
iast_GLOBAL	2.152 ms [2.098 ms, 2.206 ms]	681.741 µs (46.4%)
profiling	1.966 ms [1.923 ms, 2.008 ms]	495.651 µs (33.7%)
tracing	1.936 ms [1.895 ms, 1.978 ms]	466.4 µs (31.7%)

[mcculls]

FYI, internal APIs should be added to the internal-api module.

You can keep the same package structure and they will still be visible to the tracer internals.

[gary-huang]

ah gotcha, thanks!