Skip to content

feat(server-utils): Map Mastra classifier evaluations to gen_ai.evaluate spans #60690

feat(server-utils): Map Mastra classifier evaluations to gen_ai.evaluate spans

feat(server-utils): Map Mastra classifier evaluations to gen_ai.evaluate spans #60690

Re-run triggered October 7, 2026 08:36
Status Failure
Total duration 7m 16s
Artifacts 9

build.yml

on: pull_request
Get CI Metadata  /  Get Metadata
6s
Get CI Metadata / Get Metadata
Check lockfile
Check lockfile
Check file formatting
38s
Check file formatting
Check PR branches
5s
Check PR branches
Build Lambda layer
1m 36s
Build Lambda layer
Matrix: job_bun_integration_tests
Matrix: job_bundler_plugin_integration_tests
Matrix: job_cloudflare_integration_tests
Matrix: job_deno_integration_tests
Matrix: job_node_integration_tests
Matrix: job_node_unit_tests
Lint
1m 22s
Lint
Circular Dependency Check
1m 30s
Circular Dependency Check
Browser Unit Tests
47s
Browser Unit Tests
Bun Unit Tests
40s
Bun Unit Tests
Deno Unit Tests
1m 16s
Deno Unit Tests
Check for faulty .d.ts files
42s
Check for faulty .d.ts files
Matrix: job_browser_loader_tests
Matrix: job_browser_playwright_tests
Matrix: job_optional_e2e_tests
Upload Artifacts
Upload Artifacts
Matrix: job_e2e_tests
All required jobs passed or were skipped
3s
All required jobs passed or were skipped
Fit to window
Zoom out
Zoom in

Annotations

15 errors and 3 notices
E2E nextjs-16-streaming-cacheComponents Test
Process completed with exit code 1.
[chromium] › tests/useCacheSpans.spec.ts:11:5 › uses low-cardinality names for `use cache` spans: ../../_temp/test-application/tests/useCacheSpans.spec.ts#L40
1) [chromium] › tests/useCacheSpans.spec.ts:11:5 › uses low-cardinality names for `use cache` spans Error: expect(received).toBe(expected) // Object.is equality Expected: undefined Received: "app/api/use-cache/route.ts" 38 | expect(putSpan!.attributes['cache.key']?.value).toEqual(cacheKeyDigest); 39 | > 40 | expect(putSpan!.attributes['code.file.path']?.value).toBe(expectedRouteHandlerFilePath); | ^ 41 | }); 42 | 43 | test('sets the source file of the cached component on `cache.put` spans', async ({ request }) => { at /home/runner/work/_temp/test-application/tests/useCacheSpans.spec.ts:40:56
E2E nextjs-16-cacheComponents Test
Process completed with exit code 1.
[chromium] › tests/useCacheSpans.spec.ts:10:5 › Should create cache spans around `use cache` functions: ../../_temp/test-application/tests/useCacheSpans.spec.ts#L66
1) [chromium] › tests/useCacheSpans.spec.ts:10:5 › Should create cache spans around `use cache` functions Error: expect(received).toBe(expected) // Object.is equality Expected: undefined Received: "app/api/use-cache/route.ts" 64 | }); 65 | > 66 | expect(putSpan!.data?.['code.file.path']).toBe(expectedRouteHandlerFilePath); | ^ 67 | 68 | const hitGetSpan = hitTx.spans?.find(span => span.op === 'cache.get'); 69 | expect(hitGetSpan).toBeDefined(); at /home/runner/work/_temp/test-application/tests/useCacheSpans.spec.ts:66:45
[chromium] › tests/parameterized-routes.test.ts:65:5 › should create a nested parameterized pageload span when the `app` directory is used: ../../_temp/test-application/tests/parameterized-routes.test.ts#L0
10) [chromium] › tests/parameterized-routes.test.ts:65:5 › should create a nested parameterized pageload span when the `app` directory is used Test timeout of 30000ms exceeded.
[chromium] › tests/parameterized-routes.test.ts:45:5 › should create a partially parameterized pageload span when the `app` directory is used: ../../_temp/test-application/tests/parameterized-routes.test.ts#L0
9) [chromium] › tests/parameterized-routes.test.ts:45:5 › should create a partially parameterized pageload span when the `app` directory is used Test timeout of 30000ms exceeded.
[chromium] › tests/parameterized-routes.test.ts:24:5 › should create a span named after the static route when the `app` directory is used: ../../_temp/test-application/tests/parameterized-routes.test.ts#L0
8) [chromium] › tests/parameterized-routes.test.ts:24:5 › should create a span named after the static route when the `app` directory is used Test timeout of 30000ms exceeded.
[chromium] › tests/parameterized-routes.test.ts:4:5 › should create a parameterized pageload span when the `app` directory is used: ../../_temp/test-application/tests/parameterized-routes.test.ts#L0
7) [chromium] › tests/parameterized-routes.test.ts:4:5 › should create a parameterized pageload span when the `app` directory is used Test timeout of 30000ms exceeded.
[chromium] › tests/isr-routes.test.ts:72:5 › ISR route should be identified correctly in the route manifest: ../../_temp/test-application/tests/isr-routes.test.ts#L0
6) [chromium] › tests/isr-routes.test.ts:72:5 › ISR route should be identified correctly in the route manifest Test timeout of 30000ms exceeded.
[chromium] › tests/isr-routes.test.ts:44:5 › should create unique traces for ISR pages on each visit: ../../_temp/test-application/tests/isr-routes.test.ts#L0
5) [chromium] › tests/isr-routes.test.ts:44:5 › should create unique traces for ISR pages on each visit Test timeout of 30000ms exceeded.
[chromium] › tests/isr-routes.test.ts:28:5 › should remove meta tags for different ISR dynamic route values: ../../_temp/test-application/tests/isr-routes.test.ts#L31
4) [chromium] › tests/isr-routes.test.ts:28:5 › should remove meta tags for different ISR dynamic route values Error: expect(locator).toHaveText(expected) failed Locator: locator('#isr-product-id') Expected: "phone" Timeout: 10000ms Error: element(s) not found Call log: - Expect "toHaveText" locator('#isr-product-id') with timeout 10000ms - waiting for locator('#isr-product-id') 29 | // Test with 'phone' (one of the pre-generated static params) 30 | await page.goto('/isr-test/phone'); > 31 | await expect(page.locator('#isr-product-id')).toHaveText('phone'); | ^ 32 | 33 | await expect(page.locator('meta[name="sentry-trace"]')).toHaveCount(0); 34 | await expect(page.locator('meta[name="baggage"]')).toHaveCount(0); at /home/runner/work/_temp/test-application/tests/isr-routes.test.ts:31:49
[chromium] › tests/isr-routes.test.ts:16:5 › should remove sentry-trace and baggage meta tags on ISR static route: ../../_temp/test-application/tests/isr-routes.test.ts#L21
3) [chromium] › tests/isr-routes.test.ts:16:5 › should remove sentry-trace and baggage meta tags on ISR static route Error: expect(locator).toHaveText(expected) failed Locator: locator('#isr-static-marker') Expected: "static-isr" Timeout: 10000ms Error: element(s) not found Call log: - Expect "toHaveText" locator('#isr-static-marker') with timeout 10000ms - waiting for locator('#isr-static-marker') 19 | 20 | // Wait for page to be fully loaded > 21 | await expect(page.locator('#isr-static-marker')).toHaveText('static-isr'); | ^ 22 | 23 | // Check that sentry-trace and baggage meta tags are removed for ISR pages 24 | await expect(page.locator('meta[name="sentry-trace"]')).toHaveCount(0); at /home/runner/work/_temp/test-application/tests/isr-routes.test.ts:21:52
[chromium] › tests/isr-routes.test.ts:4:5 › should remove sentry-trace and baggage meta tags on ISR dynamic route page load: ../../_temp/test-application/tests/isr-routes.test.ts#L9
2) [chromium] › tests/isr-routes.test.ts:4:5 › should remove sentry-trace and baggage meta tags on ISR dynamic route page load Error: expect(locator).toHaveText(expected) failed Locator: locator('#isr-product-id') Expected: "laptop" Timeout: 10000ms Error: element(s) not found Call log: - Expect "toHaveText" locator('#isr-product-id') with timeout 10000ms - waiting for locator('#isr-product-id') 7 | 8 | // Wait for page to be fully loaded > 9 | await expect(page.locator('#isr-product-id')).toHaveText('laptop'); | ^ 10 | 11 | // Check that sentry-trace and baggage meta tags are removed for ISR pages 12 | await expect(page.locator('meta[name="sentry-trace"]')).toHaveCount(0); at /home/runner/work/_temp/test-application/tests/isr-routes.test.ts:9:49
[chromium] › tests/cloudflare-runtime.test.ts:5:7 › Cloudflare Runtime › Should report cloudflare as the runtime in API route error events: ../../_temp/test-application/tests/cloudflare-runtime.test.ts#L0
1) [chromium] › tests/cloudflare-runtime.test.ts:5:7 › Cloudflare Runtime › Should report cloudflare as the runtime in API route error events Test timeout of 30000ms exceeded.
All required jobs passed or were skipped
Process completed with exit code 1.
🎭 Playwright Run Summary
1 failed [chromium] › tests/useCacheSpans.spec.ts:11:5 › uses low-cardinality names for `use cache` spans 1 skipped 19 passed (29.7s)
🎭 Playwright Run Summary
1 failed [chromium] › tests/useCacheSpans.spec.ts:10:5 › Should create cache spans around `use cache` functions 1 skipped 20 passed (21.0s)
🎭 Playwright Run Summary
11 failed [chromium] › tests/cloudflare-runtime.test.ts:5:7 › Cloudflare Runtime › Should report cloudflare as the runtime in API route error events [chromium] › tests/isr-routes.test.ts:4:5 › should remove sentry-trace and baggage meta tags on ISR dynamic route page load [chromium] › tests/isr-routes.test.ts:16:5 › should remove sentry-trace and baggage meta tags on ISR static route [chromium] › tests/isr-routes.test.ts:28:5 › should remove meta tags for different ISR dynamic route values [chromium] › tests/isr-routes.test.ts:44:5 › should create unique traces for ISR pages on each visit [chromium] › tests/isr-routes.test.ts:72:5 › ISR route should be identified correctly in the route manifest [chromium] › tests/parameterized-routes.test.ts:4:5 › should create a parameterized pageload span when the `app` directory is used [chromium] › tests/parameterized-routes.test.ts:24:5 › should create a span named after the static route when the `app` directory is used [chromium] › tests/parameterized-routes.test.ts:45:5 › should create a partially parameterized pageload span when the `app` directory is used [chromium] › tests/parameterized-routes.test.ts:65:5 › should create a nested parameterized pageload span when the `app` directory is used [chromium] › tests/prefetch-spans.test.ts:5:5 › Prefetch client spans should have a http.request.prefetch attribute 16 skipped 1 passed (4.8m)

Artifacts

Produced during runtime
Name Size Digest
E2E Test Dump (nextjs-16-cacheComponents)
34 KB
sha256:15133993a53871ad2f280e777943b2b92d330fe967896d2c2b773a03ade2c1f9
E2E Test Dump (nextjs-16-streaming-cacheComponents)
40.4 KB
sha256:581f8a15f3f85c33ffa9b4efdce12fabeccae44fc711e291a133e48a9182f3e0
playwright-traces-job_e2e_playwright_tests-nextjs-16-cacheComponents
13 KB
sha256:6976fc66387a0bec7753baa0e5eb2ea3562421d7da9cdff6b0f2e13b95906b8c
playwright-traces-job_e2e_playwright_tests-nextjs-16-cf-workers
7.73 MB
sha256:a1cce276aa43c9b5c18d2960e8a2eceb7fd7e28bc046d7a20c32c472d7f03570
playwright-traces-job_e2e_playwright_tests-nextjs-16-streaming-cacheComponents
10 KB
sha256:3a9f50b12e339053d836bcd702d6561d303cf9794b2423c303803550f078e788