Skip to content

Fix WinGet and Homebrew failures in manual internal pipeline runs#15860

Open
radical wants to merge 4 commits intomainfrom
fix-azdo-pr-build
Open

Fix WinGet and Homebrew failures in manual internal pipeline runs#15860
radical wants to merge 4 commits intomainfrom
fix-azdo-pr-build

Conversation

@radical
Copy link
Copy Markdown
Member

@radical radical commented Apr 3, 2026

Summary

Running the internal pipeline manually on a dev/feature branch (e.g. via /azp run or the AzDO UI) fails in the Prepare Installers stage because:

  1. WinGet Manifest — expects native_archives_win_x64/win_arm64 artifacts that were never published (Windows archives only went through Arcade's BlobArtifacts, not as named artifacts).
  2. Homebrew Caskbrew audit --new --cask implies download checks even without --online, and the tarball URLs return 404 for non-publishing branches.

This PR fixes both issues so devs can run the internal pipeline on any branch to validate changes end-to-end.

Changes

  1. Scripts (generate-manifests.ps1, generate-cask.sh): Rename --validate-urls--skip-url-validation. Add three-way hash resolution: local archives (--archive-root), placeholder hashes (--skip-url-validation), or download from URLs (default).

  2. Installer templates (prepare-winget-manifest.yml, prepare-homebrew-cask.yml): Add skipUrlValidation and archiveRoot parameters. Derive install-test gating from skipUrlValidation (no separate parameter needed). Fix brew audit --new to skip when URLs are invalid. Skip the upstream GitHub API cask check entirely when skipUrlValidation is true to avoid rate-limit flakes.

  3. Windows CLI archive publishing (BuildAndTest.yml): Publish native_archives_win_x64 and native_archives_win_arm64 as named pipeline artifacts, matching the native_archives_<rid> pattern used by build_sign_native for macOS/Linux.

  4. Internal pipeline (azure-pipelines.yml): Widen Prepare Installers stage to run on PR and feature branch builds with skipUrlValidation: true. Download specific native_archives_<rid> artifacts for each job. Extract _PackagesPublished pipeline variable to deduplicate the long skipUrlValidation compile-time expression.

  5. Unofficial pipeline (azure-pipelines-unofficial.yml): Align with renamed parameters.

Validation

  • ✅ Internal pipeline build 2946554 — both WinGet Manifest and Homebrew Cask jobs pass on a feature branch
  • ✅ Internal pipeline build 2948394 — latest with review feedback fixes
  • Previous failure: 2945595

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 3, 2026

🚀 Dogfood this PR with:

⚠️ WARNING: Do not do this without first carefully reviewing the code of this PR to satisfy yourself it is safe.

curl -fsSL https://raw.githubusercontent.com/microsoft/aspire/main/eng/scripts/get-aspire-cli-pr.sh | bash -s -- 15860

Or

  • Run remotely in PowerShell:
iex "& { $(irm https://raw.githubusercontent.com/microsoft/aspire/main/eng/scripts/get-aspire-cli-pr.ps1) } 15860"

@radical radical force-pushed the fix-azdo-pr-build branch 3 times, most recently from ddf02e7 to c839282 Compare April 4, 2026 05:13
@radical
Copy link
Copy Markdown
Member Author

radical commented Apr 6, 2026

/azp run microsoft-aspire

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 6, 2026

🎬 CLI E2E Test Recordings — 56 recordings uploaded (commit 646731f)

View recordings
Test Recording
AddPackageInteractiveWhileAppHostRunningDetached ▶️ View Recording
AddPackageWhileAppHostRunningDetached ▶️ View Recording
AgentCommands_AllHelpOutputs_AreCorrect ▶️ View Recording
AgentInitCommand_DefaultSelection_InstallsSkillOnly ▶️ View Recording
AgentInitCommand_MigratesDeprecatedConfig ▶️ View Recording
AllPublishMethodsBuildDockerImages ▶️ View Recording
AspireAddPackageVersionToDirectoryPackagesProps ▶️ View Recording
AspireUpdateRemovesAppHostPackageVersionFromDirectoryPackagesProps ▶️ View Recording
Banner_DisplayedOnFirstRun ▶️ View Recording
Banner_DisplayedWithExplicitFlag ▶️ View Recording
Banner_NotDisplayedWithNoLogoFlag ▶️ View Recording
CertificatesClean_RemovesCertificates ▶️ View Recording
CertificatesTrust_WithNoCert_CreatesAndTrustsCertificate ▶️ View Recording
CertificatesTrust_WithUntrustedCert_TrustsCertificate ▶️ View Recording
ConfigSetGet_CreatesNestedJsonFormat ▶️ View Recording
CreateAndRunAspireStarterProject ▶️ View Recording
CreateAndRunAspireStarterProjectWithBundle ▶️ View Recording
CreateAndRunEmptyAppHostProject ▶️ View Recording
CreateAndRunJavaEmptyAppHostProject ▶️ View Recording
CreateAndRunJsReactProject ▶️ View Recording
CreateAndRunPythonReactProject ▶️ View Recording
CreateAndRunTypeScriptEmptyAppHostProject ▶️ View Recording
CreateAndRunTypeScriptStarterProject ▶️ View Recording
CreateJavaAppHostWithViteApp ▶️ View Recording
CreateStartAndStopAspireProject ▶️ View Recording
CreateTypeScriptAppHostWithViteApp ▶️ View Recording
DashboardRunWithOtelTracesReturnsNoTraces ▶️ View Recording
DescribeCommandResolvesReplicaNames ▶️ View Recording
DescribeCommandShowsRunningResources ▶️ View Recording
DetachFormatJsonProducesValidJson ▶️ View Recording
DoctorCommand_DetectsDeprecatedAgentConfig ▶️ View Recording
DoctorCommand_WithSslCertDir_ShowsTrusted ▶️ View Recording
DoctorCommand_WithoutSslCertDir_ShowsPartiallyTrusted ▶️ View Recording
GlobalMigration_HandlesCommentsAndTrailingCommas ▶️ View Recording
GlobalMigration_HandlesMalformedLegacyJson ▶️ View Recording
GlobalMigration_PreservesAllValueTypes ▶️ View Recording
GlobalMigration_SkipsWhenNewConfigExists ▶️ View Recording
GlobalSettings_MigratedFromLegacyFormat ▶️ View Recording
InvalidAppHostPathWithComments_IsHealedOnRun ▶️ View Recording
LegacySettingsMigration_AdjustsRelativeAppHostPath ▶️ View Recording
LogsCommandShowsResourceLogs ▶️ View Recording
PsCommandListsRunningAppHost ▶️ View Recording
PsFormatJsonOutputsOnlyJsonToStdout ▶️ View Recording
PublishWithDockerComposeServiceCallbackSucceeds ▶️ View Recording
RestoreGeneratesSdkFiles ▶️ View Recording
RestoreSupportsConfigOnlyHelperPackageAndCrossPackageTypes ▶️ View Recording
RunFromParentDirectory_UsesExistingConfigNearAppHost ▶️ View Recording
RunWithMissingAwaitShowsHelpfulError ▶️ View Recording
SecretCrudOnDotNetAppHost ▶️ View Recording
SecretCrudOnTypeScriptAppHost ▶️ View Recording
StagingChannel_ConfigureAndVerifySettings_ThenSwitchChannels ▶️ View Recording
StopAllAppHostsFromAppHostDirectory ▶️ View Recording
StopAllAppHostsFromUnrelatedDirectory ▶️ View Recording
StopNonInteractiveMultipleAppHostsShowsError ▶️ View Recording
StopNonInteractiveSingleAppHost ▶️ View Recording
StopWithNoRunningAppHostExitsSuccessfully ▶️ View Recording

📹 Recordings uploaded automatically from CI run #24049373704

@radical radical force-pushed the fix-azdo-pr-build branch from 646731f to 6fc57c0 Compare April 8, 2026 00:01
@radical radical changed the title Add --skip-url-validation flag for WinGet and Homebrew manifest generation Enable WinGet and Homebrew installer validation on PR builds Apr 8, 2026
@radical radical force-pushed the fix-azdo-pr-build branch 2 times, most recently from b1dc943 to abf3b83 Compare April 9, 2026 00:23
@radical radical changed the title Enable WinGet and Homebrew installer validation on PR builds Fix WinGet and Homebrew failures in manual internal pipeline runs Apr 9, 2026
@radical radical marked this pull request as ready for review April 10, 2026 21:00
Copilot AI review requested due to automatic review settings April 10, 2026 21:00
Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR updates the installer-prep tooling and internal pipelines so manual/internal runs on non-publishing branches (PRs/feature branches) don’t fail due to missing named native-archive artifacts (WinGet) or invalid/404 installer URLs (Homebrew/WinGet hashing + audits).

Changes:

  • Add “skip URL validation” modes and local-archive hash computation to WinGet/Homebrew manifest generation scripts.
  • Update Prepare Installers templates/pipelines to pass archiveRoot + skipUrlValidation, and download native archives by artifact name.
  • Publish Windows native CLI archives as named native_archives_<rid> artifacts and relax/adjust installer stage gating.

Reviewed changes

Copilot reviewed 7 out of 7 changed files in this pull request and generated 4 comments.

Show a summary per file
File Description
eng/winget/generate-manifests.ps1 Adds 3-way SHA256 resolution (local archive, placeholder, or download) and renames URL validation switch.
eng/pipelines/templates/prepare-winget-manifest.yml Replaces validateUrls/runInstallTest with skipUrlValidation and wires through to script + install-test condition.
eng/pipelines/templates/prepare-homebrew-cask.yml Replaces validateUrls/runInstallTest with skipUrlValidation and adjusts brew audit flags to avoid download checks.
eng/pipelines/templates/BuildAndTest.yml Publishes Windows native archives as named artifacts; marks template tests continueOnError.
eng/pipelines/azure-pipelines.yml Adds _PackagesPublished, broadens Prepare Installers stage execution, and downloads specific native archive artifacts per job.
eng/pipelines/azure-pipelines-unofficial.yml Aligns callers with renamed parameters and updated URL-validation behavior.
eng/homebrew/generate-cask.sh Adds local-archive hashing and placeholder-hash mode via --skip-url-validation.

radical and others added 4 commits April 10, 2026 17:32
…esolution

Rename the flag to --skip-url-validation (inverted semantics) in both
generate-cask.sh and generate-manifests.ps1. Add three-way hash
resolution: use local archives (--archive-root), placeholder hashes
(--skip-url-validation), or download from URLs (default).

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Add skipUrlValidation and archiveRoot parameters to prepare-winget-manifest.yml
and prepare-homebrew-cask.yml. Derive install-test gating from skipUrlValidation
(no separate runInstallTest parameter needed). Skip the upstream GitHub API cask
check entirely when skipUrlValidation is true to avoid rate-limit flakes.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Publish native_archives_win_x64 and native_archives_win_arm64 as named
pipeline artifacts, matching the native_archives_<rid> pattern used by
build_sign_native for macOS/Linux. This allows the Prepare Installers
stage to download them for WinGet manifest generation.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Widen the Prepare Installers stage condition to run on PR and feature
branch builds with skipUrlValidation derived from a new _PackagesPublished
pipeline variable. This deduplicates the long compile-time expression that
was previously repeated in both the WinGet and Homebrew jobs.

Align the unofficial pipeline with the renamed parameters.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants