Abram Sanderson

This commit **stages the removal of URL-based DDS types** by introducing a **compatibility layer** within the **FluidDataStoreRuntime**. It addresses a critical issue where reverse proxies incorrectly rewrite URL-like DDS type identifiers, leading to document corruption for users. The change introduces a `LegacyTypeAwareRegistry` to allow the runtime to correctly resolve both existing URL-based types and future non-URL based types, ensuring **backward compatibility** during the transition. This **refactoring** prepares numerous **DDS factories** for a future migration to non-URL identifiers, preventing further issues with network intermediaries and improving the robustness of Fluid applications.

This commit introduces **support for FIC-based authentication** within the **`OdspTestDriver`** and **`odspTokenManager`**, enabling a more secure method to acquire tokens for test users without relying on username/password combinations. This **new capability** addresses upcoming security changes for test tenants by allowing tokens to be fetched for federated identity credential-enabled users. It includes **refactoring** such as renaming `OdspTokenConfig` to `LoginCredentials` for improved clarity and simplifying the `getOdspCredentials` signature. This foundational work prepares the system for future transition of CI to this enhanced authentication flow, improving overall test security.

This commit **refactors** the **ODSP token management system** by removing all interactive browser login capabilities and their downstream dependencies. Specifically, the `odspTokenManager.ts` module is simplified to only support password-based authentication, while `odspTestDriver.ts` no longer includes browser authentication support. This **maintenance** effort reduces complexity, eliminates likely non-functional code, and prepares the system for adopting a new, more suitable authentication solution for test scenarios.

This commit **improves the reliability of the publish process** by changing how **Fluid build tools** are installed. Previously, `fluid-build` was installed globally via `npm`, which could lead to release blockages due to transitive dependency issues from its dependencies. Now, this **maintenance** change updates the **publish pipelines** (`tools/pipelines/templates/include-publish-npm-package-deployment.yml`) to install `fluid-build` as a local `pnpm` project. This new approach leverages `pnpm`'s override mechanism, providing a robust way to mitigate future dependency-related disruptions and ensure more stable releases.

This commit **resolves an issue with internal pipelines consuming stale Fluid Framework package manifests** by **adding a `Cache-Control` header with a 5-minute `max-age`** to these files. The **Azure DevOps pipeline** responsible for uploading **development package manifests** to Azure storage, specifically `tools/pipelines/templates/upload-dev-manifest.yml`, is updated to include this header. This **maintenance fix** prevents Azure Front Door from caching manifest files for extended durations, ensuring that downstream integration processes consistently retrieve the most recent versions of the Fluid Framework. Consequently, this change significantly improves the reliability and accuracy of internal development and integration workflows.

This commit **increases the timeout** for the `Snapshot.perf.spec.ts` test within the **`merge-tree` DDS package**. This **maintenance fix** addresses intermittent CI failures where the snapshot loading performance benchmarks were timing out, especially when dealing with larger snapshot sizes. By extending the timeout, the commit prevents false negatives and improves the overall stability and reliability of the CI pipeline for these critical performance tests.

This commit introduces a **refactoring** to enforce stricter typing and clarify the usage of the `squash` parameter across various internal **Fluid Framework runtime and DDS components**. The `squash` parameter has been made **required** in numerous internal `reSubmit` methods, including `sharedObject.ts:reSubmit`, `channelCollection.ts:reSubmitContainerMessage`, and `dataStoreContext.ts:reSubmit`, which are part of the core operation submission plumbing. While the main entry point `commitStagedChanges` retains its optional `squash` parameter, this change constitutes a **compile-time breaking change** for direct callers of the affected internal functions, requiring them to explicitly pass `false` where `undefined` was previously implicitly handled. This improves code robustness and maintainability by making the intent of `squash` explicit in internal API surfaces, with corresponding updates to test utilities and API reports.

This commit **promotes a minimal set of SharedTree branching APIs to beta**, enabling **local branching flows** within the `SharedTree` DDS. Specifically, the `TreeBranch` interface is moved to beta stability, while `TreeBranchAlpha` is introduced to represent its previous alpha state, alongside a new `TreeViewBeta` interface and an `asBeta` function for accessing the beta API. This **API stabilization** primarily impacts the core `packages/dds/tree` module, with cascading updates to `fluid-framework` and `tree-agent` through updated API reports and type definitions. The change makes these crucial branching capabilities more robust and accessible for developers building on `SharedTree`.

This commit **adjusts the timestamp injection mechanism** within the **SharedString attribution tests** in the `attributor` package. Previously, timestamps were added at `op` event raising time, but now they are injected "on the server" when messages are "sent" via the mock `containerRuntimeFactory`, making the test behavior more realistic. This **test refinement** ensures that catchup operations correctly include timestamps, necessitating an update to existing test snapshots to reflect this more accurate server-like behavior. The change primarily affects the `createSharedString` helper in `packages/framework/attributor/src/test/attribution/sharedString.attribution.spec.ts` and addresses a breaking change from a related commit.

This commit **updates the `test-service-clients.yml` pipeline configuration** by adding the essential `ff_pipeline_host` repository resource. This **maintenance fix** addresses a dependency issue, ensuring the pipeline can correctly resolve and utilize a shared template that was previously updated in #25599 to use a repository reference. The change **restores proper functionality** for the service client tests by providing the necessary pipeline resource, preventing failures related to missing template references.

This commit introduces **support for ODSPDF TRIPS tenants** within the **real service stress and e2e test pipelines**. It primarily **enhances the `include-test-real-service.yml` template** by updating tenant acquisition/release logic and environment variable injection to handle different ODSP tenant types. This **new capability** allows for more comprehensive testing against various Fluid backend configurations, specifically enabling stress runs against ODSPDF. Additionally, the commit includes minor **refactoring** across several pipeline templates, such as `test-real-service-stress.yml` and `test-real-service.yml`, to standardize repository resource definitions and improve parameter clarity.

This commit **restores and enhances dependency caching** within the `include-test-real-service.yml` pipeline template, specifically for compatibility dependencies. It reintroduces the caching mechanism that was previously removed and improves its effectiveness by dynamically computing a cache key based on the package's major and minor versions. This **maintenance** and **optimization** effort ensures that caches are invalidated only when a minor version change occurs, preventing unnecessary dependency installations. The change significantly **improves pipeline efficiency** by reducing build times for most runs, as compatibility dependencies will be installed only once per minor version release.

This commit **refactors the CI/CD pipeline infrastructure** to enhance the **performance benchmarks execution**. It introduces a **secondary repository checkout** for the performance benchmarks pipeline, standardizing dependency management and test environment setup. This **pipeline infrastructure refactoring** includes updating several shared pipeline templates for installation, dependency copying, and `npmrc` configuration, notably switching from `npm install` to `pnpm install` for test packages. The changes streamline the setup for performance tests, improving the **reliability and consistency of benchmark results** across various DDS packages and end-to-end tests.

This commit **improves the CI/CD pipeline** by refining the 'Copy devDependencies' step within the `tools/pipelines/templates/include-test-real-service.yml` template. It **tightens the dependency copying script** to **exclude common build-time dependencies** such as TypeScript and API Extractor. This **maintenance improvement** addresses **DDS fuzz harness pipeline failures** caused by unnecessary transitive dependencies of build-tools being copied. By preventing these build-time dependencies from being included, the change ensures more stable and efficient CI runs for services that utilize this template.

This commit introduces a **pipeline configuration enhancement** by allowing the specification of a primary registry for pnpm installations. It modifies the `tools/pipelines/templates/include-install-pnpm.yml` template to accept a new `primaryRegistry` parameter. This parameter is then leveraged in the `tools/pipelines/templates/include-upload-stage-telemetry.yml` template, where the `ado-feeds-ff-download-only` variable is passed as the primary registry. This update ensures the **telemetry stage upload template** can correctly reference the feed used for installing internal packages, improving dependency resolution within the build pipelines.

This commit performs **maintenance** by removing unnecessary `--` arguments from `pnpm exec` commands within **CI/CD pipeline templates**. It specifically targets `trips-setup`, `trips-cleanup`, and `telemetry-generator` scripts defined in `tools/pipelines/templates/include-test-real-service.yml` and `tools/pipelines/templates/include-upload-stage-telemetry.yml`. This **fix** resolves an issue where parameters were not correctly passed to scripts in pipeline environments, ensuring **reliable script execution** following the migration from `npx`.

This commit **refactors** the dependency management strategy for **secondary pipelines**, moving from ad-hoc `npx` installations to a dedicated internal repository managed with `pnpm`. The `include-real-service-test.yml` and `include-upload-stage-telemetry.yml` pipeline templates are updated to check out this new repository, ensuring **repeatable and stable dependency resolution** for internal infrastructure packages. This **maintenance** improvement enhances the reliability of real service E2E tests, stress tests, and performance benchmarks by guaranteeing consistent package versions across pipeline runs. A new variable `pathToTelemetryGeneratorHandlersNew` is also introduced to support the updated telemetry setup.

This commit **fixes a bug** in the **CI/CD pipeline's NPM package publishing process**, specifically addressing an issue where the **NPM package manifest** was being updated even when no packages were successfully published. The change modifies the condition within `tools/pipelines/templates/include-publish-npm-package.yml` to ensure the manifest upload step only proceeds if at least one package publishing stage has successfully completed. This **maintenance improvement** prevents inaccurate or empty manifest updates, ensuring the integrity of published package metadata and optimizing CI resource usage by avoiding unnecessary manifest uploads.

Fix webpack-fluid-loader's incremental build (#25241)

This commit **enhances the fuzz testing capabilities** for the **shared-tree DDS** by enabling rehydration in top-level tests, specifically for scenarios where a container is serialized/rehydrated *before* being attached. It introduces a new configuration option, `attachingBeforeRehydrateDisable`, in the **DDS fuzz harness** (`ddsFuzzHarness.ts`) to relax the rehydration disable flag, allowing **top-level fuzz tests** (`topLevel.fuzz.spec.ts`) to cover these complex flows. This **test enhancement** also includes **maintenance** in the form of clarifying comments within the fuzz harness regarding the intricate interaction of `id-compressor` operations and rehydration during attachment. The change improves the robustness of `shared-tree`'s rehydration logic validation.