Skip to content

[Beam 2.75] Restore local LinkedIn Java packaging - #191

Merged
cirquare merged 2 commits into
li-release-2.75from
yf186035/beam-2.75-phase6a-build-publish
Oct 20, 2026
Merged

cirquare merged 2 commits into
li-release-2.75from
yf186035/beam-2.75-phase6a-build-publish

Conversation

@cirquare

@cirquare cirquare commented Oct 19, 2026 •

Copy link
Copy Markdown

Summary

  • Restore opt-in com.linkedin.beam release/snapshot coordinates for 2.75.1, preserving upstream mode, dependency-management BOMs and vendor coordinates. Keep fork Java publication local-only; remote publishing and Auto ELR remain follow-up work.
  • Restore a portable Java-only version updater using gradle.properties as the version source. Fix POM-only dependency configuration under configuration-on-demand and keep snapshot versions compatible with SDK resource filtering.
  • Add versioning/publication regressions and run them in the existing Flink CI workflow without adding publishing permissions or release triggers.

Testing Done

  • Six new build tests passed across seven publication modes and seven modules, including real SDK version resource generation and the existing Dataflow evaluation cycle; version-script syntax and buildSrc checks passed.
  • Built and staged the complete 30-artifact closure as release and snapshot in separate isolated Maven repositories, 512 fresh tasks each. Verified published/embedded POM identities, jars and first-party dependency closure.
  • Independent JVM consumers resolved all 20 roots from the staged POMs in both modes, with matching jar hashes and no fallback to upstream first-party Beam artifacts.
  • Full LI release/publication-mode Java/Flink/Spark gates passed: 716 fresh tasks, 11,835 Java cases, 67 built-in skips, zero failures/errors. Covers all five Flink builds, Flink 1.20/2.2 conformance, the Spark 3 compatibility matrix, and Spark 4 build/conformance on JDK 17.
  • Only the local runner-core test heap uses the previously approved 4 GB override. Root/cloud, live JFrog/ELR, downstream runtime/JRE compatibility and production end-to-end validation remain separate open gates.
  • CI repair: the metadata checks now use explicit temporary Maven settings. All seven modes pass with a synthetic default Maven home containing an unresolved credential placeholder, leaving that default file untouched and preserving normal publication authentication. The complete metadata and Java/Flink/Spark matrix passed unchanged on rerun: six build tests, 11,835 Java cases, 67 built-in skips, zero failures/errors. An earlier full attempt encountered a closed-classloader failure in unchanged Flink 2.0 adapter code; both its complete module rerun and the subsequent entire matrix passed without runtime-code, guard or exclusion changes. This patch does not claim to fix classloader retention.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@github-actions github-actions Bot added the build label Oct 19, 2026
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@cirquare
cirquare marked this pull request as ready for review October 20, 2026 18:00
@cirquare
cirquare merged commit 2d933ec into li-release-2.75 Oct 20, 2026
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant