Skip to content

[feat][COM][hadoop] add support for hadoop 3.3.5 with compatibility fixes#982

Open
v-kkhuang wants to merge 6 commits intodev-1.18.0-webankfrom
dev-1.18.0-hadoop3-sup
Open

[feat][COM][hadoop] add support for hadoop 3.3.5 with compatibility fixes#982
v-kkhuang wants to merge 6 commits intodev-1.18.0-webankfrom
dev-1.18.0-hadoop3-sup

Conversation

@v-kkhuang
Copy link
Copy Markdown

What is the purpose of the change

Background/Problem:
The current Linkis version lacks full support for Hadoop 3.x, particularly Hadoop 3.3.5. This limits the adoption in environments running Hadoop 3 and causes compatibility issues with newer Hadoop distributions.

Purpose of Change:
To address this compatibility gap, this PR adds comprehensive support for Hadoop 3.3.5, including dependency upgrades, Jackson version adjustments, and multiple bug fixes to ensure all features work correctly with the new Hadoop version.

Value/Impact:
After the change, Linkis is fully compatible with Hadoop 3.3.5, enabling deployment in modern Hadoop environments while maintaining backward compatibility and fixing several known issues.

Related issues/PRs

Related issues: close #981
Related pr:none

Brief change log

  • Upgrade Hadoop version to 3.3.5 across all modules
  • Adjust Jackson version for Hadoop 3 compatibility
  • Fix SR task retry init_sql loading exception
  • Optimize Spark parameter acquisition logic
  • Add global history engine version display support
  • Enhance task retry switch coverage for better control

Checklist

  • I have read the Contributing Guidelines on pull requests.
  • I have explained the need for this PR and the problem it solves
  • I have explained the changes or the new features added to this PR
  • I have added tests corresponding to this change
  • I have updated the documentation to reflect this change
  • I have verified that this change is backward compatible
  • If this is a code change: I have written unit tests to fully verify the new behavior.

@v-kkhuang v-kkhuang added the enhancement New feature or request label Apr 9, 2026
# Conflicts:
#	linkis-web/src/apps/linkis/module/globalHistoryManagement/index.vue
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement New feature or request

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant