[feature][COM][hadoop] add support for hadoop 3.3.5 with compatibility fixes

[v-kkhuang]

Search before asking

• I had searched in the issues and found no similar issues.

Linkis Component

• linkis-commons
• linkis-computation-governance
• linkis-dist
• linkis-engineconn-plugin
• linkis-extensions
• linkis-orchestrator
• linkis-public-enhancements
• linkis-spring-cloud-services
• linkis-web

Description

This branch provides support for Hadoop 3.3.5, including multiple bug fixes and optimizations to ensure compatibility with the new Hadoop version.

Steps to reproduce

N/A - this is a version upgrade branch

Expected behavior

Linkis should be fully compatible with Hadoop 3.3.5 with all features working correctly.

Your environment

• Linkis version used: 1.18.0
• Environment name and version:
  • hadoop-3.3.5 (upgraded from 2.x)
  • hive-2.3.3
  • spark-2.4.3/3.3.0
  • scala-2.11.12
  • jdk 1.8.0_xxx

Anything else

This upgrade includes:

• Hadoop version upgrade to 3.3.5
• Jackson version adjustment for compatibility
• SR task retry init_sql loading bug fix
• Spark parameter optimization
• Global history engine version display support
• Task retry switch coverage enhancement

Are you willing to submit a PR?

• Yes I am willing to submit a PR!

[github-actions]

😊 Welcome to the Apache Linkis community!!

We are glad that you are contributing by opening this issue.

Please make sure to include all the relevant context.
We will be here shortly.

If you are interested in contributing to our website project, please let us know!
You can check out our contributing guide on
👉 How to Participate in Project Contribution.

Community

WeChat Assistant	WeChat Public Account

Mailing Lists

Name	Description	Subscribe	Unsubscribe	Archive
dev@linkis.apache.org	community activity information	subscribe	unsubscribe	archive