Skip to content

[feature][EC][hive] add support for yarn tag and username in hive engine #969

@v-kkhuang

Description

@v-kkhuang

Search before asking

  • I had searched in the issues and found no similar issues.

Linkis Component

  • linkis-commons
  • linkis-computation-governance
  • linkis-dist
  • linkis-engineconn-plugin
  • linkis-extensions
  • linkis-orchestrator
  • linkis-public-enhancements
  • linkis-spring-cloud-services
  • linkis-web

Description

Add support for passing Yarn tag and username to Hive engine, enabling better resource tracking and multi-tenant isolation.

Steps to reproduce

N/A - this is a feature enhancement

Expected behavior

Hive engine should be able to receive and use Yarn tag and username information for better resource management.

Your environment

  • Linkis version used: 2.0.0
  • Environment name and version:
    • hadoop-3.3.4
    • hive-2.3.3
    • spark-2.4.3/3.3.0
    • scala-2.11.12
    • jdk 1.8.0_xxx

Anything else

This enhancement also includes fixes for SR task retry init_sql loading exception and Spark parameter optimization.

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions