Skip to content

Hive 29869 beeline size reduce #6748

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
illiabarbashov-sketch wants to merge 2 commits into
base: master
Choose a base branch
from
+78 −10
Open

Hive 29869 beeline size reduce #6748

Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
4902f6c
HIVE-29869: native installer size reduced PoC
illiabarbashov-sketch Sep 1, 2026
6e8461c
HIVE-29869: wip
illiabarbashov-sketch Sep 1, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
88 changes: 78 additions & 10 deletions beeline/pom.xml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -39,11 +39,6 @@
<artifactId>hive-common</artifactId>
<version>${project.version}</version>
</dependency>
<dependency>
<groupId>org.apache.hive</groupId>
<artifactId>hive-metastore</artifactId>
<version>${project.version}</version>
</dependency>
<dependency>
<groupId>org.apache.hive</groupId>
<artifactId>hive-shims</artifactId>
Expand All @@ -70,6 +65,7 @@
<groupId>org.apache.hive</groupId>
<artifactId>hive-standalone-metastore-server</artifactId>
<version>${standalone-metastore.version}</version>
<scope>provided</scope>
</dependency>
<dependency>
<!--
Expand Down Expand Up @@ -133,12 +129,79 @@
<groupId>log4j</groupId>
<artifactId>log4j</artifactId>
</exclusion>
<!-- kerby/kerberos auth chain pulled in transitively via hadoop-auth; beeline
does not exercise hadoop-common's Kerberos/UGI code paths -->
<exclusion>
<groupId>org.apache.kerby</groupId>
<artifactId>kerb-core</artifactId>
</exclusion>
<exclusion>
<groupId>org.apache.kerby</groupId>
<artifactId>kerb-util</artifactId>

@Aggarwal-Raghav Aggarwal-Raghav Sep 2, 2026

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

maybe

<exclusion>
  <groupId>org.apache.kerby</groupId>
  <artifactId>*</artifactId>
</exclusion>

</exclusion>
<exclusion>
<groupId>org.apache.kerby</groupId>
<artifactId>kerby-config</artifactId>
</exclusion>
<exclusion>
<groupId>org.apache.kerby</groupId>
<artifactId>kerb-crypto</artifactId>
</exclusion>
<exclusion>
<groupId>org.apache.kerby</groupId>
<artifactId>kerby-pkix</artifactId>
</exclusion>
<exclusion>
<groupId>org.apache.kerby</groupId>
<artifactId>kerby-asn1</artifactId>
</exclusion>
<exclusion>
<groupId>org.apache.kerby</groupId>
<artifactId>kerby-util</artifactId>
</exclusion>
<!-- avro is only used by hadoop-common's optional SequenceFile/serialization
helpers, not by Configuration/FileSystem/Path/IOUtils/ExitUtil -->
<exclusion>
<groupId>org.apache.avro</groupId>
<artifactId>avro</artifactId>
</exclusion>
<!-- ZooKeeper client (curator) is unused; beeline does not talk to ZK
through hadoop-common -->
<exclusion>
<groupId>org.apache.curator</groupId>
<artifactId>curator-client</artifactId>
</exclusion>
<exclusion>
<groupId>org.apache.curator</groupId>
<artifactId>curator-recipes</artifactId>
</exclusion>
<exclusion>
<groupId>org.apache.curator</groupId>
<artifactId>curator-framework</artifactId>
</exclusion>
<!-- htrace tracing hooks; not exercised by beeline's thin usage -->
<exclusion>
<groupId>org.apache.htrace</groupId>
<artifactId>htrace-core4</artifactId>
</exclusion>
<!-- jsch (SFTP/SSH) backs hadoop-common's SFTPFileSystem, which beeline
never instantiates -->
<exclusion>
<groupId>com.jcraft</groupId>
<artifactId>jsch</artifactId>
</exclusion>
<!-- commons-net (FTP client) backs hadoop-common's FTPFileSystem, unused -->
<exclusion>
<groupId>commons-net</groupId>
<artifactId>commons-net</artifactId>
</exclusion>
<!-- re2j is only used by hadoop-common's optional regex path matching -->
<exclusion>
<groupId>com.google.re2j</groupId>
<artifactId>re2j</artifactId>
</exclusion>
</exclusions>
</dependency>
<dependency>
<groupId>org.apache.thrift</groupId>

@Aggarwal-Raghav Aggarwal-Raghav Sep 2, 2026

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why this is excluded? there is direct dependency in beeline module

hive/beeline/src/java/org/apache/hive/beeline/BeeLine.java

Line 110 in bfe74f9

import org.apache.thrift.transport.TTransportException;

<artifactId>libthrift</artifactId>
</dependency>
<dependency>
<groupId>net.sf.supercsv</groupId>
<artifactId>super-csv</artifactId>
Expand Down Expand Up @@ -243,7 +306,7 @@
<dependency>
<groupId>org.postgresql</groupId>
<artifactId>postgresql</artifactId>
<optional>true</optional>
<scope>test</scope>
</dependency>
</dependencies>
<profiles>
Expand Down Expand Up @@ -294,6 +357,11 @@
<!-- Output: arch-specific subdirectory so x64 and arm64 coexist -->
<arg value="--dest"/>
<arg value="${project.build.directory}/apache-hive-beeline-${project.version}/${installer.arch}"/>
<!-- Reduces the size of the output artifact -->
<arg value="--add-modules"/>
<arg value="java.base,java.compiler,java.desktop,java.instrument,java.prefs,java.rmi,java.scripting,java.security.jgss,java.security.sasl,java.sql.rowset,jdk.httpserver,jdk.jfr,jdk.management,jdk.security.auth,jdk.unsupported"/>
<arg value="--jlink-options"/>
<arg value="--strip-debug --no-man-pages --no-header-files --strip-native-commands --compress=zip-9"/>
<arg line="${jpackage.platform.args}"/>
<!--
jpackage picks the native format automatically:
Expand Down
Loading