[Bug 280333] devel/spark
Date: Wed, 17 Jul 2024 15:01:27 UTC
https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=280333 Bug ID: 280333 Summary: devel/spark Product: Ports & Packages Version: Latest Hardware: amd64 OS: Any Status: New Severity: Affects Some People Priority: --- Component: Individual Port(s) Assignee: ports-bugs@FreeBSD.org Reporter: vbasiccd@msn.com CC: freebsd@sysctl.cz Flags: maintainer-feedback?(freebsd@sysctl.cz) CC: freebsd@sysctl.cz After building Apache Spark, the installation step of copying the Hive JAR files fails. ``` ===> Installing for apache-spark-3.3.0 ===> Checking if apache-spark is already installed ===> Registering installation for apache-spark-3.3.0 pkg-static: Unable to access file /usr/ports/devel/spark/work/stage/usr/local/share/spark/jars/hive-beeline-2.3.10.jar:No such file or directory pkg-static: Unable to access file /usr/ports/devel/spark/work/stage/usr/local/share/spark/jars/hive-cli-2.3.10.jar:No such file or directory pkg-static: Unable to access file /usr/ports/devel/spark/work/stage/usr/local/share/spark/jars/hive-common-2.3.10.jar:No such file or directory pkg-static: Unable to access file /usr/ports/devel/spark/work/stage/usr/local/share/spark/jars/hive-exec-2.3.10-core.jar:No such file or directory pkg-static: Unable to access file /usr/ports/devel/spark/work/stage/usr/local/share/spark/jars/hive-jdbc-2.3.10.jar:No such file or directory pkg-static: Unable to access file /usr/ports/devel/spark/work/stage/usr/local/share/spark/jars/hive-llap-common-2.3.10.jar:No such file or directory pkg-static: Unable to access file /usr/ports/devel/spark/work/stage/usr/local/share/spark/jars/hive-metastore-2.3.10.jar:No such file or directory pkg-static: Unable to access file /usr/ports/devel/spark/work/stage/usr/local/share/spark/jars/hive-serde-2.3.10.jar:No such file or directory pkg-static: Unable to access file /usr/ports/devel/spark/work/stage/usr/local/share/spark/jars/hive-shims-0.23-2.3.10.jar:No such file or directory pkg-static: Unable to access file /usr/ports/devel/spark/work/stage/usr/local/share/spark/jars/hive-shims-2.3.10.jar:No such file or directory pkg-static: Unable to access file /usr/ports/devel/spark/work/stage/usr/local/share/spark/jars/hive-shims-common-2.3.10.jar:No such file or directory pkg-static: Unable to access file /usr/ports/devel/spark/work/stage/usr/local/share/spark/jars/hive-shims-scheduler-2.3.10.jar:No such file or directory pkg-static: Unable to access file /usr/ports/devel/spark/work/stage/usr/local/share/spark/jars/hive-vector-code-gen-2.3.10.jar:No such file or directory *** Error code 1 ``` Notice the "2.3.10" version number in the file names. Listing that "jars" work directory reveals that those JAR files do exist, but with the "2.3.9" version number. So, it appears that the Hive JAR files require Python 3.9. Any other Python version (e.g. 3.10 in my case) causes this installation error. Besides that, the building of Apache Spark did complete successfully. ``` ls /usr/ports/devel/spark/work/stage/usr/local/share/spark/jars **SHORTENED FOR BREVITIY** hadoop-yarn-server-web-proxy-3.3.4.jar HikariCP-2.5.1.jar hive-beeline-2.3.9.jar hive-cli-2.3.9.jar hive-common-2.3.9.jar hive-exec-2.3.9-core.jar hive-jdbc-2.3.9.jar hive-llap-common-2.3.9.jar hive-metastore-2.3.9.jar hive-serde-2.3.9.jar hive-service-rpc-3.1.2.jar hive-shims-0.23-2.3.9.jar hive-shims-2.3.9.jar hive-shims-common-2.3.9.jar hive-shims-scheduler-2.3.9.jar hive-storage-api-2.7.2.jar hive-vector-code-gen-2.3.9.jar hk2-api-2.6.1.jar ``` -- You are receiving this mail because: You are the assignee for the bug.