Search Criteria
Package Details: apache-spark 3.3.0-0
Git Clone URL: | https://aur.archlinux.org/apache-spark.git (read-only, click to copy) |
---|---|
Package Base: | apache-spark |
Description: | Apache Spark is a unified analytics engine for large-scale data processing. |
Upstream URL: | http://spark.apache.org |
Keywords: | spark |
Licenses: | Apache |
Submitter: | huitseeker |
Maintainer: | ttc0419 (PolarianDev) |
Last Packager: | emanuelfontelles |
Votes: | 55 |
Popularity: | 0.33 |
First Submitted: | 2015-10-04 09:31 (UTC) |
Last Updated: | 2022-08-10 13:32 (UTC) |
Dependencies (9)
- java-environment (java-gcj-compat, zulu-10-bin, jdk12-openj9-bin, zulu-12-bin, jdk12, jdk13-openj9-bin, jdk9-openj9-bin, jdk10, jdk11-openjdk-dcevm, jdk10-openj9-bin, jdk14-openj9-bin, jdk7, zulu-14-bin, amazon-corretto-15, jdk11-openjdk-dcevm-conflicts-fixed, zulu-embedded-jdk8, sapmachine-jdk-bin, amazon-corretto-16, jdk8-graalvm-bin, jdk16-graalvm-bin, jdk8-openjdk-shenandoah, zulu-16-bin, jdk16-adoptopenjdk, jdk16-microsoft-openjdk, jdk11-msopenjdk-bin, jdk18-beta-temurin, jdk8-arm, jdk17-jetbrains, liberica-jdk-11-bin, liberica-jdk-11-lite-bin, liberica-jre-11-bin, jdk11-jetbrains-imfix, java-openjdk-loom-ea-bin, jdk7-j9-bin, jdk7r1-j9-bin, jdk8-j9-bin, jdk11-j9-bin, jdk-jetbrains, jdk11-jbr-xdg, jdk12-openjdk, jdk16-openjdk, jdk13-openjdk, jdk14-openjdk, jdk-bcl, amazon-corretto-18, zulu-18-bin, zulu-13-bin, bishengjdk-17, jdk-arm, jdk11-openj9-bin, jdk-openj9-bin, zulu-15-bin, jdk-jbr-xdg, jdk18-openjdk, jdk8-dragonwell-extended, jdk18-openj9-bin, jdk8-openj9-bin, jdk-android-studio, amazon-corretto-19-bin, zulu-19-bin, jdk19-graalvm-bin, jdk-lts, liberica-jre-11-full-bin, jdk19-graalvm-ee-bin, jdk13-openjdk-bin, zulu-embedded-jdk, jdk-openjdk-xdg-bin, jabba-bin, jdk11-jetbrains-bin, jdk, jdk8-openjdk-xdg, jdk17-openjdk-xdg, jdk15-openjdk, jdk17-jetbrains-bin, amazon-corretto-8, amazon-corretto-11, zulu-embedded-jdk11, amazon-corretto-17, amazon-corretto-20-bin, zulu-11-bin, zulu-20-bin, jdk17-graalvm-ee-bin, zulu-17-bin, zulu-8-bin, jdk17-openj9-bin, jdk17-temurin, jdk11-temurin, jdk-temurin, zulu-jdk-fx-bin, java-openjdk-bin, jdk-openjdk-xdg, liberica-jdk-8-full-bin, liberica-jre-8-full-bin, liberica-jdk-17-full-bin, liberica-jdk-11-full-bin, liberica-jdk-full-bin, jdk17-graalvm-bin, jdk11-graalvm-bin, mandrel-bin, jdk18-temurin, jdk8-temurin, jdk8-graalvm-ee-bin, jdk19-openjdk, jdk-microsoft-openjdk, jdk11-microsoft-openjdk, jdk17-jetbrains-imfix, jdk-openj9, jre-jetbrains, jdk11-graalvm-ee-bin, jdk8-dragonwell-standard-bin, jdk8-dragonwell-extended-bin, jdk8-adoptopenjdk, jdk17-dragonwell-standard-bin, jdk11-dragonwell-standard-bin, jdk11-dragonwell-extended-bin, jdk8, jdk11, java-openjdk-ea-bin, jdk-openjdk, jdk11-openjdk, jdk17-openjdk, jdk8-openjdk)
- hadoop (optional) – support for running on YARN
- ipython (ipython-git) (optional) – ipython3 support for pyspark
- ipython2 (optional) – ipython2 support for pyspark
- python (nogil-python, python36, python32, python39, python38, python37, python310, python312) (optional) – python3 support for pyspark
- python2 (python2-bin) (optional) – python2 support for pyspark
- r (microsoft-r-open, r352, r-mkl) (optional) – support for sparkR
- rsync (rsync-git, rsync-reflink-git, rsync-reflink) (optional) – support rsync hadoop binaries from master
Required by (2)
- polynote (optional)
- python-xgboost (optional)
Latest Comments
1 2 3 4 5 6 Next › Last »
PolarianDev commented on 2023-03-26 12:03 (UTC)
@ttc0419 thank you, I might update it later today but I am also busy at the moment :)
ttc0419 commented on 2023-03-25 08:10 (UTC)
@PolarianDev Added you as co-maintainer, feel free to update it first
PolarianDev commented on 2023-03-23 14:31 (UTC)
@ttc0419 I see in the archives you were the one who requested this to be orphaned, I assume you want the package?
If you do want the package can I have co-maintainer?
If you don't want the package can I claim Maintainer?
PolarianDev commented on 2023-03-23 14:18 (UTC)
Someone orphan requested it, do they mind if I take the package?
dmfay commented on 2020-04-22 20:13 (UTC)
For 2.4.5 (also fixes the worker unit description):
ryukinix commented on 2020-01-17 23:12 (UTC) (edited on 2020-01-17 23:13 (UTC) by ryukinix)
Updating to spark 3.0.0-preview2 it will make works with Python3.8. I'm using this modified version of PKGBUILD: https://github.com/ryukinix/apache-spark-pkgbuild. Until now it's working fine.
5 days ago it was released the v2.4.5 github tag, but is not available yet on apache spark archive the compiled version, for that reason I used 3.0.0 preview2 version which is the most recent version available in the archive.
v2.4.5 and v3.0.0 versions contains the commit that fix the problems with python3.8: https://github.com/apache/spark/commit/811d563fbf60203377e8462e4fad271c1140b4fa
YaLTeR commented on 2019-12-13 08:25 (UTC) (edited on 2019-12-13 08:45 (UTC) by YaLTeR)
Doesn't seem to work with Python 3 (the default)?
Update: looks like it's Python 3.8; installing python37 from the AUR and using that seems to work.
tir commented on 2019-07-17 10:35 (UTC) (edited on 2019-07-17 10:39 (UTC) by tir)
I had success with the following PKGBUILD (patch: https://git.io/fj1CT).
There is another, unrelated issue probably with JLine (as noted here: https://github.com/sanori/spark-sbt/issues/4#issuecomment-401621777), for which the workaround would be:
lukaszimmermann commented on 2019-07-15 09:05 (UTC)
Hi, sorry for being unresponsive the last couple of month. Emanuel I added you as co-maintainer, can you perhaps update this package with the new PKGBUILD for Spark 2.4.3.
emanuelfontelles commented on 2019-07-13 17:56 (UTC) (edited on 2019-07-13 17:57 (UTC) by emanuelfontelles)
Hey guys, here are a full PKGBUILD with Spark-2.4.3, with Hadoop binaries, its totally works
1 2 3 4 5 6 Next › Last »