Package Details: kafka 2.12_3.2.1-1

Git Clone URL: https://aur.archlinux.org/kafka.git (read-only, click to copy)
Package Base: kafka
Description: A high-throughput distributed messaging system
Upstream URL: https://kafka.apache.org/
Licenses: Apache
Submitter: nekinie
Maintainer: thor77
Last Packager: thor77
Votes: 27
Popularity: 0.025080
First Submitted: 2014-06-25 11:05 (UTC)
Last Updated: 2022-08-03 18:48 (UTC)

Dependencies (2)

Required by (3)

Sources (5)

Latest Comments

thor77 commented on 2022-01-23 17:13 (UTC)

@kaspermarkus thanks for the report, I added both options in b57ecc9e8b93

kaspermarkus commented on 2022-01-21 09:54 (UTC)

This package didn't work for me, due to the curl command not working properly. After some digging, I found that apparently (some distributions of) curl doesn't follow redirects by default and that caused the download url generation to fail (https://unix.stackexchange.com/questions/321710/why-wont-curl-download-this-link-when-a-browser-will).

What fixed it was to modify the PKGBUILD line 35 from:

_closest=$(curl "${_apache_cgi}?asjson=1" | tr -d '\n ' | sed -r 's/.*"preferred":"(.+)".*/\1/')

to

_closest=$(curl -Li "${_apache_cgi}?asjson=1" | tr -d '\n ' | sed -r 's/.*"preferred":"(.+)".*/\1/')

That is, adding an -L flag to get it to follow redirects, and -i to avoid getting the default verbose information about download size, speed, etc.

thor77 commented on 2021-02-21 10:41 (UTC)

@servitkar it looks like they're not included in the start-script of the official distribution either. Therefore I removed them from the service file as well...

servitkar commented on 2021-02-12 18:27 (UTC)

with jdk-openjdk=15:

kafka[308588]: Unrecognized VM option 'CMSClassUnloadingEnabled'
kafka[329124]: Unrecognized VM option 'CMSScavengeBeforeRemark'

works, when omitted from systemd_kafka.service (or from installed /usr/lib/systemd/system/kafka.service )

keeyan commented on 2019-07-19 17:24 (UTC)

@cramaker Fixed! Thank you. Just updated and restarted Kafka and it all works fine now :)

@dxeoane Yeah that would probably work too. I was looking for where the JARs are located but couldn't find them.

dxeoane commented on 2019-07-19 17:15 (UTC)

@keeyan I have the same problem. In my case, i solved it by creating two symbolic links in the folder /usr/share/java/kafka to the files /usr/share/java/zookeeper/zookeeper-3.5.5.jar and /usr/share/java/zookeeper/zookeeper -jute-3.5.5.jar

cramaker commented on 2019-07-19 17:13 (UTC)

@keenyan Great info - that let me track down the issue. I just pushed out a new pkgrel: give Kafka an update and let me know if that fixes things. Thanks!

keeyan commented on 2019-07-19 15:55 (UTC)

@cramaker yeah I use yay so everything got updated together. Zookeeper is at 3.5.5-1. That said there is no file /usr/share/java/kafka/zookeeper*.jar although zookeeper is running fine. I have tried uninstalling both and reinstalling them again but there is no difference

cramaker commented on 2019-07-19 14:37 (UTC)

@keenyan Did you install the recent Zookeeper update as well? I had to make a change to the Zookeeper client library included with the Kafka package:

/usr/share/java/kafka/zookeeper-3.4.14.jar

That used to be a symbolic link over to /usr/share/java/zookeeper/zookeeper-3.5.5.jar but that is now incompatible.

Let me know a.) what you're /usr/share/java/kafka & /usr/share/java/zookeeper directories look like - I suspect the issue may stem from the change of that symbolic link.

keeyan commented on 2019-07-18 23:59 (UTC)

I installed an update today and now the Kafka service fails. Here is the relevant part of my var/log/kafka/server.log

[2019-07-19 00:50:05,442] ERROR Fatal error during KafkaServer startup. Prepare to shutdown (kafka.server.KafkaServer)
java.lang.NoClassDefFoundError: org/apache/zookeeper/KeeperException
    at kafka.server.KafkaServer.createZkClient$1(KafkaServer.scala:363)
    at kafka.server.KafkaServer.initZkClient(KafkaServer.scala:387)
    at kafka.server.KafkaServer.startup(KafkaServer.scala:207)
    at kafka.server.KafkaServerStartable.startup(KafkaServerStartable.scala:38)
    at kafka.Kafka$.main(Kafka.scala:84)
    at kafka.Kafka.main(Kafka.scala)
Caused by: java.lang.ClassNotFoundException: org.apache.zookeeper.KeeperException
    at java.base/jdk.internal.loader.BuiltinClassLoader.loadClass(BuiltinClassLoader.java:583)
    at java.base/jdk.internal.loader.ClassLoaders$AppClassLoader.loadClass(ClassLoaders.java:178)
    at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:521)
    ... 6 more
[2019-07-19 00:50:05,444] INFO shutting down (kafka.server.KafkaServer)
[2019-07-19 00:50:05,449] INFO shut down completed (kafka.server.KafkaServer)
[2019-07-19 00:50:05,449] ERROR Exiting Kafka. (kafka.server.KafkaServerStartable)
[2019-07-19 00:50:05,452] INFO shutting down (kafka.server.KafkaServer)

The Zookeeper service is up and running fine. Although for some reason it was dead earlier and I had to re enable it though.

Everything was working well before the update today so I think it's the update that broke it.

cramaker commented on 2019-03-26 14:50 (UTC)

@Gedweb Please only mark the package as out-of-date if there is a new version available.

The reason you're getting the unrecognized option error is because you're using a JDK release prior to version 11. I couldn't maintain backwards compatibility when I chose these options. If you update to JDK 11 (which is now the default jdk-openjdk package), these options should work fine.

cramaker commented on 2019-01-18 17:25 (UTC)

@fatalcoder Unfortunately, that's one of the options that I had to update in order to make it compatible with JDK 11

fatalcoder commented on 2019-01-18 09:50 (UTC) (edited on 2019-01-18 09:51 (UTC) by fatalcoder)

Had to change -Xlog:gc to -Xloggc for java openjdk1.8 because of Unrecognized option: -Xlog:gc:/var/log/kafka/kafkaServer-gc.log

cramaker commented on 2019-01-15 20:16 (UTC)

@sunng Done! Switched to +UseG1GC and eliminated some other GC options that have been deprecated

Thanks for the heads-up!

sunng commented on 2019-01-15 14:36 (UTC)

The Java option +UseParNewGC specified in systemd_kafka.service is no longer available in JDK 11. Could you please fix that file?

PhotonX commented on 2018-10-02 11:56 (UTC)

The package has some conflicting files with confluent-platform. I would like to use Kafka and its REST API which is part of the confluent-platform package: https://docs.confluent.io/2.0.0/kafka-rest/docs/intro.html#installation What is the best way to run Kafka's REST API?

cramaker commented on 2018-03-11 15:35 (UTC) (edited on 2018-03-11 15:36 (UTC) by cramaker)

Updated to upstream version 1.0.1

@aqsg As part of the update process, I removed both Kafka and Zookeeper from my local machine and pulled down Kafka using yaourt from the AUR. The Zookeeper dependency was resolved using the Zookeeper in the AUR, which is needed to build Kafka from the AUR.

If you're still having issues, please post the steps to reproduce and I'll take a look.

callofdutyops commented on 2018-03-10 16:31 (UTC) (edited on 2018-03-10 16:32 (UTC) by callofdutyops)

@aqsg Are you able to install the package zookeeper that also maintained by cramaker from AUR?

aqsg commented on 2018-03-02 11:21 (UTC)

I'm not able to build package... it downloads some of the package and then states pacman unable to resolve dependencies 'zookeeper', but I already have zookeeper.

cramaker commented on 2017-12-12 15:33 (UTC)

Adopting package

galaux commented on 2017-11-19 20:20 (UTC)

I am orphaning this package as I unfortunately do not have sufficient time to properly take care of it.

Afnarel commented on 2017-11-19 19:04 (UTC)

Version 0.11.0.0 has been removed from mirrors. Can you please update it to 0.11.0.2?

galaux commented on 2017-09-01 11:57 (UTC)

@nutz: done! For a reason, out of date package notifications were disabled so I totally missed it.

nutz commented on 2017-06-19 08:48 (UTC)

@galaux , could you possibly update the AUR, or if you're not maintaining it anymore disown it? thanks :)

nemster commented on 2017-04-13 06:29 (UTC)

on production instances you want to get rid of the systemd ressource constraints with LimitNOFILE=infinity LimitMEMLOCK=infinity in systemd_kafka.service

galaux commented on 2017-01-27 12:32 (UTC)

Hi! If you feel there is enough interest for this package, please go ahead. We could then co-maintain it!

xyproto commented on 2017-01-25 11:25 (UTC)

Hi, would you mind if I adopted and moved this package to [community], making it an official package?

galaux commented on 2016-10-13 16:17 (UTC)

Don't forget to have a look at [0] for potential breaking changes. [0] https://kafka.apache.org/0100/documentation.html#upgrade

galaux commented on 2014-12-18 13:32 (UTC)

Include Scala version into pkgver

galaux commented on 2014-11-03 19:51 (UTC)

Complete revamp of package. Changelog: - "zookeeper" service file is now named "kafka-zookeeper" - service "kafka-zookeeper" is automatically started by service "kafka" - package files now live in /usr/share/kafka rather than /opt - "backup" files declared - … TODO - run with some other user than root - use dependency on package "zookeeper" Feedback welcome :)

nekinie commented on 2014-06-25 13:58 (UTC)

Could someone with more experience take a look at the services and see if theres a better way to handle the configuration files