Kafka note

Changing from user to superuser: sudo su

bin/zookeeper-server-start.sh config/zookeeper.properties
bin/kafka-server-start.sh config/server.properties

should be run in two terminals

found port 2181 used, kill the program run on port 2181

env | grep JAVA
JAVA_HOME=/opt/jdk/jdk1.8.0_181


vi .bashrc

export JAVA_HOME="/opt/jdk/jdk1.8.0_181"
export PATH=$JAVA_HOME/bin:$PATH

source .bashrc

open another terminal

1.Creating a Kafka Topic
  • bin/kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor 1 --partitions 1 --topic test
2.Start Producer to Send Messages
  • bin/kafka-console-producer.sh --broker-list localhost:9092 --topic Hello-Kafka

open another terminal

3.Start Consumer to Receive Messages
  • bin/kafka-console-consumer.sh --zookeeper localhost:2181 --topic Hello-Kafka --from-beginning
Start multiple brokers
  • bin/kafka-server-start.sh config/server.properties
  • bin/kafka-server-start.sh config/server-one.properties (modify broker.id=1, port=9093, log.dirs=/tmp/kafka-logs-1)
  • bin/kafka-server-start.sh config/server-two.properties (modify broker.id=2, port=9094, log.dirs=/tmp/kafka-logs-2)
Creat a topic
  • bin/kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor 3 --partitions 1 --topic Multibrokerapplication
  • bin/kafka-topics.sh --describe --zookeeper localhost:2181--topic Multibrokerappli-cation
Start Producer to Send Messages
  • bin/kafka-console-producer.sh --broker-list localhost:9092 --topic Multibrokerapplication

if failed to Maven install: :::python rm -rf rm -rf ~/.m2/repository/org/apache/

web.xml: :::python
org.apache.maven.plugins maven-war-plugin src\main\webapp\WEB-INF\web.xml

add dependency in pom.xml

blogroll

social