Apache Kafka Kraft – отменен текущий запрос API_VERSIONS

Apache Kafka Kraft – отменен текущий запрос API_VERSIONS ⇐ JAVA

1 сообщение • Страница 1 из 1

Anonymous

Apache Kafka Kraft – отменен текущий запрос API_VERSIONS

Цитата

Сообщение Anonymous » 18 окт 2024, 09:40

2024-10-17T23:03:38.067+03:00  INFO 7592 --- [card-composer-service] [o-auto-1-exec-2] o.a.k.clients.producer.ProducerConfig    : ProducerConfig values:
acks = -1
auto.include.jmx.reporter = true
batch.size = 16384
bootstrap.servers = [localhost:9092, localhost:9094]
buffer.memory = 33554432
client.dns.lookup = use_all_dns_ips
client.id = producer-1
compression.type = none
connections.max.idle.ms = 540000
delivery.timeout.ms = 120000
enable.idempotence = true
enable.metrics.push = true
interceptor.classes = []
key.serializer = class org.apache.kafka.common.serialization.StringSerializer
linger.ms = 0
max.block.ms = 60000
max.in.flight.requests.per.connection = 5
max.request.size = 1048576
metadata.max.age.ms = 300000
metadata.max.idle.ms = 300000
metric.reporters = []
metrics.num.samples = 2
metrics.recording.level = INFO
metrics.sample.window.ms = 30000
partitioner.adaptive.partitioning.enable = true
partitioner.availability.timeout.ms = 0
partitioner.class = null
partitioner.ignore.keys = false
receive.buffer.bytes = 32768
reconnect.backoff.max.ms = 1000
reconnect.backoff.ms = 50
request.timeout.ms = 30000
retries = 3
retry.backoff.max.ms = 1000
retry.backoff.ms = 100
sasl.client.callback.handler.class = null
sasl.jaas.config = null
sasl.kerberos.kinit.cmd = /usr/bin/kinit
sasl.kerberos.min.time.before.relogin = 60000
sasl.kerberos.service.name = null
sasl.kerberos.ticket.renew.jitter = 0.05
sasl.kerberos.ticket.renew.window.factor = 0.8
sasl.login.callback.handler.class = null
sasl.login.class = null
sasl.login.connect.timeout.ms = null
sasl.login.read.timeout.ms = null
sasl.login.refresh.buffer.seconds = 300
sasl.login.refresh.min.period.seconds = 60
sasl.login.refresh.window.factor = 0.8
sasl.login.refresh.window.jitter = 0.05
sasl.login.retry.backoff.max.ms = 10000
sasl.login.retry.backoff.ms = 100
sasl.mechanism = GSSAPI
sasl.oauthbearer.clock.skew.seconds = 30
sasl.oauthbearer.expected.audience = null
sasl.oauthbearer.expected.issuer = null
sasl.oauthbearer.jwks.endpoint.refresh.ms = 3600000
sasl.oauthbearer.jwks.endpoint.retry.backoff.max.ms = 10000
sasl.oauthbearer.jwks.endpoint.retry.backoff.ms = 100
sasl.oauthbearer.jwks.endpoint.url = null
sasl.oauthbearer.scope.claim.name = scope
sasl.oauthbearer.sub.claim.name = sub
sasl.oauthbearer.token.endpoint.url = null
security.protocol = PLAINTEXT
security.providers = null
send.buffer.bytes = 131072
socket.connection.setup.timeout.max.ms = 30000
socket.connection.setup.timeout.ms = 10000
ssl.cipher.suites = null
ssl.enabled.protocols = [TLSv1.2, TLSv1.3]
ssl.endpoint.identification.algorithm = https
ssl.engine.factory.class = null
ssl.key.password = null
ssl.keymanager.algorithm = SunX509
ssl.keystore.certificate.chain = null
ssl.keystore.key = null
ssl.keystore.location = null
ssl.keystore.password = null
ssl.keystore.type = JKS
ssl.protocol = TLSv1.3
ssl.provider = null
ssl.secure.random.implementation = null
ssl.trustmanager.algorithm = PKIX
ssl.truststore.certificates = null
ssl.truststore.location = null
ssl.truststore.password = null
ssl.truststore.type = JKS
transaction.timeout.ms = 60000
transactional.id = null
value.serializer = class org.apache.kafka.common.serialization.StringSerializer

2024-10-17T23:03:38.092+03:00  INFO 7592 --- [card-composer-service] [o-auto-1-exec-2] o.a.k.c.t.i.KafkaMetricsCollector        : initializing Kafka metrics collector
2024-10-17T23:03:38.103+03:00  INFO 7592 --- [card-composer-service] [o-auto-1-exec-2] o.a.k.clients.producer.KafkaProducer     : [Producer clientId=producer-1] Instantiated an idempotent producer.
2024-10-17T23:03:38.134+03:00  INFO 7592 --- [card-composer-service] [o-auto-1-exec-2] o.a.kafka.common.utils.AppInfoParser     : Kafka version: 3.7.0
2024-10-17T23:03:38.134+03:00  INFO 7592 --- [card-composer-service] [o-auto-1-exec-2] o.a.kafka.common.utils.AppInfoParser     : Kafka commitId: 2ae524ed625438c5
2024-10-17T23:03:38.134+03:00  INFO 7592 --- [card-composer-service] [o-auto-1-exec-2] o.a.kafka.common.utils.AppInfoParser     : Kafka startTimeMs:  1729195418133
2024-10-17T23:03:38.372+03:00  INFO 7592 --- [card-composer-service] [ad | producer-1] org.apache.kafka.clients.NetworkClient   : [Producer clientId=producer-1] Node -2 disconnected.
2024-10-17T23:03:38.374+03:00  INFO 7592 --- [card-composer-service] [ad | producer-1] org.apache.kafka.clients.NetworkClient   : [Producer clientId=producer-1] Cancelled in-flight API_VERSIONS request with correlation id 2 due to node -2 being disconnected (elapsed time since creation: 1ms, elapsed time since send: 1ms, request timeout: 30000ms)
2024-10-17T23:03:38.374+03:00  WARN 7592 --- [card-composer-service] [ad | producer-1] org.apache.kafka.clients.NetworkClient   : [Producer clientId=producer-1] Bootstrap broker localhost:9094 (id: -2 rack: null) disconnected
2024-10-17T23:03:38.380+03:00  INFO 7592 --- [card-composer-service] [ad | producer-1] org.apache.kafka.clients.Metadata        : [Producer clientId=producer-1] Cluster ID: nQCoigKGSP22Wno_34Ez0Q
2024-10-17T23:03:38.490+03:00  INFO 7592 --- [card-composer-service] [ad | producer-1] o.a.k.c.p.internals.TransactionManager   : [Producer clientId=producer-1] ProducerId set to 17000 with epoch 0
2024-10-17T23:03:38.496+03:00  INFO 7592 --- [card-composer-service] [ad | producer-1] org.apache.kafka.clients.NetworkClient   : [Producer clientId=producer-1] Node 1 disconnected.
2024-10-17T23:03:38.496+03:00  INFO 7592 --- [card-composer-service] [ad | producer-1] org.apache.kafka.clients.NetworkClient   : [Producer clientId=producer-1] Cancelled in-flight API_VERSIONS request with correlation id 7 due to node 1 being disconnected (elapsed time since creation: 1ms, elapsed time since send: 1ms, request timeout: 30000ms)
2024-10-17T23:03:38.554+03:00  INFO 7592 --- [card-composer-service] [ad | producer-1] org.apache.kafka.clients.NetworkClient   : [Producer clientId=producer-1] Node 1 disconnected.
2024-10-17T23:03:38.554+03:00  INFO 7592 --- [card-composer-service] [ad | producer-1] org.apache.kafka.clients.NetworkClient   : [Producer clientId=producer-1] Cancelled in-flight API_VERSIONS request with correlation id 9 due to node 1 being disconnected (elapsed time since creation: 1ms, elapsed time since send: 1ms, request timeout: 30000ms)
2024-10-17T23:03:38.656+03:00  INFO 7592 --- [card-composer-service] [ad | producer-1] org.apache.kafka.clients.NetworkClient   : [Producer clientId=producer-1] Node 1 disconnected.
2024-10-17T23:03:38.657+03:00  INFO 7592 --- [card-composer-service] [ad | producer-1] org.apache.kafka.clients.NetworkClient   : [Producer clientId=producer-1] Cancelled in-flight API_VERSIONS request with correlation id 11 due to node 1 being disconnected (elapsed time since creation: 0ms, elapsed time since send: 0ms, request timeout: 30000ms)
2024-10-17T23:03:38.878+03:00  INFO 7592 --- [card-composer-service] [ad | producer-1] org.apache.kafka.clients.NetworkClient   : [Producer clientId=producer-1] Node 1 disconnected.
2024-10-17T23:03:38.878+03:00  INFO 7592 --- [card-composer-service] [ad | producer-1] org.apache.kafka.clients.NetworkClient   : [Producer clientId=producer-1] Cancelled in-flight API_VERSIONS request with correlation id 13 due to node 1 being disconnected (elapsed time since creation: 1ms, elapsed time since send: 1ms, request timeout: 30000ms)
2024-10-17T23:03:39.314+03:00  INFO 7592 --- [card-composer-service] [ad | producer-1] org.apache.kafka.clients.NetworkClient   : [Producer clientId=producer-1] Node 1 disconnected.
2024-10-17T23:03:39.314+03:00  INFO 7592 --- [card-composer-service] [ad | producer-1] org.apache.kafka.clients.NetworkClient   : [Producer clientId=producer-1] Cancelled in-flight API_VERSIONS request with correlation id 15 due to node 1 being disconnected (elapsed time since creation: 1ms, elapsed time since send: 1ms, request timeout: 30000ms)
2024-10-17T23:03:40.034+03:00  INFO 7592 --- [card-composer-service] [ad | producer-1] org.apache.kafka.clients.NetworkClient   : [Producer clientId=producer-1] Node 1 disconnected.

Я получаю эту ошибку, когда пытаюсь выполнить запрос:

Код: Выделить всё

{
"listOfWords": "side;main;plot;joke;joker;circus;",
"onlyTranslate":  false
}

Моя конфигурация производителя:

Код: Выделить всё

import org.apache.kafka.clients.producer.KafkaProducer;
import org.apache.kafka.clients.producer.ProducerConfig;
import org.apache.kafka.clients.producer.ProducerRecord;
import org.apache.kafka.common.serialization.StringSerializer;
import org.springframework.stereotype.Component;

import java.util.Properties;

@Component
public class KafkaProducerRequest {
public void sendMessage(String message) {
Properties props = new Properties();
props.put(ProducerConfig.BOOTSTRAP_SERVERS_CONFIG, "localhost:9092,localhost:9094");
props.put(ProducerConfig.KEY_SERIALIZER_CLASS_CONFIG, StringSerializer.class.getName());
props.put(ProducerConfig.VALUE_SERIALIZER_CLASS_CONFIG, StringSerializer.class.getName());
props.put(ProducerConfig.RETRIES_CONFIG, "3");

KafkaProducer producer = new KafkaProducer(props);
ProducerRecord producerRecord = new ProducerRecord("image-handler-topic", message);

producer.send(producerRecord);
producer.flush();
producer.close();
}
}

DockerFile:

Код: Выделить всё

version: "3.9"
networks:
main-network:
driver: bridge
volumes:
volume-kafka-1:
volume-kafka-2:

services:
kafka1:
image: 'bitnami/kafka:latest'
ports:
- "9092:9092"
networks:
- main-network
environment:
- KAFKA_ENABLE_KRAFT=yes
- KAFKA_CFG_NODE_ID=0
- KAFKA_BROKER_ID=0
- KAFKA_CFG_CONTROLLER_LISTENER_NAMES=CONTROLLER
- ALLOW_PLAINTEXT_LISTENER=yes
- KAFKA_CFG_PROCESS_ROLES=controller,broker
- KAFKA_CFG_LISTENERS=PLAINTEXT://0.0.0.0:9092,CONTROLLER://0.0.0.0:9093
- KAFKA_CFG_ADVERTISED_LISTENERS=PLAINTEXT://kafka1:9092
- KAFKA_CFG_LISTENER_SECURITY_PROTOCOL_MAP=CONTROLLER:PLAINTEXT,PLAINTEXT:PLAINTEXT
- KAFKA_CFG_CONTROLLER_QUORUM_VOTERS=0@kafka1:9093,1@kafka2:9095
- KAFKA_CFG_CONTROLLER_LISTENER_NAMES=CONTROLLER
- KAFKA_KRAFT_CLUSTER_ID=nQCoigKGSP22Wno_34Ez0Q
volumes:
- volume-kafka-1:/bitnami/kafka
kafka2:
image: 'bitnami/kafka:latest'
ports:
- "9094:9092"
networks:
- main-network
environment:
- KAFKA_ENABLE_KRAFT=yes
- KAFKA_CFG_NODE_ID=1
- KAFKA_BROKER_ID=1
- KAFKA_CFG_CONTROLLER_LISTENER_NAMES=CONTROLLER
- ALLOW_PLAINTEXT_LISTENER=yes
- KAFKA_CFG_PROCESS_ROLES=controller,broker
- KAFKA_CFG_LISTENERS=PLAINTEXT://0.0.0.0:9094,CONTROLLER://0.0.0.0:9095
- KAFKA_CFG_ADVERTISED_LISTENERS=PLAINTEXT://kafka2:9094
- KAFKA_CFG_LISTENER_SECURITY_PROTOCOL_MAP=CONTROLLER:PLAINTEXT,PLAINTEXT:PLAINTEXT
- KAFKA_CFG_CONTROLLER_QUORUM_VOTERS=0@kafka1:9093,1@kafka2:9095
- KAFKA_CFG_CONTROLLER_LISTENER_NAMES=CONTROLLER
- KAFKA_KRAFT_CLUSTER_ID=nQCoigKGSP22Wno_34Ez0Q
volumes:
- volume-kafka-2:/bitnami/kafka
ui:
image: provectuslabs/kafka-ui:v0.7.1
ports:
- "9898:8080"
environment:
- KAFKA_CLUSTERS_0_BOOTSTRAP_SERVERS=kafka1:9092,kafka2:9094
- KAFKA_CLUSTERS_0_NAME=kraft
networks:
- main-network

Я думаю, что что-то не так с моей конфигурацией Kafka, но я не могу осознать проблему, потому что я новичок в Kafka D:
У меня было недавно возникла другая проблема:

Код: Выделить всё

Received invalid metadata error in produce request on partition image-handler-topic-0 due to org.apache.kafka.common.errors.NotLeaderOrFollowerException: For requests intended only for the leader, this error indicates that the broker is not the current leader. For requests intended for any replica, this error indicates that the broker is not a replica of the topic partition.. Going to request metadata update now

Я исправил это, но у меня снова головная боль.

Подробнее здесь: https://stackoverflow.com/questions/790 ... ns-request

1729233627

Anonymous

[code]2024-10-17T23:03:38.067+03:00  INFO 7592 --- [card-composer-service] [o-auto-1-exec-2] o.a.k.clients.producer.ProducerConfig    : ProducerConfig values:
acks = -1
auto.include.jmx.reporter = true
batch.size = 16384
bootstrap.servers = [localhost:9092, localhost:9094]
buffer.memory = 33554432
client.dns.lookup = use_all_dns_ips
client.id = producer-1
compression.type = none
connections.max.idle.ms = 540000
delivery.timeout.ms = 120000
enable.idempotence = true
enable.metrics.push = true
interceptor.classes = []
key.serializer = class org.apache.kafka.common.serialization.StringSerializer
linger.ms = 0
max.block.ms = 60000
max.in.flight.requests.per.connection = 5
max.request.size = 1048576
metadata.max.age.ms = 300000
metadata.max.idle.ms = 300000
metric.reporters = []
metrics.num.samples = 2
metrics.recording.level = INFO
metrics.sample.window.ms = 30000
partitioner.adaptive.partitioning.enable = true
partitioner.availability.timeout.ms = 0
partitioner.class = null
partitioner.ignore.keys = false
receive.buffer.bytes = 32768
reconnect.backoff.max.ms = 1000
reconnect.backoff.ms = 50
request.timeout.ms = 30000
retries = 3
retry.backoff.max.ms = 1000
retry.backoff.ms = 100
sasl.client.callback.handler.class = null
sasl.jaas.config = null
sasl.kerberos.kinit.cmd = /usr/bin/kinit
sasl.kerberos.min.time.before.relogin = 60000
sasl.kerberos.service.name = null
sasl.kerberos.ticket.renew.jitter = 0.05
sasl.kerberos.ticket.renew.window.factor = 0.8
sasl.login.callback.handler.class = null
sasl.login.class = null
sasl.login.connect.timeout.ms = null
sasl.login.read.timeout.ms = null
sasl.login.refresh.buffer.seconds = 300
sasl.login.refresh.min.period.seconds = 60
sasl.login.refresh.window.factor = 0.8
sasl.login.refresh.window.jitter = 0.05
sasl.login.retry.backoff.max.ms = 10000
sasl.login.retry.backoff.ms = 100
sasl.mechanism = GSSAPI
sasl.oauthbearer.clock.skew.seconds = 30
sasl.oauthbearer.expected.audience = null
sasl.oauthbearer.expected.issuer = null
sasl.oauthbearer.jwks.endpoint.refresh.ms = 3600000
sasl.oauthbearer.jwks.endpoint.retry.backoff.max.ms = 10000
sasl.oauthbearer.jwks.endpoint.retry.backoff.ms = 100
sasl.oauthbearer.jwks.endpoint.url = null
sasl.oauthbearer.scope.claim.name = scope
sasl.oauthbearer.sub.claim.name = sub
sasl.oauthbearer.token.endpoint.url = null
security.protocol = PLAINTEXT
security.providers = null
send.buffer.bytes = 131072
socket.connection.setup.timeout.max.ms = 30000
socket.connection.setup.timeout.ms = 10000
ssl.cipher.suites = null
ssl.enabled.protocols = [TLSv1.2, TLSv1.3]
ssl.endpoint.identification.algorithm = https
ssl.engine.factory.class = null
ssl.key.password = null
ssl.keymanager.algorithm = SunX509
ssl.keystore.certificate.chain = null
ssl.keystore.key = null
ssl.keystore.location = null
ssl.keystore.password = null
ssl.keystore.type = JKS
ssl.protocol = TLSv1.3
ssl.provider = null
ssl.secure.random.implementation = null
ssl.trustmanager.algorithm = PKIX
ssl.truststore.certificates = null
ssl.truststore.location = null
ssl.truststore.password = null
ssl.truststore.type = JKS
transaction.timeout.ms = 60000
transactional.id = null
value.serializer = class org.apache.kafka.common.serialization.StringSerializer

2024-10-17T23:03:38.092+03:00  INFO 7592 --- [card-composer-service] [o-auto-1-exec-2] o.a.k.c.t.i.KafkaMetricsCollector        : initializing Kafka metrics collector
2024-10-17T23:03:38.103+03:00  INFO 7592 --- [card-composer-service] [o-auto-1-exec-2] o.a.k.clients.producer.KafkaProducer     : [Producer clientId=producer-1] Instantiated an idempotent producer.
2024-10-17T23:03:38.134+03:00  INFO 7592 --- [card-composer-service] [o-auto-1-exec-2] o.a.kafka.common.utils.AppInfoParser     : Kafka version: 3.7.0
2024-10-17T23:03:38.134+03:00  INFO 7592 --- [card-composer-service] [o-auto-1-exec-2] o.a.kafka.common.utils.AppInfoParser     : Kafka commitId: 2ae524ed625438c5
2024-10-17T23:03:38.134+03:00  INFO 7592 --- [card-composer-service] [o-auto-1-exec-2] o.a.kafka.common.utils.AppInfoParser     : Kafka startTimeMs:  1729195418133
2024-10-17T23:03:38.372+03:00  INFO 7592 --- [card-composer-service] [ad | producer-1] org.apache.kafka.clients.NetworkClient   : [Producer clientId=producer-1] Node -2 disconnected.
2024-10-17T23:03:38.374+03:00  INFO 7592 --- [card-composer-service] [ad | producer-1] org.apache.kafka.clients.NetworkClient   : [Producer clientId=producer-1] Cancelled in-flight API_VERSIONS request with correlation id 2 due to node -2 being disconnected (elapsed time since creation: 1ms, elapsed time since send: 1ms, request timeout: 30000ms)
2024-10-17T23:03:38.374+03:00  WARN 7592 --- [card-composer-service] [ad | producer-1] org.apache.kafka.clients.NetworkClient   : [Producer clientId=producer-1] Bootstrap broker localhost:9094 (id: -2 rack: null) disconnected
2024-10-17T23:03:38.380+03:00  INFO 7592 --- [card-composer-service] [ad | producer-1] org.apache.kafka.clients.Metadata        : [Producer clientId=producer-1] Cluster ID: nQCoigKGSP22Wno_34Ez0Q
2024-10-17T23:03:38.490+03:00  INFO 7592 --- [card-composer-service] [ad | producer-1] o.a.k.c.p.internals.TransactionManager   : [Producer clientId=producer-1] ProducerId set to 17000 with epoch 0
2024-10-17T23:03:38.496+03:00  INFO 7592 --- [card-composer-service] [ad | producer-1] org.apache.kafka.clients.NetworkClient   : [Producer clientId=producer-1] Node 1 disconnected.
2024-10-17T23:03:38.496+03:00  INFO 7592 --- [card-composer-service] [ad | producer-1] org.apache.kafka.clients.NetworkClient   : [Producer clientId=producer-1] Cancelled in-flight API_VERSIONS request with correlation id 7 due to node 1 being disconnected (elapsed time since creation: 1ms, elapsed time since send: 1ms, request timeout: 30000ms)
2024-10-17T23:03:38.554+03:00  INFO 7592 --- [card-composer-service] [ad | producer-1] org.apache.kafka.clients.NetworkClient   : [Producer clientId=producer-1] Node 1 disconnected.
2024-10-17T23:03:38.554+03:00  INFO 7592 --- [card-composer-service] [ad | producer-1] org.apache.kafka.clients.NetworkClient   : [Producer clientId=producer-1] Cancelled in-flight API_VERSIONS request with correlation id 9 due to node 1 being disconnected (elapsed time since creation: 1ms, elapsed time since send: 1ms, request timeout: 30000ms)
2024-10-17T23:03:38.656+03:00  INFO 7592 --- [card-composer-service] [ad | producer-1] org.apache.kafka.clients.NetworkClient   : [Producer clientId=producer-1] Node 1 disconnected.
2024-10-17T23:03:38.657+03:00  INFO 7592 --- [card-composer-service] [ad | producer-1] org.apache.kafka.clients.NetworkClient   : [Producer clientId=producer-1] Cancelled in-flight API_VERSIONS request with correlation id 11 due to node 1 being disconnected (elapsed time since creation: 0ms, elapsed time since send: 0ms, request timeout: 30000ms)
2024-10-17T23:03:38.878+03:00  INFO 7592 --- [card-composer-service] [ad | producer-1] org.apache.kafka.clients.NetworkClient   : [Producer clientId=producer-1] Node 1 disconnected.
2024-10-17T23:03:38.878+03:00  INFO 7592 --- [card-composer-service] [ad | producer-1] org.apache.kafka.clients.NetworkClient   : [Producer clientId=producer-1] Cancelled in-flight API_VERSIONS request with correlation id 13 due to node 1 being disconnected (elapsed time since creation: 1ms, elapsed time since send: 1ms, request timeout: 30000ms)
2024-10-17T23:03:39.314+03:00  INFO 7592 --- [card-composer-service] [ad | producer-1] org.apache.kafka.clients.NetworkClient   : [Producer clientId=producer-1] Node 1 disconnected.
2024-10-17T23:03:39.314+03:00  INFO 7592 --- [card-composer-service] [ad | producer-1] org.apache.kafka.clients.NetworkClient   : [Producer clientId=producer-1] Cancelled in-flight API_VERSIONS request with correlation id 15 due to node 1 being disconnected (elapsed time since creation: 1ms, elapsed time since send: 1ms, request timeout: 30000ms)
2024-10-17T23:03:40.034+03:00  INFO 7592 --- [card-composer-service] [ad | producer-1] org.apache.kafka.clients.NetworkClient   : [Producer clientId=producer-1] Node 1 disconnected.
[/code]
Я получаю эту ошибку, когда пытаюсь выполнить запрос:
[code]{
"listOfWords": "side;main;plot;joke;joker;circus;",
"onlyTranslate":  false
}
[/code]
Моя конфигурация производителя:
[code]import org.apache.kafka.clients.producer.KafkaProducer;
import org.apache.kafka.clients.producer.ProducerConfig;
import org.apache.kafka.clients.producer.ProducerRecord;
import org.apache.kafka.common.serialization.StringSerializer;
import org.springframework.stereotype.Component;

import java.util.Properties;

@Component
public class KafkaProducerRequest {
public void sendMessage(String message) {
Properties props = new Properties();
props.put(ProducerConfig.BOOTSTRAP_SERVERS_CONFIG, "localhost:9092,localhost:9094");
props.put(ProducerConfig.KEY_SERIALIZER_CLASS_CONFIG, StringSerializer.class.getName());
props.put(ProducerConfig.VALUE_SERIALIZER_CLASS_CONFIG, StringSerializer.class.getName());
props.put(ProducerConfig.RETRIES_CONFIG, "3");

KafkaProducer producer = new KafkaProducer(props);
ProducerRecord producerRecord = new ProducerRecord("image-handler-topic", message);

producer.send(producerRecord);
producer.flush();
producer.close();
}
}
[/code]
DockerFile:
[code]version: "3.9"
networks:
main-network:
driver: bridge
volumes:
volume-kafka-1:
volume-kafka-2:

services:
kafka1:
image: 'bitnami/kafka:latest'
ports:
- "9092:9092"
networks:
- main-network
environment:
- KAFKA_ENABLE_KRAFT=yes
- KAFKA_CFG_NODE_ID=0
- KAFKA_BROKER_ID=0
- KAFKA_CFG_CONTROLLER_LISTENER_NAMES=CONTROLLER
- ALLOW_PLAINTEXT_LISTENER=yes
- KAFKA_CFG_PROCESS_ROLES=controller,broker
- KAFKA_CFG_LISTENERS=PLAINTEXT://0.0.0.0:9092,CONTROLLER://0.0.0.0:9093
- KAFKA_CFG_ADVERTISED_LISTENERS=PLAINTEXT://kafka1:9092
- KAFKA_CFG_LISTENER_SECURITY_PROTOCOL_MAP=CONTROLLER:PLAINTEXT,PLAINTEXT:PLAINTEXT
- KAFKA_CFG_CONTROLLER_QUORUM_VOTERS=0@kafka1:9093,1@kafka2:9095
- KAFKA_CFG_CONTROLLER_LISTENER_NAMES=CONTROLLER
- KAFKA_KRAFT_CLUSTER_ID=nQCoigKGSP22Wno_34Ez0Q
volumes:
- volume-kafka-1:/bitnami/kafka
kafka2:
image: 'bitnami/kafka:latest'
ports:
- "9094:9092"
networks:
- main-network
environment:
- KAFKA_ENABLE_KRAFT=yes
- KAFKA_CFG_NODE_ID=1
- KAFKA_BROKER_ID=1
- KAFKA_CFG_CONTROLLER_LISTENER_NAMES=CONTROLLER
- ALLOW_PLAINTEXT_LISTENER=yes
- KAFKA_CFG_PROCESS_ROLES=controller,broker
- KAFKA_CFG_LISTENERS=PLAINTEXT://0.0.0.0:9094,CONTROLLER://0.0.0.0:9095
- KAFKA_CFG_ADVERTISED_LISTENERS=PLAINTEXT://kafka2:9094
- KAFKA_CFG_LISTENER_SECURITY_PROTOCOL_MAP=CONTROLLER:PLAINTEXT,PLAINTEXT:PLAINTEXT
- KAFKA_CFG_CONTROLLER_QUORUM_VOTERS=0@kafka1:9093,1@kafka2:9095
- KAFKA_CFG_CONTROLLER_LISTENER_NAMES=CONTROLLER
- KAFKA_KRAFT_CLUSTER_ID=nQCoigKGSP22Wno_34Ez0Q
volumes:
- volume-kafka-2:/bitnami/kafka
ui:
image: provectuslabs/kafka-ui:v0.7.1
ports:
- "9898:8080"
environment:
- KAFKA_CLUSTERS_0_BOOTSTRAP_SERVERS=kafka1:9092,kafka2:9094
- KAFKA_CLUSTERS_0_NAME=kraft
networks:
- main-network
[/code]
Я думаю, что что-то не так с моей конфигурацией Kafka, но я не могу осознать проблему, потому что я новичок в Kafka D:
У меня было недавно возникла другая проблема:
[code]Received invalid metadata error in produce request on partition image-handler-topic-0 due to org.apache.kafka.common.errors.NotLeaderOrFollowerException: For requests intended only for the leader, this error indicates that the broker is not the current leader. For requests intended for any replica, this error indicates that the broker is not a replica of the topic partition.. Going to request metadata update now
[/code]
Я исправил это, но у меня снова головная боль. 

Подробнее здесь: [url]https://stackoverflow.com/questions/79099718/apache-kafka-kraft-cancelled-in-flight-api-versions-request[/url]

Ответить Пред. тема След. тема

1 сообщение • Страница 1 из 1

Быстрый ответ

Заголовок:

Имя пользователя:

Изменение регистра текста:

Смайлики

Ещё смайлики…

К этому ответу прикреплено по крайней мере одно вложение.

Если вы не хотите добавлять вложения, оставьте поля пустыми. Можно прикреплять файлы, перетаскивая их в окно сообщения.

Максимально разрешённый размер вложения: 15 МБ.

Имя файла:

Комментарий к файлу:

Имя файла	Комментарий к файлу	Размер	Статус

Похожие темы

Ответы

Просмотры

Последнее сообщение

Apache Kafka Kraft – отменен текущий запрос API_VERSIONS

Последнее сообщение Anonymous « 17 окт 2024, 23:17
Добавлено в форуме JAVA

Anonymous » 17 окт 2024, 23:17 » в форуме JAVA

2024-10-17T23:03:38.067+03:00 INFO 7592 --- o.a.k.clients.producer.ProducerConfig : ProducerConfig values:
acks = -1
auto.include.jmx.reporter = true
batch.size = 16384
bootstrap.servers =
buffer.memory = 33554432
client.dns.lookup =...

0 Ответы

84 Просмотры

Последнее сообщение Anonymous
17 окт 2024, 23:17
Apache Kafka Kraft – отменен текущий запрос API_VERSIONS

Последнее сообщение Anonymous « 20 окт 2024, 16:44
Добавлено в форуме JAVA

Anonymous » 20 окт 2024, 16:44 » в форуме JAVA

acks = -1
auto.include.jmx.reporter = true
batch.size = 16384
bootstrap.servers =
buffer.memory = 33554432
client.dns.lookup = use_all_dns_ips
client.id = producer-4
compression.type = none
connections.max.idle.ms = 540000
delivery.timeout.ms =...

0 Ответы

30 Просмотры

Последнее сообщение Anonymous
20 окт 2024, 16:44
Apache Kafka Kraft – отменен текущий запрос API_VERSIONS

Последнее сообщение Anonymous « 28 дек 2024, 22:42
Добавлено в форуме JAVA

Anonymous » 28 дек 2024, 22:42 » в форуме JAVA

acks = -1
auto.include.jmx.reporter = true
batch.size = 16384
bootstrap.servers =
buffer.memory = 33554432
client.dns.lookup = use_all_dns_ips
client.id = producer-4
compression.type = none
connections.max.idle.ms = 540000
delivery.timeout.ms =...

0 Ответы

13 Просмотры

Последнее сообщение Anonymous
28 дек 2024, 22:42
Проблемы с внешним доступом к Docker-Compose Kafka Kraft

Последнее сообщение Anonymous « 23 сен 2024, 01:09
Добавлено в форуме Python

Anonymous » 23 сен 2024, 01:09 » в форуме Python

У меня есть Kafka kraft в docker-compose на сервере Ubuntu. Локально все работает правильно, и я могу, например, перечислить темы:
~$ docker exec -it blopa-kafka-1 /bin/bash
I have no name!@8b166cb3a647:/$ kafka-topics.sh --bootstrap-server...

0 Ответы

31 Просмотры

Последнее сообщение Anonymous
23 сен 2024, 01:09
Проблемы внешнего доступа Kafka Kraft docker-compose

Последнее сообщение Anonymous « 23 сен 2024, 12:42
Добавлено в форуме Python

Anonymous » 23 сен 2024, 12:42 » в форуме Python

У меня есть Kafka kraft в docker-compose на сервере Ubuntu. Локально все работает правильно, и я могу, например, перечислить темы:
~$ docker exec -it blopa-kafka-1 /bin/bash
I have no name!@8b166cb3a647:/$ kafka-topics.sh --bootstrap-server...

0 Ответы

40 Просмотры

Последнее сообщение Anonymous
23 сен 2024, 12:42

Вернуться в «JAVA»