Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature for configurable librdkafka's message_max_bytes propetry #30

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

tsukada-ascade
Copy link

To allow producers to send large messages, create a pull request that allows librdkafka's message_max_bytes to be set from nginx.conf.

See also #29 .

….conf

If the message sent by kafka producer is larger than 1000000B, librdkafka may
make the following error:

  Broker: Message size too large

In such cases, message.max.bytes should be set appropriately. This patch allows
you to set this property by specifying kafka_message_max_bytes in nginx.conf.

nginx.conf:

  http {

      # some other configs

      kafka;

      kafka_broker_list 127.0.0.1:9092 127.0.0.1:9093; # host:port ...

  ->  kafka_message_max_bytes 16m;

      server {
      ...

For details on the message.max.bytes property, please see following URL.

https://github.com/edenhill/librdkafka/blob/master/CONFIGURATION.md
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

1 participant