Fluentd v1.16.7

Full Changelog: v1.16.6...v1.16.7

Bug fix

• Backport(v1.16) command: fix NoMethodError of --daemon under Windows (#4716) in #4796
• Backport(v1.16) Windows: Fix an issue where stopping the service immediately after startup could leave the processes (#4782) in #4802

Misc

• Backport(v1.16): tests: use never instead of dont_allow (#4671) in #4723
• Backport(v1.16) tests: fix unused_port (#4675) in #4788
• Backport(v1.16) test_in_udp: add timeout for message_length_limit test (#4676) in #4789
• Backport(v1.16) test_in_udp: Reduce execution time of message_length_limit test (#4682) in #4790
• Backport(v1.16) test_out_forward: remove unnecessary ack_response_timeout setting (#4685) in #4791
• Backport(v1.16) test_cat: use proper protocol in unused_port method (#4686) in #4793
• Backport(v1.16) test_ack_handler: use singleton method instead of stub for stability (#4698) in #4794
• Backport(v1.16) test_in_tail: fix flaky tests for file rotation (#4710) in #4795
• Backport(v1.16) README: remove deprecated google analytics beacon (#4722) in #4797
• Backport(v1.16) test_out_file: fix file open mode for binary file in #4798
• Backport(v1.16) test_cat: specify the reading size to read in binary mode (#4730) in #4799
• Backport(v1.16) windows: add workaround for unexpected exception (#4747) in #4800
• Backport(v1.16) test_out_exec_filter: add a sleep to ensure the stream is emitted (#4755) in #4801
• Backport(v1.16) ci: use latest rubygems again for Ruby 3.1 on windows (#4750) in #4803

Contributors to this release (Alphabetical order)

• bennettfalkenberg
• Daijiro Fukuda
• Kentaro Hayashi
• Shizuo Fujita
• Takuro Ashie

Fluentd v1.18.0

Full Changelog: v1.17.1...v1.18.0

Enhancement

• #4624 Add zero-downtime-restart feature for non-Windows
• #4661 Add with-source-only feature
  • fluentd command: Add --with-source-only option
  • System configuration: Add with_source_only option
• #4661 Embedded plugin: Add out_buffer plugin, which can be used for buffering and relabeling events
• #4580 Config File Syntax: Extend Embedded Ruby Code support for Hashes and Arrays
  • Example: key {"foo":"#{1 + 1}"} => key {"foo":"2"}
  • Please note that this is not backward compatible, although we assume that this will never affect to actual existing configs.
  • In case the behavior changes unintentionally, you can disable this feature by surrounding the entire value with single quotes.
    • key '{"foo":"#{1 + 1}"}' => key {"foo":"#{1 + 1}"}
• #4718 transport tls: Use SSL_VERIFY_NONE by default
• #4720 transport tls: Add ensure_fips option to ensure FIPS compliant mode
• #4649 plugin_helper/server: Add receive_buffer_size parameter in transport section
• #4620 filter_parser: Now able to handle multiple parsed results
• #4655 in_http: add add_tag_prefix option
• #4604 System configuration: add path option in log section

Bug Fix

• #4716 command: fix NoMethodError of --daemon under Windows
• #4605 fluentd command: fix --plugin (-p) option not to overwrite default value

Misc

• #4619 http_server: Ready to support Async 2.0 gem
• #4641 Minor code refactoring
• #4638 #4644 #4675 #4676 #4677 #4686 CI fixes

Contributors to this release (Alphabetical order)

• Athish Pranav D
• Daijiro Fukuda
• Kentaro Hayashi
• Takuro Ashie
• Watson

Fluentd v1.16.6

Full Changelog: v1.16.5...v1.16.6

Bug Fix

• YAML config syntax: Fix issue where $log_level element was not supported correctly
  #4486
• parser_json: Fix wrong LoadError warning
  #4592
• fluentd command: Fix --plugin (-p) option not to overwrite default value
  #4605

Misc

• out_file: Add warn message for symlink_path setting
  #4512
• Keep console gem v1.23 to avoid LoadError
  #4510

Fluentd v1.17.1

Full Changelog: v1.17.0...v1.17.1

Enhancement

• #4528 out_http: Add compress gzip option
• #4533 in_exec: Add encoding option to handle non-ascii characters
• #4578 in_tail: Add throttling metrics
• #4588 compat: Improve method call performance
• #4586 in_sample: Add reuse_record parameter to reuse the sample data
  • in_sample has changed to copy sample data by default to avoid the impact of destructive changes by subsequent plugins.
  • This increases the load when generating large amounts of sample data.
  • You can use this new parameter to have the same performance as before.

Bug Fix

• #4492 logger: Fix LoadError with console gem v1.25
• #4522 parser_json: Fix wrong LoadError warning
• #4530 in_tail: Fix an issue where a large single line could consume a large amount of memory even though max_line_size is set
• #4482 yaml_parser: Support $log_level element

Misc

• #4523 Comment out inappropriate default configuration about out_forward
• #4534 gemspec: Remove unnecessary files from released gem
• #4535 plugin-generator: Update gemspec to remove unnecessary files
• #4594 Suppress non-parenthesis warnings
• #4598 Fix FrozenError in http_server plugin helper
• #4589 Add logger gem dependency for Ruby 3.5
• #4502 out_file: Add warn message for symlink_path setting

Contributors to this release (Alphabetical order)

• Athish Pranav
• Daijiro Fukuda
• Harshita Sao
• Hiroshi Hatake
• Kentaro Hayashi
• Lewis Rockliffe
• Shingo Nakayama
• Taeseong Yu
• Takuro Ashie
• Watson

Fluentd v1.17.0

Full Changelog: v1.16.2...v1.17.0

Enhancement

• #4282 in_http: Recognize CSP reports as JSON data
• #4330 out_http: Add option to reuse connections
• #4401 in_tail: Expand glob capability for square brackets and one character matcher
• #4459 out_http: Support AWS Signature Version 4 authentication

Bug Fix

• #4474 Make sure parser_json and parser_msgpack return Hash.
  Make parser_json and parser_msgpack accept only Hash or Array of Hash.
• #4478 filter_parser: Add error event for multiple parsed results

Misc

• #4288 Raise minimum required ruby version
• #4411 Require missing dependent gems as of Ruby 3.4-dev
• #4294 #4299 #4302 #4320 Minor code refactoring
• #4369 #4433 #4452 #4477 CI fixes
• #4429 github: unify YAML file extension to .yml

Contributors to this release (Alphabetical order)

• Christian Norbert Menges
• Daijiro Fukuda
• David Venable
• Giedrius Statkevičius
• Hiroshi Hatake
• Kentaro Hayashi
• Šimon Lukašík
• Takuro Ashie

v1.16.5

Full Changelog: v1.16.4...v1.16.5

Bug Fix

• #4447 Buffer: Fix emit error of v1.16.4 sometimes failing to process large data exceeding chunk size limit

Contributors to this release (Alphabetical order)

• Daijiro Fukuda
• Luke Arntz (Reporting #4447 problem. Thanks!)

v1.16.4

Full Changelog: v1.16.3...v1.16.4

Bug Fix

• #4342 Fix to avoid processing discarded chunks in write_step_by_step.
  It fixes not to raise pile of IOError when many chunk bytes limit exceeds errors are occurred.
• #4334 in_tail: Fix tail watchers in rotate_wait state not being managed.

Misc

• #4331 buffer: Avoid unnecessary log processing. It will improve performance.

Contributors to this release (Alphabetical order)

• Christian Norbert Menges
• Daijiro Fukuda
• Kentaro Hayashi
• Takuro Ashie

Fluentd v1.16.3

Bug Fix

• #4327 in_tail: Fix a stall bug on !follow_inode case
• #4339 in_tail: add warning for silent stop on !follow_inodes case
• #4303 Buffer: Fix NoMethodError with empty unstaged chunk arrays
• #4311 Fix for rotate_age where Fluentd passes as Symbol

Contributors to this release (Alphabetical order)

• amdoolittl
• Daijiro Fukuda
• mrudrego
• Takuro Ashie

Fluentd v1.16.2

Bug Fix

• #4208 in_tail: Fix new watcher is wrongly detached on rotation when follow_inodes, which causes stopping tailing the file
• #4237 in_tail: Prevent wrongly unwatching when follow_inodes, which causes log duplication
• #4214 in_tail: Fix warning log about overwriting entry when follow_inodes
• #4239 in_tail: Ensure to discard TailWatcher with missing target when follow_inodes
• #4178 MessagePackFactory: Make sure to reset local unpacker to prevent received broken data from affecting other receiving data
• #4188 Fix failure to launch Fluentd on Windows when the log path isn't specified in the command line
• #4229 logger: Prevent growing cache size of ignore_same_log_interval unlimitedly
• #4225 Update sigdump to 0.2.5 to fix wrong value of object counts

Misc

• #4191 in_tail: Check detaching inode when follow_inodes
• #4228 in_tail: Add debug log for pos file compaction
• #4201 #4210 Code improvements detected by RuboCop Performance
• #4159 Add notice for unused argument unpacker of ChunkMessagePackEventStreamer.each

Contributors to this release (Alphabetical order)

• Christian Menges
• Daijiro Fukuda
• Gary Zhu
• Katuya Kawakami
• Masaki Hatada
• Takuro Ashie

Fluentd v1.16.1

Enhancement

• #4137 in_tcp: Add message_length_limit to drop large incoming data

Bug Fix

• #4124 Fix NameError of SecondaryFileOutput when setting secondary other than out_secondary_file
• #4131 Server helper: Suppress error of UDPServer over max_bytes on Windows
• #4147 Buffer: Fix that compress setting causes unexpected error when receiving already compressed MessagePack

Misc

• #4119 Update MAINTAINERS.md
• #4123 Update security policy
• #4128 Plugin template: Remove unnecessary code
• #4116 Revive issue auto closer
• #4145 Fix a link for the repository of td-agent
• #4117 in_udp: add test of message_length_limit
• #4148 Fix a typo of an argument of Fluent::EventStream#each
• #4138 Test in_tcp: Fix undesirable way to assert logs

Contributors to this release (Alphabetical order)

• Daijiro Fukuda
• Takuro Ashie