Full Changelog: v1.17.1...v1.18.0

Enhancement

• #4624 Add zero-downtime-restart feature for non-Windows
• #4661 Add with-source-only feature
  • fluentd command: Add --with-source-only option
  • System configuration: Add with_source_only option
• #4661 Embedded plugin: Add out_buffer plugin, which can be used for buffering and relabeling events
• #4580 Config File Syntax: Extend Embedded Ruby Code support for Hashes and Arrays
  • Example: key {"foo":"#{1 + 1}"} => key {"foo":"2"}
  • Please note that this is not backward compatible, although we assume that this will never affect to actual existing configs.
  • In case the behavior changes unintentionally, you can disable this feature by surrounding the entire value with single quotes.
    • key '{"foo":"#{1 + 1}"}' => key {"foo":"#{1 + 1}"}
• #4718 transport tls: Use SSL_VERIFY_NONE by default
• #4720 transport tls: Add ensure_fips option to ensure FIPS compliant mode
• #4649 plugin_helper/server: Add receive_buffer_size parameter in transport section
• #4620 filter_parser: Now able to handle multiple parsed results
• #4655 in_http: add add_tag_prefix option
• #4604 System configuration: add path option in log section

Bug Fix

• #4716 command: fix NoMethodError of --daemon under Windows
• #4605 fluentd command: fix --plugin (-p) option not to overwrite default value

Misc

• #4619 http_server: Ready to support Async 2.0 gem
• #4641 Minor code refactoring
• #4638 #4644 #4675 #4676 #4677 #4686 CI fixes

Contributors to this release (Alphabetical order)

• Athish Pranav D
• Daijiro Fukuda
• Kentaro Hayashi
• Takuro Ashie
• Watson

Full Changelog: v1.16.5...v1.16.6

Bug Fix

• YAML config syntax: Fix issue where $log_level element was not supported correctly
  #4486
• parser_json: Fix wrong LoadError warning
  #4592
• fluentd command: Fix --plugin (-p) option not to overwrite default value
  #4605

Misc

• out_file: Add warn message for symlink_path setting
  #4512
• Keep console gem v1.23 to avoid LoadError
  #4510

Full Changelog: v1.17.0...v1.17.1

Enhancement

• #4528 out_http: Add compress gzip option
• #4533 in_exec: Add encoding option to handle non-ascii characters
• #4578 in_tail: Add throttling metrics
• #4588 compat: Improve method call performance
• #4586 in_sample: Add reuse_record parameter to reuse the sample data
  • in_sample has changed to copy sample data by default to avoid the impact of destructive changes by subsequent plugins.
  • This increases the load when generating large amounts of sample data.
  • You can use this new parameter to have the same performance as before.

Bug Fix

• #4492 logger: Fix LoadError with console gem v1.25
• #4522 parser_json: Fix wrong LoadError warning
• #4530 in_tail: Fix an issue where a large single line could consume a large amount of memory even though max_line_size is set
• #4482 yaml_parser: Support $log_level element

Misc

• #4523 Comment out inappropriate default configuration about out_forward
• #4534 gemspec: Remove unnecessary files from released gem
• #4535 plugin-generator: Update gemspec to remove unnecessary files
• #4594 Suppress non-parenthesis warnings
• #4598 Fix FrozenError in http_server plugin helper
• #4589 Add logger gem dependency for Ruby 3.5
• #4502 out_file: Add warn message for symlink_path setting

Contributors to this release (Alphabetical order)

• Athish Pranav
• Daijiro Fukuda
• Harshita Sao
• Hiroshi Hatake
• Kentaro Hayashi
• Lewis Rockliffe
• Shingo Nakayama
• Taeseong Yu
• Takuro Ashie
• Watson

Full Changelog: v1.16.2...v1.17.0

Enhancement

• #4282 in_http: Recognize CSP reports as JSON data
• #4330 out_http: Add option to reuse connections
• #4401 in_tail: Expand glob capability for square brackets and one character matcher
• #4459 out_http: Support AWS Signature Version 4 authentication

Bug Fix

• #4474 Make sure parser_json and parser_msgpack return Hash.
  Make parser_json and parser_msgpack accept only Hash or Array of Hash.
• #4478 filter_parser: Add error event for multiple parsed results

Misc

• #4288 Raise minimum required ruby version
• #4411 Require missing dependent gems as of Ruby 3.4-dev
• #4294 #4299 #4302 #4320 Minor code refactoring
• #4369 #4433 #4452 #4477 CI fixes
• #4429 github: unify YAML file extension to .yml

Contributors to this release (Alphabetical order)

• Christian Norbert Menges
• Daijiro Fukuda
• David Venable
• Giedrius Statkevičius
• Hiroshi Hatake
• Kentaro Hayashi
• Šimon Lukašík
• Takuro Ashie

Full Changelog: v1.16.4...v1.16.5

Bug Fix

• #4447 Buffer: Fix emit error of v1.16.4 sometimes failing to process large data exceeding chunk size limit

Contributors to this release (Alphabetical order)

• Daijiro Fukuda
• Luke Arntz (Reporting #4447 problem. Thanks!)

Full Changelog: v1.16.3...v1.16.4

Bug Fix

• #4342 Fix to avoid processing discarded chunks in write_step_by_step.
  It fixes not to raise pile of IOError when many chunk bytes limit exceeds errors are occurred.
• #4334 in_tail: Fix tail watchers in rotate_wait state not being managed.

Misc

• #4331 buffer: Avoid unnecessary log processing. It will improve performance.

Contributors to this release (Alphabetical order)

• Christian Norbert Menges
• Daijiro Fukuda
• Kentaro Hayashi
• Takuro Ashie

Bug Fix

• #4327 in_tail: Fix a stall bug on !follow_inode case
• #4339 in_tail: add warning for silent stop on !follow_inodes case
• #4303 Buffer: Fix NoMethodError with empty unstaged chunk arrays
• #4311 Fix for rotate_age where Fluentd passes as Symbol

Contributors to this release (Alphabetical order)

• amdoolittl
• Daijiro Fukuda
• mrudrego
• Takuro Ashie

Bug Fix

• #4208 in_tail: Fix new watcher is wrongly detached on rotation when follow_inodes, which causes stopping tailing the file
• #4237 in_tail: Prevent wrongly unwatching when follow_inodes, which causes log duplication
• #4214 in_tail: Fix warning log about overwriting entry when follow_inodes
• #4239 in_tail: Ensure to discard TailWatcher with missing target when follow_inodes
• #4178 MessagePackFactory: Make sure to reset local unpacker to prevent received broken data from affecting other receiving data
• #4188 Fix failure to launch Fluentd on Windows when the log path isn't specified in the command line
• #4229 logger: Prevent growing cache size of ignore_same_log_interval unlimitedly
• #4225 Update sigdump to 0.2.5 to fix wrong value of object counts

Misc

• #4191 in_tail: Check detaching inode when follow_inodes
• #4228 in_tail: Add debug log for pos file compaction
• #4201 #4210 Code improvements detected by RuboCop Performance
• #4159 Add notice for unused argument unpacker of ChunkMessagePackEventStreamer.each

Contributors to this release (Alphabetical order)

• Christian Menges
• Daijiro Fukuda
• Gary Zhu
• Katuya Kawakami
• Masaki Hatada
• Takuro Ashie

Enhancement

• #4137 in_tcp: Add message_length_limit to drop large incoming data

Bug Fix

• #4124 Fix NameError of SecondaryFileOutput when setting secondary other than out_secondary_file
• #4131 Server helper: Suppress error of UDPServer over max_bytes on Windows
• #4147 Buffer: Fix that compress setting causes unexpected error when receiving already compressed MessagePack

Misc

• #4119 Update MAINTAINERS.md
• #4123 Update security policy
• #4128 Plugin template: Remove unnecessary code
• #4116 Revive issue auto closer
• #4145 Fix a link for the repository of td-agent
• #4117 in_udp: add test of message_length_limit
• #4148 Fix a typo of an argument of Fluent::EventStream#each
• #4138 Test in_tcp: Fix undesirable way to assert logs

Contributors to this release (Alphabetical order)

• Daijiro Fukuda
• Takuro Ashie

Enhancement

• #3961 in_tcp: Add send_keepalive_packet option
• #4025 buffer: backup broken file chunk
• #4027 Add warning messages for restoring buffer with flush_at_shutdown true
• #4028 Add logs for time period of restored buffer possibly broken

Bug Fix

• #3987 http_server_helper: Fix format of log messages originating from Async gem
• #4034 #4043 Change to not generate a sigdump file after receiving a SIGTERM signal on non-Windows
• #4030 out_forward: fix error of ack handling conflict on stopping with require_ack_response enabled
• #4064 #4065 #4086 #4090 #4096 Fix problem that some system configs are not reflected
• #4091 Fix bug that the logger outputs some initial log messages without applying some settings such as format
• #4054 Windows: Fix a bug that the wrong log file is reopened with log rotate setting when flushing or graceful reloading
• #4081 Fix race condition of out_secondary_file
• #4087 Suppress warning using different secondary for out_secondary_file
• #4066 Fix value of system_config.workers at run_configure.
  Change argument type of Fluent::Plugin::Base::configure() to Fluent::Config::Element only.
• #4092 Fix bug that Fluentd sometimes tries to use an unavailable port and fails to start on Windows

Misc

• #3899 Add method for testing filtered_with_time
• #4040 Replace $$ with Process.pid
• #4061 Relax required webric gem version
• #3968 #3996 #3997 CI fixes to support Ruby 3.2
• #3969 #3990 #4013 #4033 #4044 #4050 #4062 #4074 #4082 #4085 Other CI fixes
• #4026 #4069 Update MAINTAINERS.md

Contributors to this release (Alphabetical order)

• abetomo
• Daijiro Fukuda
• Fujimoto Seiji
• I326463
• Kentaro Hayashi
• Takuro Ashie
• Toru Takahashi