Updated reload_connections set false by default in in_opensearch.rb by OlehPalanskyi · Pull Request #140 · fluent/fluent-plugin-opensearch

OlehPalanskyi · 2024-07-09T08:10:25Z

Hi i getting this error in input when set parameter reload_connections true.

2024-05-31 23:49:44 +0000 [error]: #0 [Faraday::ConnectionFailed] EOFError (EOFError){:id=>"GW1m2sPKhCIFjyBA", :name=>"server-004.local.host", :version=>"2.14.0", :host=>"10.23.42.24", :port=>"9200", :roles=>["data", "ingest"], :attributes=>{"zone"=>"zoneA", "temp"=>"hot", "shard_indexing_pressure_enabled"=>"true"}, :protocol=>"http", :user=>"test_user", :password=><REDACTED>}
2024-05-31 23:49:44 +0000 [warn]: #0 [Faraday::ConnectionFailed] Reloading connections (attempt 1 of 15)
2024-05-31 23:49:44 +0000 [error]: #0 [Faraday::ConnectionFailed] EOFError (EOFError) {:id=>"a4fAWUWvlfpq_mjNhg", :name=>"server-005.local.host", :version=>"2.14.0", :host=>"10.23.42.25", :port=>"9200", :roles=>["data", "ingest"], :attributes=>{"zone"=>"zoneB", "temp"=>"hot", "shard_indexing_pressure_enabled"=>"true"}, :protocol=>"http", :user=>"test_user", :password=><REDACTED>}
2024-05-31 23:49:44 +0000 [warn]: #0 failed to connect or search. retry_times=1 next_retry_time=2024-05-31 23:49:54 +0000 error="EOFError (EOFError)"
2024-05-31 23:49:54 +0000 [error]: #0 [Faraday::ConnectionFailed] EOFError (EOFError) {:id=>"OuVFdU5TM33F4zg", :name=>"server-026.local.host", :version=>"2.14.0", :host=>"10.23.42.34", :port=>"9200", :roles=>["ml"], :attributes=>{"zone"=>"zoneA", "shard_indexing_pressure_enabled"=>"true"}, :protocol=>"http", :user=>"test_user", :password=><REDACTED>}
2024-05-31 23:49:54 +0000 [warn]: #0 [Faraday::ConnectionFailed] Reloading connections (attempt 1 of 15)
2024-05-31 23:49:54 +0000 [error]: #0 [Faraday::ConnectionFailed] EOFError (EOFError) {:id=>"vscXqW6kZm94g3eQ", :name=>"server-011.local.host", :version=>"2.14.0", :host=>"10.23.42.32", :port=>"9200", :roles=>["data", "ingest"], :attributes=>{"zone"=>"zoneB", "temp"=>"warm", "shard_indexing_pressure_enabled"=>"true"}, :protocol=>"http", :user=>"test_user", :password=><REDACTED>}
2024-05-31 23:49:54 +0000 [warn]: #0 failed to connect or search. retry_times=2 next_retry_time=2024-05-31 23:50:04 +0000 error="EOFError (EOFError)"
2024-05-31 23:50:04 +0000 [error]: #0 [Faraday::ConnectionFailed] EOFError (EOFError) {:id=>"YV-qlybhxP71PuZXA", :name=>"server-006.local.host", :version=>"2.14.0", :host=>"10.23.42.26", :port=>"9200", :roles=>["data", "ingest"], :attributes=>{"zone"=>"zoneA", "temp"=>"warm", "shard_indexing_pressure_enabled"=>"true"}, :protocol=>"http", :user=>"test_user", :password=><REDACTED>}
2024-05-31 23:50:04 +0000 [warn]: #0 [Faraday::ConnectionFailed] Reloading connections (attempt 1 of 15)
2024-05-31 23:50:04 +0000 [error]: #0 [Faraday::ConnectionFailed] EOFError (EOFError) {:id=>"Cz9S2ORP9D8ty5jaw", :name=>"server-008.local.host", :version=>"2.14.0", :host=>"10.23.42.38", :port=>"9200", :roles=>["data", "ingest"], :attributes=>{"zone"=>"zoneA", "temp"=>"warm", "shard_indexing_pressure_enabled"=>"true"}, :protocol=>"http", :user=>"test_user", :password=><REDACTED>}
2024-05-31 23:50:04 +0000 [warn]: #0 failed to connect or search. retry_times=3 next_retry_time=2024-05-31 23:50:15 +0000 error="EOFError (EOFError)"
2024-05-31 23:50:14 +0000 [error]: #0 [Faraday::ConnectionFailed] EOFError (EOFError) {:id=>"OC4DnWJWj2phJPoSw", :name=>"server-029.local.host", :version=>"2.14.0", :host=>"10.23.42.29", :port=>"9200", :roles=>["cluster_manager"], :attributes=>{"shard_indexing_pressure_enabled"=>"true"}, :protocol=>"http", :user=>"test_user", :password=><REDACTED>}
2024-05-31 23:50:14 +0000 [warn]: #0 [Faraday::ConnectionFailed] Reloading connections (attempt 1 of 15)
2024-05-31 23:50:14 +0000 [error]: #0 [Faraday::ConnectionFailed] EOFError (EOFError) {:id=>"93Tq6rhuTEfuquGw", :name=>"server-002.local.host", :version=>"2.14.0", :host=>"10.23.42.22", :port=>"9200", :roles=>["data", "ingest"], :attributes=>{"zone"=>"zoneA", "temp"=>"hot", "shard_indexing_pressure_enabled"=>"true"}, :protocol=>"http", :user=>"test_user", :password=><REDACTED>}
2024-05-31 23:50:14 +0000 [warn]: #0 failed to connect or search. retry_times=4 next_retry_time=2024-05-31 23:50:25 +0000 error="EOFError (EOFError)"
2024-05-31 23:50:24 +0000 [error]: #0 [Faraday::ConnectionFailed] EOFError (EOFError) {:id=>"LvqjYJ-kdwkUIvEA", :name=>"server-003.local.host", :version=>"2.14.0", :host=>"10.23.42.23", :port=>"9200", :roles=>["data", "ingest"], :attributes=>{"zone"=>"zoneB", "temp"=>"hot", "shard_indexing_pressure_enabled"=>"true"}, :protocol=>"http", :user=>"test_user", :password=><REDACTED>}
2024-05-31 23:50:24 +0000 [warn]: #0 [Faraday::ConnectionFailed] Reloading connections (attempt 1 of 15)
2024-05-31 23:50:24 +0000 [error]: #0 [Faraday::ConnectionFailed] EOFError (EOFError) {:id=>"WVzQ44f4NBysOuA", :name=>"server-009.local.host", :version=>"2.14.0", :host=>"10.23.42.39", :port=>"9200", :roles=>["data", "ingest"], :attributes=>{"zone"=>"zoneB", "temp"=>"warm", "shard_indexing_pressure_enabled"=>"true"}, :protocol=>"http", :user=>"test_user", :password=><REDACTED>}
2024-05-31 23:50:24 +0000 [warn]: #0 failed to connect or search. retry_times=5 next_retry_time=2024-05-31 23:50:35 +0000 error="EOFError (EOFError)"
2024-05-31 23:50:35 +0000 [error]: #0 [Faraday::ConnectionFailed] EOFError (EOFError) {:id=>"GDjAmQlqkKwDGcWA", :name=>"server-027.local.host", :version=>"2.14.0", :host=>"10.23.42.27", :port=>"9200", :roles=>["cluster_manager"], :attributes=>{"shard_indexing_pressure_enabled"=>"true"}, :protocol=>"http", :user=>"test_user", :password=><REDACTED>}
2024-05-31 23:50:35 +0000 [warn]: #0 [Faraday::ConnectionFailed] Reloading connections (attempt 1 of 15)
2024-05-31 23:50:35 +0000 [error]: #0 [Faraday::ConnectionFailed] EOFError (EOFError) {:id=>"-lyPzKZwfw3Ly2uiQ", :name=>"server-010.local.host", :version=>"2.14.0", :host=>"10.23.42.31", :port=>"9200", :roles=>["data", "ingest"], :attributes=>{"zone"=>"zoneA", "temp"=>"warm", "shard_indexing_pressure_enabled"=>"true"}, :protocol=>"http", :user=>"test_user", :password=><REDACTED>}
2024-05-31 23:50:35 +0000 [warn]: #0 failed to connect or search. retry_times=6 next_retry_time=2024-05-31 23:50:45 +0000 error="EOFError (EOFError)"
2024-05-31 23:50:45 +0000 [error]: #0 [Faraday::ConnectionFailed] EOFError (EOFError) {:id=>"hSRj6ZpeT7CY8OfQ", :name=>"server-028.local.host", :version=>"2.14.0", :host=>"10.23.42.28", :port=>"9200", :roles=>["cluster_manager"], :attributes=>{"shard_indexing_pressure_enabled"=>"true"}, :protocol=>"http", :user=>"test_user", :password=><REDACTED>}
2024-05-31 23:50:45 +0000 [warn]: #0 [Faraday::ConnectionFailed] Reloading connections (attempt 1 of 15)
2024-05-31 23:50:45 +0000 [error]: #0 [Faraday::ConnectionFailed] EOFError (EOFError) {:id=>"aTlvKHkswC2dRc4Q", :name=>"server-025.local.host", :version=>"2.14.0", :host=>"10.23.42.33", :port=>"9200", :roles=>["ml"], :attributes=>{"zone"=>"zoneB", "shard_indexing_pressure_enabled"=>"true"}, :protocol=>"http", :user=>"test_user", :password=><REDACTED>}
2024-05-31 23:50:45 +0000 [warn]: #0 failed to connect or search. retry_times=7 next_retry_time=2024-05-31 23:50:55 +0000 error="EOFError (EOFError)"
2024-05-31 23:50:55 +0000 [error]: #0 [Faraday::ConnectionFailed] EOFError (EOFError) {:id=>"W3UbOaA6QK-02rO0D20NdQ", :name=>"server-007.local.host", :version=>"2.14.0", :host=>"10.23.42.37", :port=>"9200", :roles=>["data", "ingest"], :attributes=>{"zone"=>"zoneB", "temp"=>"warm", "shard_indexing_pressure_enabled"=>"true"}, :protocol=>"http", :user=>"test_user", :password=><REDACTED>}
2024-05-31 23:50:55 +0000 [warn]: #0 [Faraday::ConnectionFailed] Reloading connections (attempt 1 of 15)
2024-05-31 23:50:55 +0000 [error]: #0 [Faraday::ConnectionFailed] EOFError (EOFError) {:id=>"93Tq6rhuTEfuquGw", :name=>"server-002.local.host", :version=>"2.14.0", :host=>"10.23.42.22", :port=>"9200", :roles=>["data", "ingest"], :attributes=>{"zone"=>"zoneA", "temp"=>"hot", "shard_indexing_pressure_enabled"=>"true"}, :protocol=>"http", :user=>"test_user", :password=><REDACTED>}
2024-05-31 23:50:55 +0000 [warn]: #0 failed to connect or search. retry_times=8 next_retry_time=2024-05-31 23:51:05 +0000 error="EOFError (EOFError)"
2024-05-31 23:51:05 +0000 [error]: #0 [Faraday::ConnectionFailed] EOFError (EOFError) {:id=>"GW1m2sPKhCIFjyBA", :name=>"server-004.local.host", :version=>"2.14.0", :host=>"10.23.42.24", :port=>"9200", :roles=>["data", "ingest"], :attributes=>{"zone"=>"zoneA", "temp"=>"hot", "shard_indexing_pressure_enabled"=>"true"}, :protocol=>"http", :user=>"test_user", :password=><REDACTED>}
2024-05-31 23:51:05 +0000 [warn]: #0 [Faraday::ConnectionFailed] Reloading connections (attempt 1 of 15)
2024-05-31 23:51:05 +0000 [error]: #0 [Faraday::ConnectionFailed] EOFError (EOFError) {:id=>"-lyPzKZwfw3Ly2uiQ", :name=>"server-010.local.host", :version=>"2.14.0", :host=>"10.23.42.31", :port=>"9200", :roles=>["data", "ingest"], :attributes=>{"zone"=>"zoneA", "temp"=>"warm", "shard_indexing_pressure_enabled"=>"true"}, :protocol=>"http", :user=>"test_user", :password=><REDACTED>}
2024-05-31 23:51:05 +0000 [warn]: #0 failed to connect or search. retry_times=9 next_retry_time=2024-05-31 23:51:16 +0000 error="EOFError (EOFError)"
2024-05-31 23:51:15 +0000 [error]: #0 [Faraday::ConnectionFailed] EOFError (EOFError) {:id=>"a4fAWUWvlfpq_mjNhg", :name=>"server-005.local.host", :version=>"2.14.0", :host=>"10.23.42.25", :port=>"9200", :roles=>["data", "ingest"], :attributes=>{"zone"=>"zoneB", "temp"=>"hot", "shard_indexing_pressure_enabled"=>"true"}, :protocol=>"http", :user=>"test_user", :password=><REDACTED>}
2024-05-31 23:51:15 +0000 [warn]: #0 [Faraday::ConnectionFailed] Reloading connections (attempt 1 of 15)
2024-05-31 23:51:15 +0000 [error]: #0 [Faraday::ConnectionFailed] EOFError (EOFError) {:id=>"LvqjYJ-kdwkUIvEA", :name=>"server-003.local.host", :version=>"2.14.0", :host=>"10.23.42.23", :port=>"9200", :roles=>["data", "ingest"], :attributes=>{"zone"=>"zoneB", "temp"=>"hot", "shard_indexing_pressure_enabled"=>"true"}, :protocol=>"http", :user=>"test_user", :password=><REDACTED>}
2024-05-31 23:51:15 +0000 [warn]: #0 failed to connect or search. retry_times=10 next_retry_time=2024-05-31 23:51:26 +0000 error="EOFError (EOFError)"
2024-05-31 23:51:25 +0000 [error]: #0 [Faraday::ConnectionFailed] EOFError (EOFError) {:id=>"OuVFdU5TM33F4zg", :name=>"server-026.local.host", :version=>"2.14.0", :host=>"10.23.42.34", :port=>"9200", :roles=>["ml"], :attributes=>{"zone"=>"zoneA", "shard_indexing_pressure_enabled"=>"true"}, :protocol=>"http", :user=>"test_user", :password=><REDACTED>}
2024-05-31 23:51:25 +0000 [warn]: #0 [Faraday::ConnectionFailed] Reloading connections (attempt 1 of 15)
2024-05-31 23:51:25 +0000 [error]: #0 [Faraday::ConnectionFailed] EOFError (EOFError) {:id=>"aTlvKHkswC2dRc4Q", :name=>"server-025.local.host", :version=>"2.14.0", :host=>"10.23.42.33", :port=>"9200", :roles=>["ml"], :attributes=>{"zone"=>"zoneB", "shard_indexing_pressure_enabled"=>"true"}, :protocol=>"http", :user=>"test_user", :password=><REDACTED>}
2024-05-31 23:51:25 +0000 [warn]: #0 failed to connect or search. retry_times=11 next_retry_time=2024-05-31 23:51:36 +0000 error="EOFError (EOFError)"
2024-05-31 23:51:36 +0000 [error]: #0 [Faraday::ConnectionFailed] EOFError (EOFError) {:id=>"vscXqW6kZm94g3eQ", :name=>"server-011.local.host", :version=>"2.14.0", :host=>"10.23.42.32", :port=>"9200", :roles=>["data", "ingest"], :attributes=>{"zone"=>"zoneB", "temp"=>"warm", "shard_indexing_pressure_enabled"=>"true"}, :protocol=>"http", :user=>"test_user", :password=><REDACTED>}
2024-05-31 23:51:36 +0000 [warn]: #0 [Faraday::ConnectionFailed] Reloading connections (attempt 1 of 15)
2024-05-31 23:51:36 +0000 [error]: #0 [Faraday::ConnectionFailed] EOFError (EOFError) {:id=>"WVzQ44f4NBysOuA", :name=>"server-009.local.host", :version=>"2.14.0", :host=>"10.23.42.39", :port=>"9200", :roles=>["data", "ingest"], :attributes=>{"zone"=>"zoneB", "temp"=>"warm", "shard_indexing_pressure_enabled"=>"true"}, :protocol=>"http", :user=>"test_user", :password=><REDACTED>}
2024-05-31 23:51:36 +0000 [warn]: #0 failed to connect or search. retry_times=12 next_retry_time=2024-05-31 23:51:46 +0000 error="EOFError (EOFError)"
2024-05-31 23:51:46 +0000 [error]: #0 [Faraday::ConnectionFailed] EOFError (EOFError) {:id=>"YV-qlybhxP71PuZXA", :name=>"server-006.local.host", :version=>"2.14.0", :host=>"10.23.42.26", :port=>"9200", :roles=>["data", "ingest"], :attributes=>{"zone"=>"zoneA", "temp"=>"warm", "shard_indexing_pressure_enabled"=>"true"}, :protocol=>"http", :user=>"test_user", :password=><REDACTED>}
2024-05-31 23:51:46 +0000 [warn]: #0 [Faraday::ConnectionFailed] Reloading connections (attempt 1 of 15)
2024-05-31 23:51:46 +0000 [error]: #0 [Faraday::ConnectionFailed] EOFError (EOFError) {:id=>"hSRj6ZpeT7CY8OfQ", :name=>"server-028.local.host", :version=>"2.14.0", :host=>"10.23.42.28", :port=>"9200", :roles=>["cluster_manager"], :attributes=>{"shard_indexing_pressure_enabled"=>"true"}, :protocol=>"http", :user=>"test_user", :password=><REDACTED>}
2024-05-31 23:51:46 +0000 [warn]: #0 failed to connect or search. retry_times=13 next_retry_time=2024-05-31 23:51:56 +0000 error="EOFError (EOFError)"
2024-05-31 23:51:56 +0000 [error]: #0 [Faraday::ConnectionFailed] EOFError (EOFError) {:id=>"Cz9S2ORP9D8ty5jaw", :name=>"server-008.local.host", :version=>"2.14.0", :host=>"10.23.42.38", :port=>"9200", :roles=>["data", "ingest"], :attributes=>{"zone"=>"zoneA", "temp"=>"warm", "shard_indexing_pressure_enabled"=>"true"}, :protocol=>"http", :user=>"test_user", :password=><REDACTED>}
2024-05-31 23:51:56 +0000 [warn]: #0 [Faraday::ConnectionFailed] Reloading connections (attempt 1 of 15)
2024-05-31 23:51:56 +0000 [error]: #0 [Faraday::ConnectionFailed] EOFError (EOFError) {:id=>"GDjAmQlqkKwDGcWA", :name=>"server-027.local.host", :version=>"2.14.0", :host=>"10.23.42.27", :port=>"9200", :roles=>["cluster_manager"], :attributes=>{"shard_indexing_pressure_enabled"=>"true"}, :protocol=>"http", :user=>"test_user", :password=><REDACTED>}
2024-05-31 23:51:56 +0000 [warn]: #0 failed to connect or search. retry_times=14 next_retry_time=2024-05-31 23:52:06 +0000 error="EOFError (EOFError)"
2024-05-31 23:52:06 +0000 [error]: #0 [Faraday::ConnectionFailed] EOFError (EOFError) {:id=>"OC4DnWJWj2phJPoSw", :name=>"server-029.local.host", :version=>"2.14.0", :host=>"10.23.42.29", :port=>"9200", :roles=>["cluster_manager"], :attributes=>{"shard_indexing_pressure_enabled"=>"true"}, :protocol=>"http", :user=>"test_user", :password=><REDACTED>}
2024-05-31 23:52:06 +0000 [warn]: #0 [Faraday::ConnectionFailed] Reloading connections (attempt 1 of 15)
2024-05-31 23:52:06 +0000 [error]: #0 [Faraday::ConnectionFailed] EOFError (EOFError) {:id=>"W3UbOaA6QK-02rO0D20NdQ", :name=>"server-007.local.host", :version=>"2.14.0", :host=>"10.23.42.37", :port=>"9200", :roles=>["data", "ingest"], :attributes=>{"zone"=>"zoneB", "temp"=>"warm", "shard_indexing_pressure_enabled"=>"true"}, :protocol=>"http", :user=>"test_user", :password=><REDACTED>}
2024-05-31 23:52:06 +0000 [warn]: #0 failed to connect or search. retry_times=15 next_retry_time=2024-05-31 23:52:17 +0000 error="EOFError (EOFError)"
2024-05-31 23:52:16 +0000 [error]: #0 [Faraday::ConnectionFailed] EOFError (EOFError) {:id=>"93Tq6rhuTEfuquGw", :name=>"server-002.local.host", :version=>"2.14.0", :host=>"10.23.42.22", :port=>"9200", :roles=>["data", "ingest"], :attributes=>{"zone"=>"zoneA", "temp"=>"hot", "shard_indexing_pressure_enabled"=>"true"}, :protocol=>"http", :user=>"test_user", :password=><REDACTED>}
2024-05-31 23:52:16 +0000 [warn]: #0 [Faraday::ConnectionFailed] Reloading connections (attempt 1 of 15)
2024-05-31 23:52:16 +0000 [error]: #0 [Faraday::ConnectionFailed] EOFError (EOFError) {:id=>"GW1m2sPKhCIFjyBA", :name=>"server-004.local.host", :version=>"2.14.0", :host=>"10.23.42.24", :port=>"9200", :roles=>["data", "ingest"], :attributes=>{"zone"=>"zoneA", "temp"=>"hot", "shard_indexing_pressure_enabled"=>"true"}, :protocol=>"http", :user=>"test_user", :password=><REDACTED>}
2024-05-31 23:52:16 +0000 [warn]: #0 failed to connect or search. retry_times=16 next_retry_time=2024-05-31 23:52:27 +0000 error="EOFError (EOFError)"
2024-05-31 23:52:26 +0000 [error]: #0 [Faraday::ConnectionFailed] EOFError (EOFError) {:id=>"-lyPzKZwfw3Ly2uiQ", :name=>"server-010.local.host", :version=>"2.14.0", :host=>"10.23.42.31", :port=>"9200", :roles=>["data", "ingest"], :attributes=>{"zone"=>"zoneA", "temp"=>"warm", "shard_indexing_pressure_enabled"=>"true"}, :protocol=>"http", :user=>"test_user", :password=><REDACTED>}
2024-05-31 23:52:26 +0000 [warn]: #0 [Faraday::ConnectionFailed] Reloading connections (attempt 1 of 15)
2024-05-31 23:52:26 +0000 [error]: #0 [Faraday::ConnectionFailed] EOFError (EOFError) {:id=>"a4fAWUWvlfpq_mjNhg", :name=>"server-005.local.host", :version=>"2.14.0", :host=>"10.23.42.25", :port=>"9200", :roles=>["data", "ingest"], :attributes=>{"zone"=>"zoneB", "temp"=>"hot", "shard_indexing_pressure_enabled"=>"true"}, :protocol=>"http", :user=>"test_user", :password=><REDACTED>}
2024-05-31 23:52:26 +0000 [warn]: #0 failed to connect or search. retry_times=17 next_retry_time=2024-05-31 23:52:37 +0000 error="EOFError (EOFError)"
2024-05-31 23:52:37 +0000 [error]: #0 [Faraday::ConnectionFailed] EOFError (EOFError) {:id=>"LvqjYJ-kdwkUIvEA", :name=>"server-003.local.host", :version=>"2.14.0", :host=>"10.23.42.23", :port=>"9200", :roles=>["data", "ingest"], :attributes=>{"zone"=>"zoneB", "temp"=>"hot", "shard_indexing_pressure_enabled"=>"true"}, :protocol=>"http", :user=>"test_user", :password=><REDACTED>}
2024-05-31 23:52:37 +0000 [warn]: #0 [Faraday::ConnectionFailed] Reloading connections (attempt 1 of 15)
2024-05-31 23:52:37 +0000 [error]: #0 [Faraday::ConnectionFailed] EOFError (EOFError) {:id=>"OuVFdU5TM33F4zg", :name=>"server-026.local.host", :version=>"2.14.0", :host=>"10.23.42.34", :port=>"9200", :roles=>["ml"], :attributes=>{"zone"=>"zoneA", "shard_indexing_pressure_enabled"=>"true"}, :protocol=>"http", :user=>"test_user", :password=><REDACTED>}
2024-05-31 23:52:37 +0000 [warn]: #0 failed to connect or search. retry_times=18 next_retry_time=2024-05-31 23:52:47 +0000 error="EOFError (EOFError)"
2024-05-31 23:52:47 +0000 [error]: #0 [Faraday::ConnectionFailed] EOFError (EOFError) {:id=>"aTlvKHkswC2dRc4Q", :name=>"server-025.local.host", :version=>"2.14.0", :host=>"10.23.42.33", :port=>"9200", :roles=>["ml"], :attributes=>{"zone"=>"zoneB", "shard_indexing_pressure_enabled"=>"true"}, :protocol=>"http", :user=>"test_user", :password=><REDACTED>}
2024-05-31 23:52:47 +0000 [warn]: #0 [Faraday::ConnectionFailed] Reloading connections (attempt 1 of 15)
2024-05-31 23:52:47 +0000 [error]: #0 [Faraday::ConnectionFailed] EOFError (EOFError) {:id=>"vscXqW6kZm94g3eQ", :name=>"server-011.local.host", :version=>"2.14.0", :host=>"10.23.42.32", :port=>"9200", :roles=>["data", "ingest"], :attributes=>{"zone"=>"zoneB", "temp"=>"warm", "shard_indexing_pressure_enabled"=>"true"}, :protocol=>"http", :user=>"test_user", :password=><REDACTED>}
2024-05-31 23:52:47 +0000 [warn]: #0 failed to connect or search. retry_times=19 next_retry_time=2024-05-31 23:52:57 +0000 error="EOFError (EOFError)"
2024-05-31 23:52:57 +0000 [error]: #0 [Faraday::ConnectionFailed] EOFError (EOFError) {:id=>"WVzQ44f4NBysOuA", :name=>"server-009.local.host", :version=>"2.14.0", :host=>"10.23.42.39", :port=>"9200", :roles=>["data", "ingest"], :attributes=>{"zone"=>"zoneB", "temp"=>"warm", "shard_indexing_pressure_enabled"=>"true"}, :protocol=>"http", :user=>"test_user", :password=><REDACTED>}
2024-05-31 23:52:57 +0000 [warn]: #0 [Faraday::ConnectionFailed] Reloading connections (attempt 1 of 15)
2024-05-31 23:52:57 +0000 [error]: #0 [Faraday::ConnectionFailed] EOFError (EOFError) {:id=>"YV-qlybhxP71PuZXA", :name=>"server-006.local.host", :version=>"2.14.0", :host=>"10.23.42.26", :port=>"9200", :roles=>["data", "ingest"], :attributes=>{"zone"=>"zoneA", "temp"=>"warm", "shard_indexing_pressure_enabled"=>"true"}, :protocol=>"http", :user=>"test_user", :password=><REDACTED>}
2024-05-31 23:52:57 +0000 [error]: #0 Hit limit for retries. retry_times: 20, EOFError (EOFError)

But I found if we set parameter reload_connections false we stop getting this error.
This way I set this parameter reload_connections false by default in code.

Signed-off-by: Oleh <o.palanskyi@socprime.com>

Signed-off-by: OlehPalanskyi <Trahterber@gmail.com> Signed-off-by: Oleh <o.palanskyi@socprime.com>

cosmo0920 · 2024-08-29T11:32:46Z

lib/fluent/plugin/in_opensearch.rb

        user: host[:user],
        password: host[:password],
-        reload_connections: @reload_connections,
+        # reload_connections: @reload_connections,


Hey, could you describe why this line is commented out?
Would you mind if you revive this line?

cosmo0920 · 2024-08-29T11:33:34Z

lib/fluent/plugin/in_opensearch.rb

        @retry.step
+        if error.message.include?('EOFError (EOFError)')
+          log.error("Restart plugin because hit error #{error.message}")
+          exit(1)


exit(1) caused entire termination. This is brutal manner for handling this exception. :(

added Faraday::TimeoutError in retry function

Refactor retry logic

daipom · 2025-04-09T01:43:54Z

@OlehPalanskyi Thanks for this improvement!

This way I set this parameter reload_connections false by default in code.

It appears that some diffs are not related to this.
Could you please separate PR or explain the purpose of each diff?

OlehPalanskyi force-pushed the main branch from 581083f to c0fd2c0 Compare July 9, 2024 08:16

OlehPalanskyi added 3 commits July 9, 2024 11:21

Updated retry stage and change parameter reload_connections set false

0927d62

Signed-off-by: Oleh <o.palanskyi@socprime.com>

updated login message when get error EOFError (EOFError)

c316df6

Signed-off-by: OlehPalanskyi <Trahterber@gmail.com> Signed-off-by: Oleh <o.palanskyi@socprime.com>

Updated reload_connections set false by default in in_opensearch.rb

982356e

Signed-off-by: OlehPalanskyi <Trahterber@gmail.com> Signed-off-by: Oleh <o.palanskyi@socprime.com>

OlehPalanskyi force-pushed the main branch from c0fd2c0 to 982356e Compare July 9, 2024 08:21

cosmo0920 requested changes Aug 29, 2024

View reviewed changes

OlehPalanskyi added 6 commits October 2, 2024 10:55

Merge branch 'fluent:main' into main

0c7bc0d

Merge branch 'fluent:main' into main

0512d34

Merge branch 'fluent:main' into main

7ab6490

Update in_opensearch.rb

c880aba

added Faraday::TimeoutError in retry function

Merge branch 'fluent:main' into main

e79f873

Update in_opensearch.rb

d94c83a

Refactor retry logic

Merge branch 'fluent:main' into main

4b10ba7

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Updated reload_connections set false by default in in_opensearch.rb#140

Updated reload_connections set false by default in in_opensearch.rb#140
OlehPalanskyi wants to merge 10 commits intofluent:mainfrom
OlehPalanskyi:main

OlehPalanskyi commented Jul 9, 2024 •

edited by daipom

Loading

Uh oh!

cosmo0920 Aug 29, 2024

Uh oh!

cosmo0920 Aug 29, 2024

Uh oh!

daipom commented Apr 9, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

Conversation

OlehPalanskyi commented Jul 9, 2024 • edited by daipom Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

cosmo0920 Aug 29, 2024

Choose a reason for hiding this comment

Uh oh!

cosmo0920 Aug 29, 2024

Choose a reason for hiding this comment

Uh oh!

daipom commented Apr 9, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

OlehPalanskyi commented Jul 9, 2024 •

edited by daipom

Loading