Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
63 commits
Select commit Hold shift + click to select a range
dad00d0
feat(connectors): implement Redshift Sink Connector with S3 staging
GaneshPatil7517 Jan 13, 2026
c60cccd
fix: resolve CI failures for redshift sink connector
GaneshPatil7517 Jan 13, 2026
8cc7748
fix: correct alphabetical ordering of rust-s3 in DEPENDENCIES.md
GaneshPatil7517 Jan 14, 2026
efae2b0
Merge branch 'master' into feature/redshift-sink-connector
GaneshPatil7517 Jan 14, 2026
043470d
feat(connectors): add integration e2e test for Redshift sink connector
GaneshPatil7517 Jan 14, 2026
5671347
Merge branch 'master' into feature/redshift-sink-connector
GaneshPatil7517 Jan 14, 2026
ffce03c
Merge branch 'master' into feature/redshift-sink-connector
GaneshPatil7517 Jan 14, 2026
db76d46
fix: add missing s3_endpoint field and update DEPENDENCIES.md
GaneshPatil7517 Jan 15, 2026
5e17c19
fix: address Copilot review feedback
GaneshPatil7517 Jan 15, 2026
1e9e9c7
fix(integration): add #[allow(dead_code)] to RedshiftTestSetup struct
GaneshPatil7517 Jan 15, 2026
04c299b
Merge branch 'master' into feature/redshift-sink-connector
GaneshPatil7517 Jan 15, 2026
0a49fba
Update core/connectors/sinks/redshift_sink/src/lib.rs
GaneshPatil7517 Jan 16, 2026
3a18911
Merge branch 'master' into feature/redshift-sink-connector
hubcio Jan 16, 2026
a3d15ff
Merge upstream/master into feature/redshift-sink-connector
GaneshPatil7517 Jan 31, 2026
898b58d
chore: update DEPENDENCIES.md and Cargo.lock after merge
GaneshPatil7517 Jan 31, 2026
67bae8a
fix: add trailing newline and comma to DEPENDENCIES.md
GaneshPatil7517 Jan 31, 2026
8faa335
fix: correct environment variable naming in redshift integration tests
GaneshPatil7517 Jan 31, 2026
6ba9297
Merge remote-tracking branch 'ganesh/feature/redshift-sink-connector'…
ryerraguntla Apr 1, 2026
afa6dc7
Initial version merging with iggy master with earlier Redshift S3 eff…
ryerraguntla Apr 1, 2026
b96c29b
Add shared influxdb_common crate and adapters for V2 and V3 versions.
ryerraguntla Apr 13, 2026
23e397d
Refactor InfluxDB sink to support v2/v3
ryerraguntla Apr 14, 2026
6d79aab
Remove test-connectors.sh script
ryerraguntla Apr 14, 2026
4a482f5
Use influxdb_common and refactor sink/source
ryerraguntla Apr 14, 2026
cff220c
Trim trailing slash in health URLs
ryerraguntla Apr 15, 2026
66bc9d2
influxdb_common: stricter validation and fixes
ryerraguntla Apr 17, 2026
db07c8a
influxdb: validate time/org, CB fixes, tests
ryerraguntla Apr 17, 2026
ff7e5aa
InfluxDB: header detection, atomics, cursor error
ryerraguntla Apr 17, 2026
d5d697d
Remove influxdb_common crate and inline code
ryerraguntla Apr 18, 2026
76b4c23
InfluxDB: default config version & v3 improvements
ryerraguntla Apr 18, 2026
5e77d13
Refactor InfluxDB connectors and config handling
ryerraguntla Apr 18, 2026
addf81c
Remove Redshift sink connector and tests
ryerraguntla Apr 19, 2026
096d071
influxdb: add simd-json parsing and config checks
ryerraguntla Apr 19, 2026
13bcecb
Merge remote-tracking branch 'apache/master' into feat/influxdb_v2_v3…
ryerraguntla Apr 19, 2026
b34be87
Refactor InfluxDB source, fixtures and Cargo.lock
ryerraguntla Apr 19, 2026
575de71
Docs: fix formatting, typos, and duplicate dep
ryerraguntla Apr 19, 2026
899f275
Mark code fence as text and fix table header
ryerraguntla Apr 19, 2026
662f35c
Normalize TOML spacing in InfluxDB test configs
ryerraguntla Apr 19, 2026
933651e
InfluxDB connectors: timestamps, auth, parsing
ryerraguntla Apr 26, 2026
00565d6
Normalize InfluxDB v3 timestamps and tweak test
ryerraguntla Apr 26, 2026
6cad572
Fix typo in test comment
ryerraguntla Apr 26, 2026
5b5a05c
Preserve nanosecond precision for V3 timestamps
ryerraguntla Apr 26, 2026
22e2975
Update v3.rs
ryerraguntla Apr 26, 2026
d3dc875
Merge branch 'master' into feat/influxdb_v2_v3_connector
hubcio May 4, 2026
8737c0e
Merge branch 'master' into feat/influxdb_v2_v3_connector
ryerraguntla May 4, 2026
c4659f0
Add lz4_flex 0.13.0 to Cargo.lock
ryerraguntla May 4, 2026
643446b
Bump lz4_flex to 0.13.0 in DEPENDENCIES.md
ryerraguntla May 4, 2026
5f7bc21
Merge branch 'master' into feat/influxdb_v2_v3_connector
hubcio May 5, 2026
8621d49
Merge branch 'master' into feat/influxdb_v2_v3_connector
ryerraguntla May 5, 2026
a7504e6
Restore quickwit_sink lib.rs from master
ryerraguntla May 5, 2026
44bc4ed
Use get_host_port_ipv4 in WireMock fixture
ryerraguntla May 5, 2026
7765899
Remove tokio dependency from quickwit_sink
ryerraguntla May 5, 2026
428f5e2
InfluxDB: robustness, perf, and validation
ryerraguntla May 7, 2026
f8b2b35
Remove simd-json and clean up InfluxDB code
ryerraguntla May 7, 2026
7989a58
Add OFFSET clause to InfluxDB test query
ryerraguntla May 7, 2026
6a93d58
Optimize V3 timestamp handling; Improve the documentation
ryerraguntla May 12, 2026
b6fc62f
Merge branch 'master' into feat/influxdb_v2_v3_connector
ryerraguntla May 13, 2026
59cf3ec
Bump Arrow, Parquet and other deps in Cargo.lock
ryerraguntla May 13, 2026
3d53c30
Normalize spacing before inline comment
ryerraguntla May 13, 2026
da8af8d
Merge branch 'master' into feat/influxdb_v2_v3_connector
ryerraguntla May 13, 2026
787cd96
Merge branch 'master' into feat/influxdb_v2_v3_connector
ryerraguntla May 14, 2026
a64cadf
Merge branch 'master' into feat/influxdb_v2_v3_connector
ryerraguntla May 14, 2026
1cb83e1
Merge branch 'master' into feat/influxdb_v2_v3_connector
ryerraguntla May 14, 2026
37ca305
Merge branch 'master' into feat/influxdb_v2_v3_connector
ryerraguntla May 15, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
425 changes: 213 additions & 212 deletions Cargo.lock

Large diffs are not rendered by default.

2 changes: 1 addition & 1 deletion Cargo.toml
Original file line number Diff line number Diff line change
Expand Up @@ -166,7 +166,7 @@ governor = "0.10.4"
harness_derive = { path = "core/harness_derive" }
hash32 = "1.0.0"
hostname = "0.4.2"
http = "1"
http = "1.4.0"
human-repr = "1.1.0"
humantime = "2.3.0"
hwlocality = "1.0.0-alpha.12"
Expand Down
202 changes: 202 additions & 0 deletions core/connectors/influxdb_v3_architecture.md

Large diffs are not rendered by default.

11 changes: 4 additions & 7 deletions core/connectors/sinks/influxdb_sink/Cargo.toml
Original file line number Diff line number Diff line change
Expand Up @@ -29,26 +29,23 @@ repository = "https://github.com/apache/iggy"
readme = "../../README.md"
publish = false

[package.metadata.cargo-machete]
ignored = ["dashmap", "once_cell", "futures"]

[lib]
crate-type = ["cdylib", "lib"]

[dependencies]
async-trait = { workspace = true }
base64 = { workspace = true }
bytes = { workspace = true }
dashmap = { workspace = true }
futures = { workspace = true }
iggy_common = { workspace = true }
iggy_connector_sdk = { workspace = true }
once_cell = { workspace = true }
reqwest = { workspace = true }
reqwest-middleware = { workspace = true }
secrecy = { workspace = true }
serde = { workspace = true }
serde_json = { workspace = true }
simd-json = { workspace = true }
tokio = { workspace = true }
tracing = { workspace = true }

[dev-dependencies]
axum = { workspace = true }
toml = { workspace = true }
1 change: 1 addition & 0 deletions core/connectors/sinks/influxdb_sink/config.toml
Original file line number Diff line number Diff line change
Expand Up @@ -32,6 +32,7 @@ poll_interval = "5ms"
consumer_group = "influxdb_sink"

[plugin_config]
version = "v2"
url = "http://localhost:8086"
org = "iggy"
bucket = "events"
Expand Down
Loading
Loading