Skip to content

Add DualStarRocksWriter for dual-writing to two StarRocks clusters#2273

Open
decli wants to merge 1 commit intoalibaba:masterfrom
decli:add-dual-starrocks-writer
Open

Add DualStarRocksWriter for dual-writing to two StarRocks clusters#2273
decli wants to merge 1 commit intoalibaba:masterfrom
decli:add-dual-starrocks-writer

Conversation

@decli
Copy link

@decli decli commented Feb 23, 2025

Add support for dual-writing to two StarRocks clusters for cross-room data disaster recovery.

  • Add DualStarRocksWriter class to handle dual-writing to two StarRocks clusters.
  • Implement Job and Task inner classes in DualStarRocksWriter to manage configuration and writing logic.
  • Add configuration options for the second StarRocks cluster in plugin_job_template.json.
  • Update plugin.json to include the new DualStarRocksWriter entry and description.

For more details, open the Copilot Workspace session.

Add support for dual-writing to two StarRocks clusters for cross-room data disaster recovery.

* Add `DualStarRocksWriter` class to handle dual-writing to two StarRocks clusters.
* Implement `Job` and `Task` inner classes in `DualStarRocksWriter` to manage configuration and writing logic.
* Add configuration options for the second StarRocks cluster in `plugin_job_template.json`.
* Update `plugin.json` to include the new `DualStarRocksWriter` entry and description.

---

For more details, open the [Copilot Workspace session](https://copilot-workspace.githubnext.com/alibaba/DataX?shareId=XXXX-XXXX-XXXX-XXXX).
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant