[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"project-4304":3},{"id":4,"name":5,"fullName":6,"owner":7,"repo":5,"description":8,"homepage":9,"htmlUrl":10,"language":11,"languages":10,"totalLinesOfCode":10,"stars":12,"forks":13,"watchers":14,"openIssues":15,"contributorsCount":16,"subscribersCount":16,"size":16,"stars1d":16,"stars7d":17,"stars30d":18,"stars90d":16,"forks30d":16,"starsTrendScore":15,"compositeScore":19,"rankGlobal":10,"rankLanguage":10,"license":20,"archived":21,"fork":21,"defaultBranch":22,"hasWiki":23,"hasPages":21,"topics":24,"createdAt":10,"pushedAt":10,"updatedAt":40,"readmeContent":41,"aiSummary":42,"trendingCount":16,"starSnapshotCount":16,"syncStatus":43,"lastSyncTime":44,"discoverSource":45},4304,"flink-cdc","apache\u002Fflink-cdc","apache","Flink CDC is a streaming data integration tool","https:\u002F\u002Fnightlies.apache.org\u002Fflink\u002Fflink-cdc-docs-stable",null,"Java",6433,2172,133,1,0,6,24,41,"Apache License 2.0",false,"master",true,[25,26,27,28,29,30,31,32,33,34,35,36,37,38,39],"batch","cdc","change-data-capture","data-integration","data-pipeline","distributed","elt","etl","flink","kafka","mysql","paimon","postgresql","real-time","schema-evolution","2026-06-12 02:01:01","\u003Cp align=\"center\">\n  \u003Ca href=\"https:\u002F\u002Fnightlies.apache.org\u002Fflink\u002Fflink-cdc-docs-stable\u002F\">\u003Cimg src=\"docs\u002Fstatic\u002Ffig\u002Fflink-cdc-logo.png\" alt=\"Flink CDC\" style=\"width: 375px;\">\u003C\u002Fa>\n\u003C\u002Fp>\n\u003Cp align=\"center\">\n\u003Ca href=\"https:\u002F\u002Fgithub.com\u002Fapache\u002Fflink-cdc\u002F\" target=\"_blank\">\n    \u003Cimg src=\"https:\u002F\u002Fimg.shields.io\u002Fgithub\u002Fstars\u002Fapache\u002Fflink-cdc?style=social&label=Star&maxAge=2592000\" alt=\"Test\">\n\u003C\u002Fa>\n\u003Ca href=\"https:\u002F\u002Fgithub.com\u002Fapache\u002Fflink-cdc\u002Freleases\" target=\"_blank\">\n    \u003Cimg src=\"https:\u002F\u002Fimg.shields.io\u002Fgithub\u002Fv\u002Frelease\u002Fapache\u002Fflink-cdc?color=yellow\" alt=\"Release\">\n\u003C\u002Fa>\n\u003Ca href=\"https:\u002F\u002Fgithub.com\u002Fapache\u002Fflink-cdc\u002Factions\u002Fworkflows\u002Fflink_cdc_ci.yml\" target=\"_blank\">\n    \u003Cimg src=\"https:\u002F\u002Fimg.shields.io\u002Fgithub\u002Factions\u002Fworkflow\u002Fstatus\u002Fapache\u002Fflink-cdc\u002Fflink_cdc_ci.yml?branch=master\" alt=\"Build\">\n\u003C\u002Fa>\n\u003Ca href=\"https:\u002F\u002Fgithub.com\u002Fapache\u002Fflink-cdc\u002Factions\u002Fworkflows\u002Fflink_cdc_ci_nightly.yml\" target=\"_blank\">\n    \u003Cimg src=\"https:\u002F\u002Fimg.shields.io\u002Fgithub\u002Factions\u002Fworkflow\u002Fstatus\u002Fapache\u002Fflink-cdc\u002Fflink_cdc_ci_nightly.yml?branch=master&label=nightly\" alt=\"Nightly Build\">\n\u003C\u002Fa>\n\u003Ca href=\"https:\u002F\u002Fgithub.com\u002Fapache\u002Fflink-cdc\u002Ftree\u002Fmaster\u002FLICENSE\" target=\"_blank\">\n    \u003Cimg src=\"https:\u002F\u002Fimg.shields.io\u002Fgithub\u002Flicense\u002Fapache\u002Fflink-cdc?color=white\" alt=\"License\">\n\u003C\u002Fa>\n\u003C\u002Fp>\n\n\nFlink CDC is a distributed data integration tool for real-time data and batch data, built on top of Apache Flink. It prioritizes efficient end-to-end data integration and offers enhanced functionalities such as full database synchronization, sharding table synchronization, schema evolution and data transformation.\n\n![Flink CDC framework design](docs\u002Fstatic\u002Ffig\u002Farchitecture.png)\n\n## API Layers\n\nFlink CDC provides three API layers for different usage scenarios:\n\n### 1. YAML API (Pipeline API)\n\nThe YAML API provides a declarative, zero-code approach to define data pipelines. Users describe the source, sink, [routing](https:\u002F\u002Fnightlies.apache.org\u002Fflink\u002Fflink-cdc-docs-stable\u002Fdocs\u002Fcore-concept\u002Froute\u002F), [transformation](https:\u002F\u002Fnightlies.apache.org\u002Fflink\u002Fflink-cdc-docs-stable\u002Fdocs\u002Fcore-concept\u002Ftransform\u002F), and [schema evolution](https:\u002F\u002Fnightlies.apache.org\u002Fflink\u002Fflink-cdc-docs-stable\u002Fdocs\u002Fcore-concept\u002Fschema-evolution\u002F) rules in a YAML file and submit it via the `flink-cdc.sh` CLI.\n\nPlease refer to the [Quickstart Guide](https:\u002F\u002Fnightlies.apache.org\u002Fflink\u002Fflink-cdc-docs-stable\u002Fdocs\u002Fget-started\u002Fintroduction\u002F) for detailed setup instructions.\n\n```yaml\nsource:\n  type: mysql\n  hostname: localhost\n  port: 3306\n  username: root\n  password: 123456\n  tables: app_db.\\.*\n\nsink:\n  type: doris\n  fenodes: 127.0.0.1:8030\n  username: root\n  password: \"\"\n\n# Transform data on-the-fly\ntransform:\n  - source-table: app_db.orders\n    projection: id, order_id, UPPER(product_name) as product_name\n    filter: id > 10 AND order_id > 100\n    \n# Route source tables to different sink tables\nroute:\n  - source-table: app_db.orders\n    sink-table: ods_db.ods_orders\n  - source-table: app_db.shipments\n    sink-table: ods_db.ods_shipments\n  - source-table: app_db.\\.*\n    sink-table: ods_db.others\n\npipeline:\n  name: Sync MySQL Database to Doris\n  parallelism: 2\n  schema.change.behavior: evolve  # Support schema evolution\n```\n\n**Pipeline connectors:**\n\n[Doris](https:\u002F\u002Fmvnrepository.com\u002Fartifact\u002Forg.apache.flink\u002Fflink-cdc-pipeline-connector-doris) | [Elasticsearch](https:\u002F\u002Fmvnrepository.com\u002Fartifact\u002Forg.apache.flink\u002Fflink-cdc-pipeline-connector-elasticsearch) | [Fluss](https:\u002F\u002Fmvnrepository.com\u002Fartifact\u002Forg.apache.flink\u002Fflink-cdc-pipeline-connector-fluss) | [Hudi](https:\u002F\u002Fmvnrepository.com\u002Fartifact\u002Forg.apache.flink\u002Fflink-cdc-pipeline-connector-hudi) | [Iceberg](https:\u002F\u002Fmvnrepository.com\u002Fartifact\u002Forg.apache.flink\u002Fflink-cdc-pipeline-connector-iceberg) | [Kafka](https:\u002F\u002Fmvnrepository.com\u002Fartifact\u002Forg.apache.flink\u002Fflink-cdc-pipeline-connector-kafka) | [MaxCompute](https:\u002F\u002Fmvnrepository.com\u002Fartifact\u002Forg.apache.flink\u002Fflink-cdc-pipeline-connector-maxcompute) | [MySQL](https:\u002F\u002Fmvnrepository.com\u002Fartifact\u002Forg.apache.flink\u002Fflink-cdc-pipeline-connector-mysql) | [OceanBase](https:\u002F\u002Fmvnrepository.com\u002Fartifact\u002Forg.apache.flink\u002Fflink-cdc-pipeline-connector-oceanbase) | [Oracle](https:\u002F\u002Fmvnrepository.com\u002Fartifact\u002Forg.apache.flink\u002Fflink-cdc-pipeline-connector-oracle) | [Paimon](https:\u002F\u002Fmvnrepository.com\u002Fartifact\u002Forg.apache.flink\u002Fflink-cdc-pipeline-connector-paimon) | [PostgreSQL](https:\u002F\u002Fmvnrepository.com\u002Fartifact\u002Forg.apache.flink\u002Fflink-cdc-pipeline-connector-postgres) | [StarRocks](https:\u002F\u002Fmvnrepository.com\u002Fartifact\u002Forg.apache.flink\u002Fflink-cdc-pipeline-connector-starrocks)\n\nSee the [connector overview](https:\u002F\u002Fnightlies.apache.org\u002Fflink\u002Fflink-cdc-docs-stable\u002Fdocs\u002Fconnectors\u002Fpipeline-connectors\u002Foverview\u002F) for a full list and configurations.\n\n### 2. SQL API (Table\u002FSQL API)\n\nThe SQL API integrates with Flink SQL, allowing users to define CDC sources using SQL DDL statements. Deploy the SQL connector JAR to `FLINK_HOME\u002Flib\u002F` and use it directly in Flink SQL Client:\n\n```sql\nCREATE TABLE mysql_binlog (\n  id INT NOT NULL,\n  name STRING,\n  description STRING,\n  weight DECIMAL(10,3),\n  PRIMARY KEY(id) NOT ENFORCED\n) WITH (\n  'connector' = 'mysql-cdc',\n  'hostname' = 'localhost',\n  'port' = '3306',\n  'username' = 'flinkuser',\n  'password' = 'flinkpw',\n  'database-name' = 'inventory',\n  'table-name' = 'products'\n);\n\nSELECT id, UPPER(name), description, weight FROM mysql_binlog;\n```\n\n**Available SQL connectors** (dependencies bundled):\n\n[MySQL](https:\u002F\u002Fmvnrepository.com\u002Fartifact\u002Forg.apache.flink\u002Fflink-sql-connector-mysql-cdc) | [PostgreSQL](https:\u002F\u002Fmvnrepository.com\u002Fartifact\u002Forg.apache.flink\u002Fflink-sql-connector-postgres-cdc) | [Oracle](https:\u002F\u002Fmvnrepository.com\u002Fartifact\u002Forg.apache.flink\u002Fflink-sql-connector-oracle-cdc) | [SQL Server](https:\u002F\u002Fmvnrepository.com\u002Fartifact\u002Forg.apache.flink\u002Fflink-sql-connector-sqlserver-cdc) | [MongoDB](https:\u002F\u002Fmvnrepository.com\u002Fartifact\u002Forg.apache.flink\u002Fflink-sql-connector-mongodb-cdc) | [OceanBase](https:\u002F\u002Fmvnrepository.com\u002Fartifact\u002Forg.apache.flink\u002Fflink-sql-connector-oceanbase-cdc) | [TiDB](https:\u002F\u002Fmvnrepository.com\u002Fartifact\u002Forg.apache.flink\u002Fflink-sql-connector-tidb-cdc) | [Db2](https:\u002F\u002Fmvnrepository.com\u002Fartifact\u002Forg.apache.flink\u002Fflink-sql-connector-db2-cdc) | [Vitess](https:\u002F\u002Fmvnrepository.com\u002Fartifact\u002Forg.apache.flink\u002Fflink-sql-connector-vitess-cdc)\n\nSee the [source connector overview](https:\u002F\u002Fnightlies.apache.org\u002Fflink\u002Fflink-cdc-docs-stable\u002Fdocs\u002Fconnectors\u002Fflink-sources\u002Foverview\u002F) for a full list and configurations.\n\n### 3. DataStream API\n\nThe DataStream API provides programmatic access for building custom Flink streaming applications. Add the corresponding connector as a Maven dependency:\n\n```xml\n\u003Cdependency>\n  \u003CgroupId>org.apache.flink\u003C\u002FgroupId>\n  \u003CartifactId>flink-connector-mysql-cdc\u003C\u002FartifactId>\n  \u003Cversion>${flink-cdc.version}\u003C\u002Fversion>\n\u003C\u002Fdependency>\n```\n\n**Available source connectors:**\n\n[MySQL](https:\u002F\u002Fmvnrepository.com\u002Fartifact\u002Forg.apache.flink\u002Fflink-connector-mysql-cdc) | [PostgreSQL](https:\u002F\u002Fmvnrepository.com\u002Fartifact\u002Forg.apache.flink\u002Fflink-connector-postgres-cdc) | [Oracle](https:\u002F\u002Fmvnrepository.com\u002Fartifact\u002Forg.apache.flink\u002Fflink-connector-oracle-cdc) | [SQL Server](https:\u002F\u002Fmvnrepository.com\u002Fartifact\u002Forg.apache.flink\u002Fflink-connector-sqlserver-cdc) | [MongoDB](https:\u002F\u002Fmvnrepository.com\u002Fartifact\u002Forg.apache.flink\u002Fflink-connector-mongodb-cdc) | [OceanBase](https:\u002F\u002Fmvnrepository.com\u002Fartifact\u002Forg.apache.flink\u002Fflink-connector-oceanbase-cdc) | [TiDB](https:\u002F\u002Fmvnrepository.com\u002Fartifact\u002Forg.apache.flink\u002Fflink-connector-tidb-cdc) | [Db2](https:\u002F\u002Fmvnrepository.com\u002Fartifact\u002Forg.apache.flink\u002Fflink-connector-db2-cdc) | [Vitess](https:\u002F\u002Fmvnrepository.com\u002Fartifact\u002Forg.apache.flink\u002Fflink-connector-vitess-cdc)\n\nAll artifacts use group ID `org.apache.flink`. See the [DataStream API packaging guide](https:\u002F\u002Fnightlies.apache.org\u002Fflink\u002Fflink-cdc-docs-stable\u002Fdocs\u002Fconnectors\u002Fflink-sources\u002Fdatastream-api-package-guidance\u002F) for a complete `pom.xml` example.\n\n## Flink Version Compatibility\n\n| Flink CDC | Supported Flink Versions     | Notes                                                           |\n|-----------|------------------------------|-----------------------------------------------------------------|\n| 3.6       | 1.20, 2.2                    |                                                                 |\n| 3.5       | 1.19, 1.20                   |                                                                 |\n| 3.4       | 1.19, 1.20                   |                                                                 |\n| 3.3       | 1.19, 1.20                   |                                                                 |\n| 3.2       | 1.17, 1.18, 1.19             |                                                                 |\n| 3.1       | 1.16, 1.17, 1.18, 1.19       | Only Flink CDC 3.1.1 supports Flink 1.19                        |\n| 3.0       | 1.14, 1.15, 1.16, 1.17, 1.18 | Pipeline API requires Flink 1.17 and above                      |\n| 2.4       | 1.13, 1.14, 1.15, 1.16, 1.17 | Flink CDC 1.x and 2.x does not support Pipeline API, same below |\n| 2.3       | 1.13, 1.14, 1.15, 1.16       |                                                                 |\n| 2.2       | 1.13, 1.14                   |                                                                 |\n| 2.1       | 1.13                         |                                                                 |\n| 2.0       | 1.13                         |                                                                 |\n| 1.4       | 1.13                         |                                                                 |\n| 1.3       | 1.12                         |                                                                 |\n| 1.2       | 1.12                         |                                                                 |\n| 1.1       | 1.11                         |                                                                 |\n| 1.0       | 1.11                         |                                                                 |\n\nSee the [Pipeline connector overview](https:\u002F\u002Fnightlies.apache.org\u002Fflink\u002Fflink-cdc-docs-stable\u002Fdocs\u002Fconnectors\u002Fpipeline-connectors\u002Foverview\u002F) and [source connector overview](https:\u002F\u002Fnightlies.apache.org\u002Fflink\u002Fflink-cdc-docs-stable\u002Fdocs\u002Fconnectors\u002Fflink-sources\u002Foverview\u002F) for details.\n\n## Join the Community\n\nThere are many ways to participate in the Apache Flink CDC community. The\n[mailing lists](https:\u002F\u002Fflink.apache.org\u002Fwhat-is-flink\u002Fcommunity\u002F#mailing-lists) are the primary place where all Flink\ncommitters are present. For user support and questions use the user mailing list. If you've found a problem of Flink CDC,\nplease create a [Flink JIRA](https:\u002F\u002Fissues.apache.org\u002Fjira\u002Fprojects\u002FFLINK\u002Fsummary) and tag it with the `Flink CDC` tag.\nBugs and feature requests can either be discussed on the dev mailing list or on Jira.\n\n## Contributing\n\nWelcome to contribute to Flink CDC, please see our [Developer Guide](https:\u002F\u002Fnightlies.apache.org\u002Fflink\u002Fflink-cdc-docs-stable\u002Fdocs\u002Fdeveloper-guide\u002Fcontribute-to-flink-cdc\u002F)\nand [APIs Guide](https:\u002F\u002Fnightlies.apache.org\u002Fflink\u002Fflink-cdc-docs-stable\u002Fdocs\u002Fdeveloper-guide\u002Funderstand-flink-cdc-api\u002F).\n\n## License\n\n[Apache 2.0 License](LICENSE).\n\n## Special Thanks\n\nThe Flink CDC community welcomes everyone who is willing to contribute, whether it's through submitting bug reports,\nenhancing the documentation, or submitting code contributions for bug fixes, test additions, or new feature development.     \nThanks to all contributors for their enthusiastic contributions.\n\n\u003Ca href=\"https:\u002F\u002Fgithub.com\u002Fapache\u002Fflink-cdc\u002Fgraphs\u002Fcontributors\">\n  \u003Cimg src=\"https:\u002F\u002Fcontrib.rocks\u002Fimage?repo=apache\u002Fflink-cdc\"\u002F>\n\u003C\u002Fa>\n","Flink CDC 是一个基于 Apache Flink 构建的实时和批量数据集成工具。其核心功能包括全数据库同步、分片表同步、模式演化及数据转换，支持 MySQL、PostgreSQL 等多种数据源，并能将数据流式传输到 Kafka、Paimon 等目标系统中。该项目通过提供 YAML API 等多种接口层，允许用户以声明式方式零代码定义数据管道，极大简化了 ETL\u002FELT 流程配置。适用于需要高效处理大规模数据变更捕获与集成的应用场景，如企业级数据仓库构建、实时数据分析平台等。",2,"2026-06-11 02:59:33","top_language"]