Feature change tracking

[Rayan (hichambouzkraoui)]

Problem

I was trying to sync and old SQL Server version which only supports Change Tracking but not CDC to PostgreSQL
I couldn't find any Kafka source connector which support this feature
I found an old issue open for the same problem
refer to issue 80:(#80)

Solution

Extend kafka-connect-jdbc connect by adding new mode=change_tracking

Does this solution apply anywhere else?

• [x ] yes
• no

If yes, where?

issue 80:(#80)

Test Strategy

Done manual Testing by Setting up docker-compose with 3 services sqlserver, kafka,connect

• connector config
  mssql-connector.json

• seed file
  init-sqlserver.sql

• docker-compose
  docker-compose.yml

• workaround.sh
  workaround.sh

• Tests
  INSERT INTO accounts VALUES (2,'Mary',200);
  INSERT INTO accounts VALUES (3,'Peter',300);
  INSERT INTO users VALUES (2,'mary@example.com','active');
  INSERT INTO users VALUES (3,'peter@example.com','active');
  UPDATE accounts SET amount = amount + 100 WHERE id = 2;
  DELETE FROM accounts WHERE id = 1;

Testing done:

• [ x] Unit tests
• [ x] Integration tests
• System tests
• [x ] Manual tests

Release Plan

[confluent-cla-assistant]

🎉 All Contributor License Agreements have been signed. Ready to merge.
✅ hichambouzkraoui
_{Please push an empty commit if you would like to re-run the checks to verify CLA status for all contributors.}

[Matthias Brückner (heinebold)]

I just stumbled over this because we need it too. Rayan (@hichambouzkraoui), do you have plans to continue with this?

[Rayan (hichambouzkraoui)]

I just stumbled over this because we need it too. Rayan (@hichambouzkraoui), do you have plans to continue with this?

Matthias Brückner (@heinebold) I remember after signing the CLA the check was still pending, I'll retest the PR locally tomorrow and let you know

[Rayan (hichambouzkraoui)]

Matthias Brückner (@heinebold)
I retested locally the PR and it's working fine

[Matthias Brückner (heinebold)]

Cool, thanks! Let's see if we get this upstream :-)