Ff2Cql

A simple transfer data from NiFi to CQL (support Apache Cassandra, ScyllaDB, AstraDB, etc.). The implementation details:

• development NiFi v2 processor (with controller) and java application (support Java 17/21+)
• support Apache Cassandra v4/v5, ScyllaDB, AstraDB based on CQL (Cassandra Query Language)

1. The main motivation

• the Apache NiFi v2 does not support Apache Cassandra v4/v5 (NiFi v2 removed the Cassandra processor due to security vulnerabilities and unmaintained code. The processor supported only Cassandra v3 not newer.)

2. Usage in NiFi

You can use this preferred way:

• ✅ PutCQL as NiFi processor with controller (download latest version, see 'nifi-cql-nar-*.nar'), where inputs are FlowFiles (addition detail)

or two other alternative ways:

• ✅ ExecuteProcess with java application (see 'Ff2Cql-*.jar'), where inputs are CSV files (addition detail)
• ✅ ExecuteStreamCommand with java application (see 'Ff2Cql-*.jar'), where inputs are FlowFiles via stdin (addition detail)

3. Connection setting

You can see sample of relevant setting for CQL controllers:

• Cassandra setting
  • access with IP addresses
• Scylla setting
  • access with IP address (localhost)
• AstraDB setting
  • access with security connection bundle (SCB) and token
  • NOTE about SCB: see the file with '.zip' suffix
    • How to get the SCB? Go to the https://astra.datastax.com/..., Menu Databases/Your database/Region/Download SCB
  • NOTE about token: see the file with 'token.json' suffix
    • How to get the token? Go to the https://astra.datastax.com/..., Menu Tokens/Generate Token/Token Details/Download Token Details
• YugabyteDB setting
  • TBD.

NOTE:

• These connection settings are used directly in unit tests.