We are creating a Kafka pipeline as below. But our Kafka topics are different for development, QA and production environment.
Please guide us how to avoid hard coding of this Kafka topic in a pipeline.
create or replace pipeline pipeline_processemp
as load data kafka ‘b-2.-msk.nf.c2.kafka.us-west-2.amazonaws.com:9092/processemp’
batch_interval 500
max_partitions_per_batch 10
resource pool inventory_resource_pool
into table processemp format json;