I have a few KAFKA pipelines consuming AVRO messages and inserting into MemSql tables.
i have 1 KAFKA topic that is JSON and i’m able to pass that to a Stored Proc, which is nice b/c i can use the REPLACE command on a table that has primary keys - which fits my situation perfectly.
Is there a way to implement this functionality all in the PIPELINE?
I tried using the REPLACE keyword in the pipeline but no data was added to my table which made me think it’s literally a REPLACE (ie existing) rather than an INSERT_or_UPDATE.