Trying a trigger a pipeline whenever a new student getting adding to a college via kafka. This pipeline will invoke a stored procedure which will insert new record in student table and department table based on a validation.
-> Student table contains department Id alone. Department details will be available in department table.
-> If the department unavailable in the table then only insert a new record otherwise assign the existing department id in the students table.
I can’t pre-populate the Department dimension table ahead. It needs to populate during the real time.
Able to insert into department table whenever entry is not available but not able to assign Department Id in the Student table. Facing below error.
Message: Feature ‘Non-partition-local INSERT…SELECT from a table already written to in this transaction’ is not supported by MemSQL Distributed.
Is there any alternative way in memsql?