we are getting more and more into pipelines and are pretty amazed by the performance!
In order to ease our development and management, I would like to propose improvements to Studio:
- GUI to create / update Pipelines (e.g. to select the data source, to select the table, to manage the transforms)
- When modifying a pipeline, it is important to start it again correctly so that the previously imported files are not imported again. It is easy to make mistakes here, so a GUI would help
- Some statistics relating to the amount of imported data and the speed of which this happens
Let me know what you think!