I have files in normal FS, after starting the pipeline when i add files in leaf node it is not reflecting in information_schema.pipelines. Kindly help
Can you elaborate? I’m not sure I understand the situation.
I want to achieve the migration of data from text file to table. I have kept my file in leaf node and i have created, started the pipeline but the text files status are not visible in the information_schema.pipelines
I think you mean that you are keeping text files on the file system on a leaf node server, and trying to read from those files with a pipeline. It should work, but you need to make sure those files are visible on the aggregator nodes and all the leaf nodes as a remotely mounted file system. Otherwise, the CREATE PIPELINE statement can’t see the folders you’re trying to load from.