Cant create file based pipeline

Have 5 running file based pipelines and all failed with the same error at the same time.

Cannot get source metadata for pipeline. No stderr returned.

To try and troubleshoot, I tried to create a new file based pipeline, I get the same error when trying to create a new pipeline. Note that the pipelines that failed were running for 4 months without issue, they all failed pretty much at the same time. This pipeline that I am creating is one of those that was running, I just added _test to the pipeline name and the table name.

this is a 4 node singlestore cluster running on redhat 7. I used admin commands to stop and restart all the nodes. I even stopped the nodes and rebooted all the servers. I also have about 20 kafka pipelines and these are not impacted, still up and running without issue.

CREATE or REPLACE PIPELINE sterling_pl_prod_test
AS LOAD DATA FS ‘/ssnfs/sterling/sterling*’
SKIP DUPLICATE KEY ERRORS
INTO TABLE peak.order_fact_test
FIELDS TERMINATED BY ‘|’;

(conn=174941) Cannot get source metadata for pipeline. No stderr returned.
1 statement failed.

I’m sorry to hear you’re having trouble with this. What version of SingleStore are you running?