Create pipeline with C# transform fails

Help Connectors and Pipelines
1

Hi, Im using cluster in a box in order to get familiar with memsql especially with the use of pipelines.
Ive created a very simple .cs code and wraped it in a shell script (dotnet run pipeTest.cs)

The .cs program does the following:
Console.ReadLine();
Console.WriteLine(Console.ReadLine());

When it try to test the newly created pipeline:
Create pipeline firstPipeline
as load data FS '/home/dev/Development/PipeTest/pipeTest.csv’
with transform(‘file://localhost/home/dev/Development/PipeTransform/trans.sh’,’’,’’)
into table testPipe
fields terminated by ‘,’;

I get the following error: ERROR 1953 ER_TRANSFORM_NONZERO_EXIT_VALUE: Leaf Error (127.0.0.1:3306): Leaf Error (127.0.0.1:3307): Transform for pipeline exited with nonzero exit code.

1 Like
2

Looks like you need to specify the user to connect to your HDFS. There is another post in this forum about HDFS:

3

I added the credentials line but i get the same error, also i like to point out that my example is refering to FS not to HDFS.