Monitoring Tool for MemSQL

Help
1

Hi Team,

Do we have any in-built monitoring tool in MemSQL for monitoring pipelines?

We are planning multiple pipelines running in the background.
Hence, we want to monitor those pipelines and send alerts on events of pipeline failure.

So far we could see the errors are logged in the PIPELINE_ERRORS table, as well as few other monitoring parameters are available in information_schema.

Is there any monitoring tool that sends notifications/alerts when pipeline state changes?

Thanks,
Pradeep

2

Hello pkodavoo,

As of now we do not have an in-house tool to monitor and report on pipelines. Your best bet would be to periodically look into the pipeline tables in information_schema, gather the data via a cron job and then connect that to a mail alerting mechanism via the shell script.

Here are the tables which store relevant information

Our engineering team is constantly looking to improve the monitoring and alerting piece of MemSQL and we hope to have some tools out soon.

Let us know how you implement your interim solution for now.

Thanks

3

So far, we were thinking of doing it the same way. Get the details by cron and push that to Cloudwatch and monitor /alert it over there!

4

@rnarayanan Any improvements in the Pipeline Alerts? Basically, I am looking for alert\trigger whenever a pipeline succeed loading a file.