Job monitoring and control in Java

Discussion on developing CloverETL engine, transformation components etc.

adrianshum
Posts: 1
Joined: Tue May 29, 2012 10:53 am

Job monitoring and control in Java

Postby adrianshum » Tue May 29, 2012 11:02 am

Dear all,

I am new in CloverETL, wish I am not asking something stupid (I have tried to search for this forum before asking)

I know we can use runGraph to run an ETL job in Java. However, I want to know if there is anyway for me to get information on the current state of the execution (e.g. number of record processed, status of the job now, error message in case of error etc)? And, any way to control the job, for example, cancel a running job? These feature seems not that obvious when I am reading Javadoc of runGraph

kubosj
Posts: 372
Joined: Thu Jan 12, 2012 9:10 am

Re: Job monitoring and control in Java

Postby kubosj » Wed May 30, 2012 7:42 am

Dear adrianshum,

you can try to parse logs (Engine prints internal status every few seconds).

Whole bunch of monitoring functions and controls is available in CloverETL Server product: see http://www.cloveretl.com/products/enterprise-editions
Jaroslav Kubos
CloverCARE Support
CloverETL | Rapid Data Integration

Visit us online at http://www.cloveretl.com

dpavlis
Posts: 180
Joined: Sat Mar 10, 2007 8:12 pm

Re: Job monitoring and control in Java

Postby dpavlis » Wed May 30, 2012 8:42 am

During runtime, Clover provides a lot of useful statistics (records processed, cpu load by component, etc.) through JMX Bean it registers with JVM.
You may connect to running instance through JConsole (as an example) and see what is going on. Also, there is a possibility to create your own Java JMX client and listen/poll the JMX Bean of Clover.

As for the Java code on Clover's side - look into org.jetel.graph.runtime.jmx package.
David Pavlis
CloverCARE Support
CloverETL | Rapid Data Integration

Visit us online at http://www.cloveretl.com


cron