paul.rego
Posts: 4
Joined: Tue May 17, 2016 12:28 pm

How to run execute remote calls or a remote script from the server

Postby paul.rego » Tue May 17, 2016 2:46 pm

All,

To start, I'm fairly new to Clover. My goal is to remotely execute a sql client from the clover server. For now, I'm trying something simple, ssh'ing to the remote server and execute a md5sum command (from the examples). I tried using the SystemExecute component with the script code embedded in the component. When I run the jobflow, I encounter permission problems.

The errors generated from SystemExecute are:
"Permission denied, please try again. Permission denied, please try again. Permission denied (publickey,gssapi-keyex,gssapi-with-mic,password)."

Any suggestion would be appreciated.

vazquezrosariop
Posts: 99
Joined: Mon Feb 29, 2016 5:33 pm

Re: How to run execute remote calls or a remote script from the server

Postby vazquezrosariop » Wed May 18, 2016 7:23 pm

Hi,

From the information you provided, I would recommend two better approaches then using a SystemExecute component to accomplish your use case.

  • DBInputTable component which uses the JDBC to connect to the database. In this case you would need to create a new JDBC connection in the Connections section of CloverETL Designer, you can read more about this here.
  • Bulk loader components (e.g. PostgreSQLDataWriter, MySQLDataWriter, etc.) which will use the native client to connect to the database.
---
Pedro Vazquez Rosario
CloverCARE Support
CloverETL | Rapid Data Integration

Visit us online at http://www.cloveretl.com
How to speed up communication with CloverCARE support

paul.rego
Posts: 4
Joined: Tue May 17, 2016 12:28 pm

Re: How to run execute remote calls or a remote script from the server

Postby paul.rego » Thu May 19, 2016 2:47 pm

Thanks for the suggestions!

First, we are using vertica. I dont believe there is a data writer.

Some additional information, I'm trying to execute a bulk load with a compressed file which is not on the clover server. The remote server which has the compressed file, has the vertica client installed. We dont want to copy the file locally and the client is not installed on the clover server. Is there a component or combination of components which would facilitate the execution of the client remotely?

vazquezrosariop
Posts: 99
Joined: Mon Feb 29, 2016 5:33 pm

Re: How to run execute remote calls or a remote script from the server

Postby vazquezrosariop » Mon May 23, 2016 8:48 pm

Hi,

I would recommend that you use a combination of the UniversalDataReader and the DBOutputTable components. The following is the steps to accomplish this:

  • In the UniversalDataReader under File URL you will click on the Remote Files – Create/Edit URL, a window should pop up where you will enter the credentials for your remote server
  • After validating that the connection works you will be able to see all the files in the server and select the zip file (File URL should look something like zip:(sftp://someserver)#somefile.txt)
  • You should use DBOutputTable component which uses the JDBC to connect to the database. You will need to create a new JDBC connection in the Connections section of CloverETL Designer, you can read more about this here
  • Depending on the version of CloverETL you are running, the Vertica JDBC driver should be already included in the Database Connections section, in the case it’s not you can load the driver by clicking on the plus sign
---
Pedro Vazquez Rosario
CloverCARE Support
CloverETL | Rapid Data Integration

Visit us online at http://www.cloveretl.com
How to speed up communication with CloverCARE support


cron