melshami
Posts: 10
Joined: Tue Dec 23, 2014 4:39 pm

Unable to list files with whitespaces using ListFiles

Postby melshami » Tue Dec 23, 2014 4:59 pm

The directory listing works ok using wildcard filter (*.csv), but it seems that it's unable to recognise the encoded URI for the file

Code: Select all

---------------------------------------------------- Error details ------------------------------------------------------
  Component [List EOD Files:LIST_EOD_FILES] finished with status ERROR. (Out0: 0 recs)
   Failed to list ftp://user:mypass@ftp.myserver:21/EODReports/Process/*.csv
   [color=#008040] Directory listing failed
     File not found: "ftp://user:mypass@ftp.myserver:21/EODReports/Process/DailyTrans%20191220142232.csv[/color]"

melshami
Posts: 10
Joined: Tue Dec 23, 2014 4:39 pm

Re: Unable to list files with whitespaces using ListFiles

Postby melshami » Tue Dec 30, 2014 12:34 pm

This is currently preventing me from successfully evaluating CloverETL server. Can someone from CloverETL team confirm if there is a known issue with file URL's with white spaces?

slechtaj
Posts: 192
Joined: Wed Aug 15, 2012 8:18 am

Re: Unable to list files with whitespaces using ListFiles

Postby slechtaj » Tue Dec 30, 2014 1:55 pm

Hi,

coud you please tell us what CloverETL version do you use?

Thanks!
Jan Slechta
CloverCARE Support
CloverETL | Rapid Data Integration

Visit us online at http://www.cloveretl.com

How to speed up communication with CloverCARE support

melshami
Posts: 10
Joined: Tue Dec 23, 2014 4:39 pm

Re: Unable to list files with whitespaces using ListFiles

Postby melshami » Tue Dec 30, 2014 2:05 pm

Hi

I am using CloverETL Server 4.0.2.7/7

Regards,
M. Elshami

kubosj
Posts: 372
Joined: Thu Jan 12, 2012 9:10 am

Re: Unable to list files with whitespaces using ListFiles

Postby kubosj » Wed Dec 31, 2014 9:12 am

Hi M. Elshami,

In general, CloverETL handles spaces in names very well. I have test exactly same file name you use on our FTP server (Pure-FTPd) and it works great. So maybe the issue lays in access rights, FTP server type, or something like that.

I would suggest following to debug:
  1. Try to run your graph with DEBUG log level (Configuring the Graph Run resp. Program Arguments) and post (please remove credentials) execution log here. Maybe we will see more information.
  2. Try to run same graph on similar FTP folder not containing spaces in file names and then put there file with space and run again. This should help us to be sure that problem is really spaces in file names.
  3. What FTP server do you use, please?
  4. Do you have access to FTP server logs? Maybe something interesting could be found there.

I hope this helps.
Jaroslav Kubos
CloverCARE Support
CloverETL | Rapid Data Integration

Visit us online at http://www.cloveretl.com

melshami
Posts: 10
Joined: Tue Dec 23, 2014 4:39 pm

Re: Unable to list files with whitespaces using ListFiles

Postby melshami » Wed Dec 31, 2014 12:52 pm

Hi Jaroslav

Thanks a lot for your reply.

I've performed to runs in debug mode.

a) ftp_log1_success.txt: filename with no spaces (used _ in the filename).
b) ftp_log2_fail.txt: filename with spaces.

3.What FTP server do you use, please?
The ftp server is Microsoft Ftp Service (we deal with various numbers of OS including Solaris, RedHat and Windows). There is no single unified FTP server corporate wide.

4.Do you have access to FTP server logs? Maybe something interesting could be found there.
I don't have access to server logs. If it will help, I can arrange for a local installation of FTP service and peform more testing.

Please note that, we already have our own in house built ETL engine that handles the FTP server I am currently testing against.

Regards,
M. Elshami

kubosj
Posts: 372
Joined: Thu Jan 12, 2012 9:10 am

Re: Unable to list files with whitespaces using ListFiles

Postby kubosj » Wed Dec 31, 2014 1:46 pm

Hi M. Elshami,

your .txt files are not attached, probably because .txt extension were not allowed. I changed forum settings, can you please attach them?

Thank you!
Jaroslav Kubos
CloverCARE Support
CloverETL | Rapid Data Integration

Visit us online at http://www.cloveretl.com

melshami
Posts: 10
Joined: Tue Dec 23, 2014 4:39 pm

Re: Unable to list files with whitespaces using ListFiles

Postby melshami » Wed Dec 31, 2014 2:00 pm

Here is the attachments again.
Attachments
ftp_log2_fail.txt
(7.31 KiB) Downloaded 57 times
ftp_log1_success.txt
(5.59 KiB) Downloaded 62 times

kubosj
Posts: 372
Joined: Thu Jan 12, 2012 9:10 am

Re: Unable to list files with whitespaces using ListFiles

Postby kubosj » Fri Jan 02, 2015 1:12 pm

Hi,

Thank you for logs. We are investigating now but it will take few days. We will let you know when we will have results.

Thank you for patience.
Jaroslav Kubos
CloverCARE Support
CloverETL | Rapid Data Integration

Visit us online at http://www.cloveretl.com

slechtaj
Posts: 192
Joined: Wed Aug 15, 2012 8:18 am

Re: Unable to list files with whitespaces using ListFiles

Postby slechtaj » Tue Jan 06, 2015 1:52 pm

Hi,

We have been trying to reproduce the issue with the same settings (based on the log) as you. During the testing we didn’t experience any issue, so could you please provide us with a few more details – we are especially interested in your IIS version, and any further information about your environment (whether you are behind a proxy etc.)

Thank you
Jan Slechta
CloverCARE Support
CloverETL | Rapid Data Integration

Visit us online at http://www.cloveretl.com

How to speed up communication with CloverCARE support

melshami
Posts: 10
Joined: Tue Dec 23, 2014 4:39 pm

Re: Unable to list files with whitespaces using ListFiles

Postby melshami » Fri Jan 09, 2015 4:32 pm

Thanks for getting back to me.

I will perform the testing on other FTP servers and provide you with more details.

Regards,
MElshami


cron