Search found 32 matches

by pintail
Fri Oct 20, 2017 4:58 pm
Forum: CloverETL Support
Topic: Normalizer Cols to Rows
Replies: 9
Views: 1518

Re: Normalizer Cols to Rows

Thanks! That worked prefect for what I need and doubt I would have figured out the right code on my own....thanks for the help.
by pintail
Thu Oct 19, 2017 11:05 pm
Forum: CloverETL Support
Topic: Normalizer Cols to Rows
Replies: 9
Views: 1518

Re: Normalizer Cols to Rows

Hi, I am having a similar challenge. I'm looking to collapse data in various columns into a single column and multiple rows. I think the normalizer can do this? Do you have an example graph for how to do this? Incoming record (1 row): First Name, Last Name, State, Field1, Field2, Field3, Field4 outg...
by pintail
Thu Jun 15, 2017 3:48 pm
Forum: CloverETL Support
Topic: Partition Component
Replies: 3
Views: 241

Re: Partition Component

that worked great. thanks!
by pintail
Thu Jun 15, 2017 2:02 am
Forum: CloverETL Support
Topic: Partition Component
Replies: 3
Views: 241

Partition Component

Hi - Can a partition component be used to separate data into three separate output ports based on the key value? I have incoming data with a field called TypeID (values 1,2 or 3). I want to separate the data into three separate ports, records with values 1 going to port 0, records with values 2 go t...
by pintail
Wed Jun 14, 2017 9:20 pm
Forum: CloverETL Support
Topic: How does the System Execute Command work related to connections?
Replies: 3
Views: 421

Re: How does the System Execute Command work related to connections?

Ok, that's what I thought about the file getting written out and executed separately. thanks. It's a little odd what's happening. Essentially a high level here is the process... 1) Jobflow is executed which reads a file sending 500 about input parameters. The jobflow calls a single graph for each ne...
by pintail
Fri May 19, 2017 11:06 pm
Forum: CloverETL Support
Topic: How does the System Execute Command work related to connections?
Replies: 3
Views: 421

How does the System Execute Command work related to connections?

Hi - we're using a a system execute command to execute a python script (linux server) with parameters passed to it- synchronously 10 at a time. This works ok for a while but eventually locks up and gets a connection refused error. We're thinking it's that the graph that calls the script is waiting f...
by pintail
Thu May 18, 2017 6:10 pm
Forum: CloverETL Support
Topic: Anyone have a working web service client component on linux that needs to go through a proxy server
Replies: 1
Views: 244

Anyone have a working web service client component on linux that needs to go through a proxy server

We have a working web service client that calls an API to retrieve data running on a linux server. It works ok in a test environment which doesn't require a proxy to hit the API URL but when we put this into the environment that needs to go through a web proxy it doesn't work (connect refused/can't ...
by pintail
Thu May 18, 2017 6:06 pm
Forum: CloverETL Support
Topic: System Execute Stops Working after a while in PROD, still works in DEV
Replies: 1
Views: 178

Re: System Execute Stops Working after a while in PROD, still works in DEV

looks like it's a socket issue on the webserver. We're temporarily just restarting the service to clear things out night, but would be good to see if anyone has any other ideas about the issue. I do see the python processes starting and going away in the monitoring window on linux, so it looks like ...
by pintail
Thu May 18, 2017 3:10 am
Forum: CloverETL Support
Topic: System Execute Stops Working after a while in PROD, still works in DEV
Replies: 1
Views: 178

System Execute Stops Working after a while in PROD, still works in DEV

Hi, Version 4.1 We're finding an issue where a system execute call to a python script stops working after a while in production (seems random). The same script will work in DEV. The system execute is called repeatedly by a jobflow which passes a parameter to be used in the system execute component w...
by pintail
Thu Aug 11, 2016 8:30 pm
Forum: CloverETL Support
Topic: What comes out of the two ports on the DBOutputTable component?
Replies: 1
Views: 507

What comes out of the two ports on the DBOutputTable component?

I'm looking to capture and write out the error messages, and ideally the UID of the record causing the problem. I tried setting up a meta with ErrCode and ErrText like I saw in the documentation. I can see in debug mode that there is one error record on port 1. But when I open up the debug window bo...
by pintail
Wed Jul 06, 2016 8:54 pm
Forum: CloverETL Support
Topic: Job Scheduler Starts again, but previous job not finished - any way to prevent?
Replies: 1
Views: 427

Job Scheduler Starts again, but previous job not finished - any way to prevent?

Hi, We have a bunch of jobs scheduled to run on the hour. Occasionally it takes longer than an hour to finish the previous job (API data calls via a slow proxy server is the cause there). We don't want the next job to start if the current job is running. Is there a way to configure the job scheduler...
by pintail
Tue Mar 15, 2016 4:48 pm
Forum: CloverETL Support
Topic: long2date not working?
Replies: 1
Views: 505

No need to follow up on that long2date conversion I just submitted....

I figured it out....was missing a 1000 multiplier to the long date that was being provided to me. Or you can add that as the solution and post I guess in case someone runs into the same issue.... using this code output = long2date(str2long($in.0.time)* 1000); instead of this code output = long2date(...
by pintail
Tue Mar 15, 2016 4:43 pm
Forum: CloverETL Support
Topic: long2date not working?
Replies: 1
Views: 505

long2date not working?

Hi, I'm trying to convert a string into a date. The data comes is as a string but is a long number. I would think the code below would work? output (meta is defined as a date type) = long2date(str2long($in.0.time)); I've verified that the str2long is keeping the same numbers: 1457895600 But...that n...
by pintail
Mon Feb 15, 2016 11:02 pm
Forum: CloverETL Support
Topic: Easiest way to check a history file and only process new records
Replies: 1
Views: 377

Easiest way to check a history file and only process new records

Hi, Does anyone out there have a good example of a process to check a history file of processed records to see which incoming records haven't already been processed? I'm using this in some processing where we get new sets of data that often include records which were previously supplied and don't ne...
by pintail
Thu Dec 10, 2015 2:24 am
Forum: CloverETL Support
Topic: Combine Component - can you specify relationship fields?
Replies: 1
Views: 437

Combine Component - can you specify relationship fields?

Hi, Is there a way to specify how to link data between two incoming sources using a combine. I have two simple record sets. Five coming in port 1 and five coming in port 2. Each one matches only one record on the linked field. Is there any way to define that master / slave relationship like in other...