Search found 180 matches

by dpavlis
Fri Jun 16, 2017 10:53 am
Forum: CloverETL Support
Topic: Compare data does not get all data
Replies: 2
Views: 256

Re: Compare data does not get all data

It looks like you are comparing not numbers, but strings - you have your variables defined as string variables. When comparing strings, you get "100" lover than "90" simply because it looks at the first chars of each string "1" & "9" in this case and decid...
by dpavlis
Fri Jun 16, 2017 10:43 am
Forum: CloverETL Support
Topic: Partition Component
Replies: 3
Views: 173

Re: Partition Component

Just a small note: Partition component does assign the filtered records to the output ports randomly when using the Partition key That is not really true. In fact the Partition component in that case (partition key defined) calculates a HASH of that key (which is a 32bit number) and then based on th...
by dpavlis
Tue Aug 30, 2016 10:37 am
Forum: CloverETL Support
Topic: find matching characters in 2 strings
Replies: 1
Views: 291

Re: find matching characters in 2 strings

Hi, the first can be done somehow like this in CTL: string str1; string str2; string target; for(integer i=0;i<lenght(str1);i++){ string letter=charAt(str1,i); if (contains(str2,letter) target=target+letter; } Basically I go through individual letters/characters of str1 and check whether they are in...
by dpavlis
Thu Aug 25, 2016 1:20 pm
Forum: CloverETL Support
Topic: CTL Template
Replies: 1
Views: 282

Re: CTL Template

Hi,

You may find import statement of CTL2 useful for this.
by dpavlis
Thu Aug 25, 2016 1:16 pm
Forum: CloverETL Server
Topic: DDL for CloverETL server database setup
Replies: 5
Views: 900

Re: DDL for CloverETL server database setup

Hi, One creative idea. Why don't you let CloverETL Server create all the necessary Oracle DB objects on some test instance of DB (or just schema). Then your DB admin can a) analyze that it does not contain anything dangerous b) just clone/copy all the tables and DB objects into the production DB. Th...
by dpavlis
Sun May 15, 2016 1:18 pm
Forum: IBM InfoSphere MDM
Topic: Message to IBM InfoSphere MDM users upgrading to version 11.4 or higher
Replies: 0
Views: 1299

Message to IBM InfoSphere MDM users upgrading to version 11.4 or higher

If you upgrade to IBM InfoSphere MDM version 11.4 or higher, you are now offered DataStage, an alternative ETL product, instead of CloverETL. Users and resellers often choose to continue with CloverETL, originally offered within the solution, instead of InfoSphere DataStage. As a result, IBM has fun...
by dpavlis
Thu May 12, 2016 10:44 am
Forum: CloverETL Support
Topic: Create a valid data format
Replies: 2
Views: 682

Re: Create a valid data format

Hi, Since "2012-10" is not a valid date - just year & month, you will need (ideally in a Reformat) add a day info. You can just append "01" for the first day in any particular month and then use str2date() function with mask like "yyyy-MM-dd" or you can use "yy...
by dpavlis
Wed Mar 30, 2016 12:46 pm
Forum: CloverETL Support
Topic: Compare list with string
Replies: 1
Views: 488

Re: Compare list with string

Hi, The error is a result of trying to compare STRING with LIST of STRINGS - for equality - which of course does not work. What you need to do is to check whether the LIST contains your STRING. For this, the function containsValue() can be used. Your code could be re-written this way: for(integer i ...
by dpavlis
Sat Jan 23, 2016 4:49 pm
Forum: CloverETL Jobs
Topic: Posting to CloverETL Jobs section
Replies: 0
Views: 675

Posting to CloverETL Jobs section

This section is dedicated to CloverETL related expertise (commercial or non):

  • open positions (employment/contract)
  • help/services offers

Please note that all posts are moderated before approval.
by dpavlis
Mon Nov 23, 2015 4:51 pm
Forum: CloverETL Support
Topic: Hadoop Reader - Reading log file (JASON format)
Replies: 2
Views: 819

Re: Hadoop Reader - Reading log file (JASON format)

You may also use JSONExtract if you are processing large (>>100kB) files. JSONReader is using XPath queries for extracting data (need to build DOM representation in memory first). JSONExtract is using SAX style parsing (events) which allows stream-based parsing. Which one to use will depend on your ...
by dpavlis
Tue Oct 27, 2015 4:13 pm
Forum: CloverETL Support
Topic: Copy Book to SQL
Replies: 1
Views: 478

Re: Copy Book to SQL

Hi Anil, This is difficult to automate. What you could do is to use Cobol CopyBook metadata extract wizard to convert your CopyBook definitions into CloverETL metadata. Then you can use Clover's feature which allows to take existing metadata definition and create DB's DDL statement, which can be run...
by dpavlis
Tue Sep 29, 2015 7:08 pm
Forum: CloverETL Support
Topic: partition instance or partition number
Replies: 6
Views: 1164

Re: partition instance or partition number

Hi, after consulting with our R&D guys, you might use following two parameters which are globally set for any graph running in clustered mode: ⋅ WORKER_ID - ID (number) - of current worker - e.g. 1,2,3..up to WORKER_COUNT ⋅ WORKER_COUNT - how many workers are running/processi...
by dpavlis
Thu Sep 24, 2015 10:07 am
Forum: CloverETL Support
Topic: partition instance or partition number
Replies: 6
Views: 1164

Re: partition instance or partition number

It looks like you are mixing the concept of partitioning records in data flow into different output ports/edges in graph - for this Partition component can be used. It may be perceived as an "intelligent" CASE statement. You may send records out through different ports of the component bas...
by dpavlis
Fri Jul 24, 2015 3:24 pm
Forum: CloverETL Support
Topic: Reader and Writer component for Cassandra
Replies: 1
Views: 847

Re: Reader and Writer component for Cassandra

If you are skilled in Java, you might try to wrap a piece of Java code from following Datastax/Cassandra blog.
http://www.datastax.com/dev/blog/bulk-loading

A Reformat component or the new 4.1 version CustomJavaWriter component
might be used to create the solution.
by dpavlis
Tue May 19, 2015 9:57 pm
Forum: CloverETL Support
Topic: Oracle bind variables support
Replies: 2
Views: 545

Re: Oracle bind variables support

You may also look at DBJoin component . That is doing exactly what you asked - allows to set SQL query with parameters and then supply them through input port. For each record, query is executed and results sent out - actually the input record & record from DB would go to Transform function firs...

cron