Search found 76 matches

by mzatopek
Wed Jul 03, 2013 3:38 pm
Forum: CloverETL Support
Topic: Large, Wide File Performance hints?
Replies: 3
Views: 1942

Re: Large, Wide File Performance hints?

Your investigation seems to be right. Look up from an array is definitely faster than look up from a map. So I recommend to use integer instead string lookup to a record's field. Regarding SetVal and GetVal classes, I do not see any big advantage in using these classes. The fastest way how to copy a...
by mzatopek
Tue May 14, 2013 9:05 am
Forum: CloverETL Support
Topic: Tweaking Memory Settings in Clover 3.3.0?
Replies: 13
Views: 5482

Re: Tweaking Memory Settings in Clover 3.3.0?

Hi Anna, the Clover 3.4 is actually done and will be released this week. Backport into 3.3 version is not planned, at least for now. Regarding your CloverString behaviour observation, you scary me a bit ;) This unnecessary backed char array cleanup could definitely harm overall performance. As I sai...
by mzatopek
Thu May 09, 2013 10:03 am
Forum: CloverETL Support
Topic: Tweaking Memory Settings in Clover 3.3.0?
Replies: 13
Views: 5482

Re: Tweaking Memory Settings in Clover 3.3.0?

Good point Anna,

this change could really easily increase memory footprint of our sorters. Duplicated string field should be optimized for memory usage instead of data manipulation.

See new issue https://bug.javlin.eu/browse/CLO-761

Thanks a lot for your investigation, good work.
by mzatopek
Tue May 07, 2013 2:53 pm
Forum: CloverETL Support
Topic: Tweaking Memory Settings in Clover 3.3.0?
Replies: 13
Views: 5482

Re: Tweaking Memory Settings in Clover 3.3.0?

Your observation about CloverString is interesting, since the CloverString is almost deep copy of formerly used StringBuilder. See the implementation, we added just couple new methods, but algorithm of memory allocation has been preserved. Even StringBuilder use 16 chars array to represent empty str...
by mzatopek
Tue Oct 16, 2012 10:22 am
Forum: CloverETL Support
Topic: Rollup java transofrmation + madapi.jar
Replies: 3
Views: 2533

Re: Rollup java transofrmation + madapi.jar

Hello Vadim, nice to hear you again :) Regarding your issue, I see you are still using archaic Clover version, hard to guess exact version. At least few years we don't use janino library for runtime compilation. Would it be possible to compile your custom code for Rollup component manually and use t...
by mzatopek
Tue Jul 24, 2012 1:29 pm
Forum: CloverETL Support
Topic: Custom Component
Replies: 1
Views: 1591

Re: Custom Component

Hello Stephen, please check implementation of checkConfig() method of your custom component. I guess you find there something like following code: if (!checkInputPorts(status, 1, 1) || !checkOutputPorts(status, 1, Integer.MAX_VALUE, false)) { return status; } Please, update parameters of these check...
by mzatopek
Mon Jun 25, 2012 12:48 pm
Forum: CloverETL Support
Topic: auto-generated key gets null pointer exception with MySQL
Replies: 3
Views: 2274

Re: auto-generated key gets null pointer exception with MySQL

You are definitely right, I have reported the issue:

http://bug.javlin.eu/browse/CL-2343

Martin
by mzatopek
Mon Jun 25, 2012 9:21 am
Forum: CloverETL Support
Topic: WebServiceClient - unable to read wsdl file from location
Replies: 4
Views: 3491

Re: WebServiceClient - unable to read wsdl file from location

Would you mind to test your webservice with our latest milestone release 3-3-M2? Some improvements were done there. Another bunch of fixes are sitting in our 3-3-M3, which is going to be released in few weeks.

Thanks, Martin
by mzatopek
Fri Jun 22, 2012 3:56 pm
Forum: CloverETL Support
Topic: auto-generated key gets null pointer exception with MySQL
Replies: 3
Views: 2274

Re: auto-generated key gets null pointer exception with MySQL

Hello, unfortunately the error message is not too descriptive. But according my investigation, this NPE is thrown in case the second output port is not attached. See our DBOutputTable documentation http://doc.cloveretl.com/documentation/UserGuide/topic/com.cloveretl.gui.docs/docs/dboutputtable.html ...
by mzatopek
Mon Mar 19, 2012 1:35 pm
Forum: CloverETL for Java Programmers
Topic: Best way to get a JDBC connection inside a custom transform?
Replies: 1
Views: 2230

Re: Best way to get a JDBC connection inside a custom transform?

Within your custom transformation code you can easily get a connection with following code: public class MyTrans extends DataRecordTransform { ... public boolean init() { DBConnection bdConnection = getGraph().getConnection(parameters.getProperty("myCustomPropertyNameWithConnectionId")); /...
by mzatopek
Tue Dec 13, 2011 10:39 am
Forum: CloverETL Support
Topic: bug in DataParser
Replies: 2
Views: 1844

Re: bug in DataParser

May I ask you to send an example of valid delimited file, which is not possible to be parsed by UniversalDataReader.

Thanks a lot.
by mzatopek
Mon Nov 07, 2011 5:35 pm
Forum: CloverETL Support
Topic: Reformat component : transform to Java
Replies: 2
Views: 1564

Re: Reformat component : transform to Java

Unfortunately it is not possible. This is only one way operation. If you saved the graph with java representation of transformation, you need to restore the former CTL2 code from your local history. Of course Unde/Redo operations work fine in this case as well.
by mzatopek
Mon Nov 07, 2011 5:29 pm
Forum: CloverETL Support
Topic: How to split up file
Replies: 1
Views: 1553

Re: How to split up file

If I understand right you have a single file with two different data records (user information and resposibility information). For this purpose we have special reader component - Complex Data Reader http://www.cloveretl.com/documentation/UserGuide/topic/com.cloveretl.gui.docs/docs/complexdatareader....
by mzatopek
Mon Nov 07, 2011 5:02 pm
Forum: CloverETL Support
Topic: Fast Sort BufferOverflowException
Replies: 12
Views: 8361

Re: Fast Sort BufferOverflowException

The clover engine configuration file can be changed even on clover server, see 'engine.config.file' property at http://server-demo-ec2.cloveretl.com/clover/docs/list-of-properties.html.