Read dynamic xml data and store it in databse using CloverETL

Discussion on developing CloverETL engine, transformation components etc.

SaSuSri
Posts: 4
Joined: Thu May 25, 2017 7:58 am

Read dynamic xml data and store it in databse using CloverETL

Postby SaSuSri » Thu May 25, 2017 9:09 am

Hi Guys,

Could you please help me on reading XML data(Where xml files will be different in each time) and store the data into databases.

I am very new to CloverETL, and I could see some post related XML Reader and XML Extract but I am not sure how to use it on our applications and how to call those.

Please help me on this as soon as possible.

Thanks in Advance!
Sai Chaitanya

SaSuSri
Posts: 4
Joined: Thu May 25, 2017 7:58 am

Re: Read dynamic xml data and store it in databse using CloverETL

Postby SaSuSri » Fri May 26, 2017 9:40 am

Can some one help me on this its very urgent requirement.
Thank you!

bartonv
Posts: 25
Joined: Wed May 03, 2017 12:10 pm

Re: Read dynamic xml data and store it in databse using CloverETL

Postby bartonv » Mon May 29, 2017 2:12 pm

Hello Sai,
let’s break this down into 2 separate topics based on your question: reading data from XML files and writing the data into databases.
A. Reading XML files
There are several options how you can read the XML files using the CloverETL Designer. It can be done either by using the XMLExtract, XMLReader or XMLPathReader component. Generally, it is suggested to use the XMLExtract as it can offer a graphical user interface that would help you map elements to records. All you need to do to make the XMExtract component work is to fill in the source File URL and define the Mapping. Please find more information about the mapping in our online documentation for CloverETL Designer or in the following video, although it concerns an older Clover version (https://youtu.be/18jkmcMI11M).
B. Writing into databases
There are also many options in the CloverETL Designer how to write data into a database. In general, it is recommended to use the DBOutputTable component that is capable of writing into many different sorts of databases by using the JDBC driver. Feel free to review the detailed instructions on how to use this component.
CloverETL Designer also provides a number of specialized database writer components that can be useful in specific scenarios. However, they generally require a more complex setup and might also demonstrate certain limitations (e.g. both the Designer and the database must reside on the same machine in some cases). Picking the proper database writer component also largely depends on which sort of database you need to write the data into, for example, HadoopWriter (writes into the Hadoop database), MongoDBWriter (writes into the Mongo database), MSQLDataWriter (writes into the MS SQL database) etc. I would suggest reading our CloverETL Designer documentation for the specific database writer component that you might consider to use.
You can also find much useful information on our CloverETL Forum while searching for particular keywords (http://forum.cloveretl.com/).
If you are looking for more specific information or if you are facing a particular issue with your CloverETL graph, feel free to come back to us with a specific question, screenshot or attachment.
Regards,
---
Vladimir Barton
CloverCARE Support
CloverETL | Rapid Data Integration

Visit us online at http://www.cloveretl.com
How to speed up communication with CloverCARE support