Can I write java code to access NoSQL DB (not MongoDB)?

Discussion on developing CloverETL engine, transformation components etc.

williambigdata
Posts: 3
Joined: Fri May 16, 2014 4:27 am

Can I write java code to access NoSQL DB (not MongoDB)?

Postby williambigdata » Fri May 16, 2014 4:37 am

Hi,

I want to access NoSQL DB from graph (not MongoDB), it seems that there's no available component currently. Is it possible to write Java code to implement this? And how?
It's a very urgent requirement.
Thank you in advance.

kubosj
Posts: 372
Joined: Thu Jan 12, 2012 9:10 am

Re: Can I write java code to access NoSQL DB (not MongoDB)?

Postby kubosj » Fri May 16, 2014 8:09 am

Hi William,

Easiest option would be to check whether your DB supports JDBC - some NoSQL DBs support subset of functionality through JDBC and sometimes it is enough. They you can try to use it with Clover. Some JDBC drivers works even if they are officially unsupported.

If you decide to write your own component I have some links for you:
* http://doc.cloveretl.com/documentation/ ... index.html
* Sources of DbInputTable and MongoDb* are available for download on SourceForge http://sourceforge.net/projects/cloveretl/ as part of OpenSource Engine so you can take a look on it
* JavaDoc is also available on SourceForge

We typically base our decision on particular DB support on customer requests. Can you please tell me what database you are interested in? It would help us. Thank you!
Jaroslav Kubos
CloverCARE Support
CloverETL | Rapid Data Integration

Visit us online at http://www.cloveretl.com

williambigdata
Posts: 3
Joined: Fri May 16, 2014 4:27 am

Re: Can I write java code to access NoSQL DB (not MongoDB)?

Postby williambigdata » Fri May 16, 2014 8:49 am

Hi kubosj,

Thank you very much for your quick answer.

Actually, what I want to access is Oracle NoSQL. I will try following your advice. And if JDBC does not work, I will try to create a new component. To be honest, this is a big challenge for me.

Best Regards,
William

kubosj
Posts: 372
Joined: Thu Jan 12, 2012 9:10 am

Re: Can I write java code to access NoSQL DB (not MongoDB)?

Postby kubosj » Fri May 16, 2014 11:47 am

Thank you for the info.

I also forget to mention one more possibility. If you task is small - for example one time import of single table - it may be easier to implement only http://doc.cloveretl.com/documentation/ ... rmers.html and use it in transformer.
Jaroslav Kubos
CloverCARE Support
CloverETL | Rapid Data Integration

Visit us online at http://www.cloveretl.com

williambigdata
Posts: 3
Joined: Fri May 16, 2014 4:27 am

Re: Can I write java code to access NoSQL DB (not MongoDB)?

Postby williambigdata » Wed May 28, 2014 3:35 am

Thank you very much, Kubos.

Sorry I was busy for another critical issue. Now it has been done, so I am back.

I successfully created a custom component by following the guide but not started to modify the code to access NoSQL DB yet.
From now on, I will try this.


cron