Well, it is not unsolvable. Metadata are in fact represented by an XML document. So using jobflows it is possible to pre-generate metadata, similarly as Eva suggested and set them any delimiters as engine allows. Basically create some sort of static/dynamic infrastructure. Below is a prototype how "metadata generator" could look like. The only thing missing is a graph, which will use external metadata, with parametrized fileUrl attribute. Of course, this one should run in jobflow prior the DB dump itself.
- metadata.PNG (26.25 KiB) Viewed 204 times
Pavel Švec | CloverETL | Sales Engineer | 2111 Wilson Blvd | Suite 320 | Arlington, VA 22201