Assume you have a small project which on the surface looks like a good match for an ETL tool like Talend.
But assume further, that you have never used Talend and furthermore, you do not trust "visual programming" tools in general and would rather code everything the old fashioned way (text on a nice IDE!) with the help of an appropriate language & support libraries.
What are some language patterns & support libraries that could help you stay away from the ETL tool temptation/trap?
It depends on whether the deliverable is the processor or the output itself. If you just need to deliver the output, you don t need to maintain the code. If the code needs to be maintained then will it be you maintaining it or somebody else?
If somebody else needs to maintain I d use Java or give them Talend.
If it s throwaway code, I d use what will be easier or fun to program with.
If you need to maintain it and the processing is complex, I d use Scala. It has:
I used to think that "visual programming" is something for people who can t program. Then I was exposed to Talend in a project, and I realized that this type of tool is exactly right for the job, when it comes to moving data from A to B, and transforming it in the process. It s component-oriented software design, by a more academic label.
I still consider myself a decent programmer who can do anything, and then some, with a text editor and a shell prompt. But I ve become a big fan of Talend as well.
Full disclosure: I now work for the company :-)
Check out DataExpress. It s a Scala-based, cross-database ETL toolkit.
I think this is a pretty good match for Rails-inspired frameworks, such as Grails on Groovy or Lift on Scala.
Depending on the size of the DB schema, you could map everything real quick in Hibernate and just use the resulting object model to do your work (depending on what you want the ETL tool for anyways)
Hi have this j2ee web application developed using spring framework. I have a problem with rendering mnessages in nihongo characters from the properties file. I tried converting the file to ascii using ...
Check this, List<String> list = new ArrayList<String>(); for (int i = 0; i < 10000; i++) { String value = (""+UUID.randomUUID().getLeastSignificantBits()).substring(3, ...
I am in the middle of solving a problem where I think it s best suited for a decorator and a state pattern. The high level setting is something like a sandwich maker and dispenser, where I have a set ...
I have been trying to execute a MS SQL Server stored procedure via JDBC today and have been unsuccessful thus far. The stored procedure has 1 input and 1 output parameter. With every combination I ...
I have a system which contains multiple applications connected together using JMS and Spring Integration. Messages get sent along a chain of applications. [App A] -> [App B] -> [App C] We set a ...
If I m given two Java Libraries in Jar format, 1 having no bells and whistles, and the other having lots of them that will mostly go unused.... my question is: How will the larger, mostly unused ...
I have a Class variable that holds a certain type and I need to get a variable that holds the corresponding array class. The best I could come up with is this: Class arrayOfFooClass = java.lang....
I m working on a Java desktop application that reads and writes from/to different files. I think a better solution would be to replace the file system by a SQLite database. How hard is it to migrate ...
