Low-Cost data migration and ETL tools

    This site uses cookies. By continuing to browse this site, you are agreeing to our Cookie Policy.

    • Low-Cost data migration and ETL tools

      Hi, Im building a database for my company. We are a rather small size book company with a lot of references and still growing.

      We have a Mysql database here and are trying to find some good tools to use it at its best. Basically we are just starting up the database after dealing with Excel: we had a size problem… So im trying to find a program that will allow us to do two different things: the migration of our data from the old system to the new one and a specialized software to perform ETL (Extract, transform and load) on our database.

      About the price of the tools, if we were one year ago, the accounting department would have been pretty relaxed about this. But today, we have some budget restrictions and therefore need a low cost tool. So could you give me some advice on a good data migration and etl tool for a low cost?

      Thanks for your help.
    • RE: Low-Cost data migration and ETL tools

      If your focus is purely Palo, then Jedox's own ETL Server will handle most ETL requirements. For a more generalised ETL tool, Talend would be my choice, but Pentaho's PDI (aka Kettle) is also very good (both also have Palo add-ins).

      As for the cost, all three are free and open source.

      Tom
    • Hi,

      Some companies have budget problems and are having to reduce their cost of operation.

      Have you ever heard of open source tools? They can do the job easily and less expensive than proprietary solutions that cost a lot of money.

      As Gleesoto says in the previous post, you can have a look at a good ETL open source program called Talend Open Studio: it is user-friendly but also has advanced features intended for technical users (java debugger, code injection…). It can perform data migration and ETL.

      The website is talend.com/solutions-data-integration/data-migration.php to download the open source program. They have a forum and documentation you can read. Tell us what you think about the software.

      For an ETL benchmark: blogs.sun.com/aja/entry/talend_s_new_data_processing
    • Hi Tgroul,

      Since you are advertising for Talend, are you guys able to provide some step to step instructions on integration with Palo.

      Of all the ETL tools, I find Talend the hardest one to get my head around.

      I have successfully being able to do a basic import in Kettle. I have been able to use Cubeware IMP:PALO. I have been able to use ETL server 3.0 with relative ease, but it is just impossible to get Talend up and running no matter how hard I try!!!



      Kind Regards,

      Jimmy
    • Hi Expresson and Axi,

      First, Talend Open Studio has many components for different programs. Including Palo. You can check our component page: talendforge.org/components/index.php .

      Second, you might also want to check out the tutorials page where you will get all the information you need to get started with Talend and do an import with the tool: talendforge.org/tutorials/menu.php

      And then, if you still have problems to resolve, you can chat with the community and use the bugtracker.

      All of these solutions are given to you for free!

      The post was edited 1 time, last by Tgroul ().

    • Talend's Palo connector is very limited, handles only 'value' loads (i.e fact table loads), the hard work associated with OLAP ETL is the handling of dimensional changes. Kettle's Palo Add-in is much better (but there has been some confusion over versions, which I think is now resolved).

      Cubeware IMP is a nice product, but it's closed source and the free version is time limited (no guarantee it'll work after 12 months) and I think has limits on what size of dataset it can handle.

      But if your focus is Palo, Jedox's own ETL tool would be the obvious choice.

      Tom
    • Dude,

      Given that you work for Talend, maybe you should be our representative to Talend.

      Why don't we play this the other way round.

      Why don't you download the free and open source version of PALO ETL and figure out the functionalities that Tal-End doesn't have and add to it. Hint: There is a lot................(Hint: Look under Transformation)

      If you have a look at the PALO transformation options such as "Tree FH", "Tree NC", "Tree FC", they are all good places to start.

      So far, I have been able to use the Palo ETL to do everything including loading up my SQL database. Don't see why I need to try to learn another!

      These things are not "Bugs", these things are enhancements. What's the point of trying to log it with the tech team when there is the possibility of no action? Wouldn't I be better off just using Palo ETL?

      As I said before, the problem with Talend starts off where it is really hard to get the god damn thing up and running! I have used many other ETL tools and have been able to figure it out, so therefore it must be your tool (and your tutorial!) that's turning people off in even trying to use it for Palo.

      JH
    • Having experienced TM1's recommendation of third party ETL tools before they got off their backside and develeoped their own Turbo Integrator, I'd be quite cautious of relying on any 3rd party tool.

      The problem is that the 3rd party developers don't have the inside track and you can't assume that any third party tool will continue to work when Jedox relase a new version of Palo.

      Sad but true, which is why I would always choose the Jedox version of a component like ETL or Web as long as it works properly.
      Best wishes

      John Hobson
      The Planning Factory, Lytham, UK
      www.planfact.co.uk
    • Talend Open Studio

      I think Talend Open Studio is an excellent choice. Open Source, powerfull, easy to use and learn. It's a tool focused on data integration in general. Here you can find some slides:
      robertomarchetto.com/www/talend_open_studio_slides

      A comparison on Pentaho Kettle and Talend is here:
      robertomarchetto.com/www/talen…tle_pentao_pdi_comparison
      Business intelligence consultant
      http://www.robertomarchetto.com

      The post was edited 1 time, last by robertom ().