Using Kettle on Windows with Palo

This site uses cookies. By continuing to browse this site, you are agreeing to our Cookie Policy.

  • Using Kettle on Windows with Palo

    Hi!

    I would like to share my experience with using Kettle on Windows with Palo.
    Kettle with Palo works!!

    I have downloaded the Kettle version that is customized with a plugin for Palo.
    It includes import and export to Palo Cube and includes also Palo Rules.

    The download address is 3a-strategy.com/public_files/kettle/
    I tested Palo on the Foodmart datawarehouse sample.

    After installation, I tried to import a fact table into a Palo cube using Kettle.

    I got the following error...

    2007/07/07 15:47:29 - Spoon - Transformation opened.
    2007/07/07 15:47:29 - Spoon - Launching transformation [Foodmart]...
    2007/07/07 15:47:29 - Spoon - Started the transformation execution.
    2007/07/07 15:47:29 - Foodmart - Dispatching started for transformation [Foodmart]
    2007/07/07 15:47:29 - Foodmart - Nr of arguments detected:10
    2007/07/07 15:47:29 - Foodmart - This is not a replay transformation
    2007/07/07 15:47:29 - Foodmart - This transformation can be replayed with replay date: 2007/07/07 15:47:29
    2007/07/07 15:47:29 - Foodmart - Initialising 3 steps...
    2007/07/07 15:47:29 - Fact 1997 input from Foodmart.0 - Starting to run...
    2007/07/07 15:47:30 - Palo output.0 - Starting to run...
    2007/07/07 15:47:30 - Java Script Value.0 - Starting to run...
    2007/07/07 15:47:32 - Fact 1997 input from Foodmart.0 - linenr 5000
    2007/07/07 15:47:32 - Java Script Value.0 - linenr 5000
    2007/07/07 15:47:34 - Palo output.0 - ERROR (version 2.3.1, build 60 from 2007/01/27 15:30:24) : Unexpected error in '' : com.tensegrity.palojava.PaloException: dimensionAddOrUpdateDimElement failed: 1015 invalid session old session identifier
    2007/07/07 15:47:34 - Palo output.0 - ERROR (version 2.3.1, build 60 from 2007/01/27 15:30:24) : com.tensegrity.palojava.PaloException: dimensionAddOrUpdateDimElement failed: 1015 invalid session old session identifier
    2007/07/07 15:47:34 - Palo output.0 - ERROR (version 2.3.1, build 60 from 2007/01/27 15:30:24) : at com.tensegrity.palojava.http.ConnectionHttp.dimensionAddOrUpdateDimElement(ConnectionHttp.java:614)
    2007/07/07 15:47:34 - Palo output.0 - ERROR (version 2.3.1, build 60 from 2007/01/27 15:30:24) : at org.palo.api.impl.DimensionImpl.addElementInternal(DimensionImpl.java:287)
    2007/07/07 15:47:34 - Palo output.0 - ERROR (version 2.3.1, build 60 from 2007/01/27 15:30:24) : at org.palo.api.impl.DimensionImpl.addElements(DimensionImpl.java:343)
    2007/07/07 15:47:34 - Palo output.0 - ERROR (version 2.3.1, build 60 from 2007/01/27 15:30:24) : at be.ibridge.kettle.trans.step.palooutput.PaloOutput.processDataBuffer(PaloOutput.java:270)
    2007/07/07 15:47:34 - Palo output.0 - ERROR (version 2.3.1, build 60 from 2007/01/27 15:30:24) : at be.ibridge.kettle.trans.step.palooutput.PaloOutput.addBuffer(PaloOutput.java:204)
    2007/07/07 15:47:34 - Palo output.0 - ERROR (version 2.3.1, build 60 from 2007/01/27 15:30:24) : at be.ibridge.kettle.trans.step.palooutput.PaloOutput.processRow(PaloOutput.java:107)
    2007/07/07 15:47:34 - Palo output.0 - ERROR (version 2.3.1, build 60 from 2007/01/27 15:30:24) : at be.ibridge.kettle.trans.step.palooutput.PaloOutput.run(PaloOutput.java:582)
    2007/07/07 15:47:34 - Palo output.0 - Finished processing (I=0, O=0, R=9000, W=0, U=0, E=1
    2007/07/07 15:47:34 - Foodmart - ERROR (version 2.3.1, build 60 from 2007/01/27 15:30:24) : Errors detected!
    2007/07/07 15:47:34 - Foodmart - Looking at step: Fact 1997 input from Foodmart
    2007/07/07 15:47:34 - Fact 1997 input from Foodmart.0 - Finished reading query, closing connection.
    2007/07/07 15:47:34 - Fact 1997 input from Foodmart.0 - Finished processing (I=9809, O=0, R=0, W=9807, U=0, E=0
    2007/07/07 15:47:34 - Foodmart - Looking at step: Java Script Value
    2007/07/07 15:47:34 - Java Script Value.0 - Finished processing (I=0, O=0, R=9641, W=9640, U=0, E=0
    2007/07/07 15:47:34 - Foodmart - Looking at step: Palo output
    2007/07/07 15:47:34 - Spoon - The transformation has finished!!

    -----------------
    After contacting Axel Kiselev of 3a-Strategy, he responded as follows...
    ....
    The error 'old session identifier' appears when session timeout happens - version of jpalo which was bundled with kettle suite has this small bug - it does not reconnect after long inactivity periods... so, the answer should be very simple - just open propeties of the connection used in Palo Output step ant press Test button - this will cause forse reconnect - that should resovle your issue.
    ....
    I did as instructed and it worked like a gem.

    I would like to encourage others to use this solution for ETL work with Palo.


    Herman

  • RE: Using Kettle on Windows with Palo

    Hello,

    I'm already using it since it was available. I should say that it works really fine with siple cube, but I should say that I ecountered some problem (still not solved) in defining aggregate dimension.

    In particular when I run twice the function that create an aggregate this de-aggregate first chid element. If I run it again the second element is de-aggregated too, and so on....

    I aked for suggestions to Axel but still got no answare....so I came back to VBA and I'm using Kettle to prepare data to be loaded.

    So, It's really a good tool but be carefull (and of course if you can understand why it heppens I hope you will let me know !!!)

    Good luck,

    Paolo

  • RE: Using Kettle on Windows with Palo

    I found that creating dimensions on excel is good.
    I use Kettle only for uploading the cube (fact table).

    I think most of the problems with loading of dimension has to do with the loading sequence of the dimension table.

    Do the query and select only the aggregates only first.
    The query should also sort it such that the aggregates are built up properly.

    Then do another load to attach the members to the bottom of the aggregates.