HUE... spark, hive, zeppelin

[Cory Johns]

(Adding the bigdata list.)

Thanks, Andrew.  I'd also like to add my own small PR:

https://github.com/juju-solutions/interface-spark/pull/3

Merlijn, I know you were interested in and perhaps working on Hue
yourself.  Hopefully there hasn't been too much parallel effort going on,
and hopefully this work benefits you.  Perhaps you could give it a review
as well?

On Thu, Feb 18, 2016 at 7:25 AM, Andrew Mcleod <andrew.mcleod at canonical.com>
wrote:

> Ok, so I'm done for HUE for the time being.
>
> !!!!!!! PLEASE REVIEW !!!!!!!
>
> https://github.com/juju-solutions/layer-apache-zeppelin/pull/3
> https://github.com/juju-solutions/layer-apache-spark/pull/7
> https://github.com/juju-solutions/layer-apache-hive/pull/8
> https://github.com/juju-solutions/interface-spark/pull/2
>
>
> I have changed some states (from related => joined and available => ready)
> in the spark interface and spark reactive (as discussed)
>
>
>
> *** benchmark layer / interface will need to be updated to join to this
> new spark layer*
>
> I've added the livy server into spark with some caveats:
>
> 1. The start and stop clauses are a bit dodgy (i dont know of a better way
> to do it right now, and the jps process name is "Main"...)
>
> 2. livy CLASSPATH is hard coded - `hadoop classpath` should return the
> right value, however i couldnt use the utils.env as it was putting a lone
> ‘=‘ after the classpath insertion, i.e /etc/environments looks like this:
>
> STUFF="thing"
> OTHERSTUFF="otherthing"
> CLASSPATH="/etc/dir:/dir:/dir:/dir............/dir/dir/dir"
> =
>
> ^ Equals sign out of nowhere.
>
>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.ubuntu.com/archives/bigdata/attachments/20160218/9c7c3812/attachment.html>