How best to install Spark?

[Ken Williams]

Hi Sam (and Maarten),

    Cloning Spark 1.2.0 from github seems to have worked!
    I can install the Spark examples afterwards.

    Thanks for all your help!

    Yes - Andrew and Angie both say 'hi'  :-)

    Best Regards,

Ken


On 28 January 2015 at 16:43, Samuel Cozannet <samuel.cozannet at canonical.com>
wrote:

> Hey Ken,
>
> So I had a closer look to your Spark problem and found out what went wrong.
>
> The charm available on the charmstore is trying to download Spark 1.0.2,
> and the versions available on the Apache website are 1.1.0, 1.1.1 and
> 1.2.0.
>
> There is another version of the charm available on GitHub that actually
> will deploy 1.2.0
>
> 1. On your computer, the below folders & get there:
>
> cd ~
> mkdir charms
> mkdir charms/trusty
> cd charms/trusty
>
> 2. Branch the Spark charm.
>
> git clone https://github.com/Archethought/spark-charm spark
>
> 3. Deploy Spark from local repository
>
> juju deploy --repository=~/charms local:trusty/spark spark-master
> juju deploy --repository=~/charms local:trusty/spark spark-slave
> juju add-relation spark-master:master spark-slave:slave
>
> Worked on AWS for me just minutes ago. Let me know how it goes for you.
> Note that this version of the charm does NOT install the Spark examples.
> The files are present though, so you'll find them in
> /var/lib/juju/agents/unit-spark-master-0/charm/files/archive
>
> Hope that helps...
> Let me know if it works for you!
>
> Best,
> Sam
>
>
> Best,
> Samuel
>
> --
> Samuel Cozannet
> Cloud, Big Data and IoT Strategy Team
> Business Development - Cloud and ISV Ecosystem
> Changing the Future of Cloud
> Ubuntu <http://ubuntu.com>  / Canonical UK LTD <http://canonical.com> /
> Juju <https://jujucharms.com>
> samuel.cozannet at canonical.com
> mob: +33 616 702 389
> skype: samnco
> Twitter: @SaMnCo_23
>
> On Wed, Jan 28, 2015 at 4:44 PM, Ken Williams <ken.w at theasi.co> wrote:
>
>>
>> Hi folks,
>>
>> I'm completely new to juju so any help is appreciated.
>>
>> I'm trying to create a hadoop/analytics-type platform.
>>
>> I've managed to install the 'data-analytics-with-sql-like' bundle
>> (using this command)
>>
>>     juju quickstart
>> bundle:data-analytics-with-sql-like/data-analytics-with-sql-like
>>
>> This is very impressive, and gives me virtually everything that I want
>> (hadoop, hive, etc) - but I also need Spark.
>>
>> The Spark charm (http://manage.jujucharms.com/~asanjar/trusty/spark)
>> and bundle (
>> http://manage.jujucharms.com/bundle/~asanjar/spark/spark-cluster)
>> however do not seem stable or available and I can't figure out how to
>> install them.
>>
>> Should I just download and install the Spark tar-ball on the nodes
>> in my AWS cluster, or is there a better way to do this ?
>>
>> Thanks in advance,
>>
>> Ken
>>
>>
>> --
>> Juju mailing list
>> Juju at lists.ubuntu.com
>> Modify settings or unsubscribe at:
>> https://lists.ubuntu.com/mailman/listinfo/juju
>>
>>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.ubuntu.com/archives/juju/attachments/20150128/4e433459/attachment.html>