Hadoop/zeppelin setup

[Kevin Monroe]

Hi Ross, i'm happy to help figure out what's going on with your
csv/hadoop/zeppelin issue.

Which guide are you following to setup hadoop/zeppelin?  It could be we
have stale docs out there.  The zeppelin charm readme [1] has up to date
deployment instructions and comes with a notebook that does something
similar to what you're describing.  In short, the steps are:

$ juju deploy hadoop-processing
$ juju deploy zeppelin
$ juju add-relation zeppelin plugin
$ juju expose zeppelin

Watch the deployment with 'watch juju status', and once all applications
have settled to ready, you can browse to the zeppelin UI at:

http://<zeppelin-public-address>:9080

Take a look at the "Zeppelin HDFS Tutorial".  The first scala paragraph
essentially uses shell commands to wget and copy a csv file into hdfs.  I
think this might be similar to what you're trying to do.  Subsequent
paragraphs transform the csv into a table that zeppelin/spark can process,
which later paragraphs use to do some simple sql queries.

Hopefully that serves as a good example of working with csv files in
hadoop/zeppelin, but if you're getting stuck somewhere else, please let us
know!

[1] https://jujucharms.com/zeppelin/

Thanks,
-Kevin

On Mon, Nov 7, 2016 at 10:39 AM, Ross Doyle <weemanrd at gmail.com> wrote:

> Hello
>
> I recently used your guide to setup a juju hadoop and zeppelin setup on my
> localhost. However I am having trouble with the uploading of a csv file
> into my hadoop database to then call from zeppelin. If there's anything
> that I'm doing wrong, please let me know.
>
> Thank you, Ross.
>
> --
> Bigdata mailing list
> Bigdata at lists.ubuntu.com
> Modify settings or unsubscribe at: https://lists.ubuntu.com/
> mailman/listinfo/bigdata
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.ubuntu.com/archives/bigdata/attachments/20161110/87be9a3d/attachment.html>