[ANN] Bigtop-1.2 charms/bundles have been released

[Merlijn Sebrechts]

Awesome!

Some visibility improvements.

   - If you search for Hadoop <https://jujucharms.com/q/hadoop> in the
   Charm Store, the first results you get are the old non-bigtop charms. Can
   we do something about this? This is the same for Spark, Pig, etc..
   - The ancient "hadoop" <https://jujucharms.com/hadoop/trusty/16> Charms
   are still in the store and stil "recommended".
   - If you search for "bigtop", you only see one bundle while there are a
   bunch of bigtop bundles: https://jujucharms.com/q/bigtop?type=bundle
   - If you click on the search bar in the store without typing
   something[1] we see a bunch of old bigdata charms. This should show the
   latest and gratest.
   - The bigtop Spark charm doesn't seem to have bigtop in its icon?
   https://jujucharms.com/spark/ <https://jujucharms.com/spark/>
   - There are still a bunch of charms that don't list what version they
   install in the description.


[1]
[image: Inline afbeelding 1]

2017-04-25 18:54 GMT+02:00 Kevin Monroe <kevin.monroe at canonical.com>:

> Hi folks!
>
> After over a year in development, Apache Bigtop 1.2 was released earlier
> this month.  Today, we released updated charms and bundles for this release
> to the appropriate stable channels.
>
> HIGHLIGHTS:
>
> + Software versions:
> - hadoop-namenode 2.7.3
> - hadoop-plugin 2.7.3
> - hadoop-resourcemanager 2.7.3
> - hadoop-slave 2.7.3
> - hbase 1.1.3-1 **
> - kafka 0.10.1.1-1
> - mahout 0.12.2-1 **
> - pig 0.15.0
> - spark 2.1.0-1
> - zeppelin 0.7.0
> - zookeeper 3.4.6-1 **
>
> ** There is a planned bigtop-1.2.1 point release to bring in hotfixes.
> This will likely include hbase-1.1.9, mahout-0.13, and zookeeper-3.4.10.
> No charm changes are required; when these debs hit the upstream repo, the
> charms will provide the new version.
>
> + Juju 2.0 or greater
> - To leverage Juju Resources, bigtop-related charms now require Juju 2 or
> greater.
>
> + Usability
> - Refreshed READMEs and actions for a consistent UX
>
> + Hadoop-Spark
> - Reduced resource requirements.  Spark is not in HA mode in this bundle,
> so we removed 3 unnecessary zookeeper units.
>
> + Spark
> - New configuration to change driver/executor memory at runtime.
> - Improved spark reliability when changing execution mode (local,
> standalone, yarn).
>
>
> KNOWN ISSUES:
>
> + GCE
> - https://bugs.launchpad.net/juju/+bug/1674871
> - Most of our applications require a minimum of 7g ram.  We set a generic
> memory constraint in our bundles for a consistent experience across all
> clouds.  However, with GCE, mem=7G results in a "highcpu" instance type.
> These are significantly more expensive than "standard" instance types.
> - If "highcpu" instances are not required, workaround this issue by
> modifying a local copy of bundle.yaml.  For example:
>
> $ charm pull hadoop-processing
> cs:bundle/hadoop-processing-58
> $ cd hadoop-processing/
> $ sed -ie 's/mem=7G/instance-type=n1-standard-2/' bundle.yaml
> $ juju deploy ./bundle.yaml
>
> + Zeppelin
> - https://issues.apache.org/jira/browse/BIGTOP-2742
> - The init script for the zeppelin service is broken.  The charm will work
> around this during install and relation changes, but users may find that
> things like "sudo systemctl <action> zeppelin" on the unit do not work.
> - We'll update the zeppelin charm once an appropriate fix lands upstream.
>
>
> Please let me know if you have any questions or issues with the bigtop-1.2
> release.  Thanks!
> -Kevin Monroe
>
> --
> Juju mailing list
> Juju at lists.ubuntu.com
> Modify settings or unsubscribe at: https://lists.ubuntu.com/
> mailman/listinfo/juju
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.ubuntu.com/archives/juju/attachments/20170426/04d8e87f/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image.png
Type: image/png
Size: 53350 bytes
Desc: not available
URL: <https://lists.ubuntu.com/archives/juju/attachments/20170426/04d8e87f/attachment.png>