[Blueprint servercloud-q-bigdata-hadoop] Next steps for Hadoop on Ubuntu
James Page
james.page at ubuntu.com
Tue May 22 11:29:32 UTC 2012
Blueprint changed by James Page:
Whiteboard changed:
UDS Discussion Topics:
Quick 101 on current packaging and general approach.
- Based on binary distributions from upstream
- Re-use of Bigtop packaging where appropriate
- Rebuild of native components (to support 12.04 and ARM).
Alignment to next release of Apache Bigtop and potential collaboration (Ubuntu 12.04 will be the targetted release for Bigtop 0.4.0).
- Stick with Hadoop 1.x or move to 2.x (former 0.23) branch (or both).
- Process and technology for feeding back patches to Bigtop (not easy ATM).
- Work to support Ubuntu 12.04 as target version for Bigtop.
Updates to stable packages for Ubuntu 12.04
- Release/Testing process
OpenJDK7 as default Java in 12.10 - support from upstreams and testing process
Revisit packaging from source.
Testing of packages and functionality
Enable kerberos authentication in the current charmset?
Use of puppet modules in juju charms.
http://pad.ubuntu.com/uds-q-servercloud-q-bigdata-hadoop
User Stories:
Toby want todo some testing of hadoop-2.0 prior to upgrading his
existing hadoop-1.0.x deployments. He is easily able to deploy a
hadoop-2.0 cluster using Juju and the hadoop charm from the Juju Charm
Store.
Frank likes the idea of using Juju to deploy hadoop but he's unsure
about the quality of the charms. He can easily see the depth of testing
being undertaken on each of the charms and decides that this is the
right choice for his deployment.
Janice wants to deploy a secure hadoop cluster. She is able to leverage
the hadoop charms inconjunction with kerberos to support this
requirement.
Assumptions:
- hadoop-2.0 will be packaged alongside hadoop-1.0.x (different PPA or different pkg names).
- Hadoop will run OK on openjdk-7
- Suitable resources for regular testing of hadoop charms.
- Changes can be fed back to bigtop easily
- -
+ - All work will also target Ubuntu 12.04 as well as 12.10
+ - No new releases of components/charms for Ubuntu 11.10.
Test Plans:
TBC
Release Note:
N/A - still outside of the main archive.
--
Next steps for Hadoop on Ubuntu
https://blueprints.launchpad.net/ubuntu/+spec/servercloud-q-bigdata-hadoop
More information about the Ubuntu-server-bugs
mailing list