[Blueprint servercloud-q-bigdata-hadoop] Next steps for Hadoop on Ubuntu
James Page
james.page at ubuntu.com
Tue May 22 11:28:13 UTC 2012
Blueprint changed by James Page:
Whiteboard changed:
UDS Discussion Topics:
Quick 101 on current packaging and general approach.
- Based on binary distributions from upstream
- Re-use of Bigtop packaging where appropriate
- Rebuild of native components (to support 12.04 and ARM).
Alignment to next release of Apache Bigtop and potential collaboration (Ubuntu 12.04 will be the targetted release for Bigtop 0.4.0).
- Stick with Hadoop 1.x or move to 2.x (former 0.23) branch (or both).
- Process and technology for feeding back patches to Bigtop (not easy ATM).
- Work to support Ubuntu 12.04 as target version for Bigtop.
Updates to stable packages for Ubuntu 12.04
- Release/Testing process
OpenJDK7 as default Java in 12.10 - support from upstreams and testing process
Revisit packaging from source.
Testing of packages and functionality
Enable kerberos authentication in the current charmset?
Use of puppet modules in juju charms.
http://pad.ubuntu.com/uds-q-servercloud-q-bigdata-hadoop
User Stories:
- TBC
+ Toby want todo some testing of hadoop-2.0 prior to upgrading his
+ existing hadoop-1.0.x deployments. He is easily able to deploy a
+ hadoop-2.0 cluster using Juju and the hadoop charm from the Juju Charm
+ Store.
+
+ Frank likes the idea of using Juju to deploy hadoop but he's unsure
+ about the quality of the charms. He can easily see the depth of testing
+ being undertaken on each of the charms and decides that this is the
+ right choice for his deployment.
+
+ Janice wants to deploy a secure hadoop cluster. She is able to leverage
+ the hadoop charms inconjunction with kerberos to support this
+ requirement.
Assumptions:
- TBC
+ - hadoop-2.0 will be packaged alongside hadoop-1.0.x (different PPA or different pkg names).
+ - Hadoop will run OK on openjdk-7
+ - Suitable resources for regular testing of hadoop charms.
+ - Changes can be fed back to bigtop easily
+ -
Test Plans:
TBC
Release Note:
- TBC
+ N/A - still outside of the main archive.
--
Next steps for Hadoop on Ubuntu
https://blueprints.launchpad.net/ubuntu/+spec/servercloud-q-bigdata-hadoop
More information about the Ubuntu-server-bugs
mailing list