<div dir="ltr">This is awesome, thanks for the update. <div><br></div><div>Also, you forgot to mention the addition of the NFS packages, which means CDK can now consume NFS storage OOTB in addition to having Ceph as a backend. </div><div><br></div><div>Great work folks :)</div><div><br></div><div>++</div><div>Sam</div></div><div class="gmail_extra"><br clear="all"><div><div class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div><br></div><div>--</div><div>Samuel Cozannet</div><div dir="ltr"><div>Cloud, Big Data and IoT Strategy Team<br><div>Business Development - Cloud and ISV Ecosystem</div><div>Changing the Future of Cloud<br><a href="http://ubuntu.com" target="_blank">Ubuntu</a> / <a href="http://canonical.com" target="_blank">Canonical UK LTD</a> / <a href="https://jujucharms.com" target="_blank">Juju</a><br></div><div><a href="mailto:samuel.cozannet@canonical.com" target="_blank">samuel.cozannet@canonical.com</a></div><div>mob: +33 616 702 389</div><div>skype: samnco<span></span><span></span><a href="http:///" target="_blank"></a></div><div>Twitter: @SaMnCo_23<br><a href="https://es.linkedin.com/in/scozannet" target="_blank"><img src="https://static.licdn.com/scds/common/u/img/webpromo/btn_liprofile_blue_80x15.png" style="font-size:12.8000001907349px" alt="View Samuel Cozannet's profile on LinkedIn"></a><br></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div>
<br><div class="gmail_quote">On Thu, Oct 13, 2016 at 9:53 PM, Charles Butler <span dir="ltr"><<a href="mailto:charles.butler@canonical.com" target="_blank">charles.butler@canonical.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><span id="m_975311334870564691inbox-inbox-docs-internal-guid-588e030b-bf9b-2bb5-2343-d61f11517371"><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:arial;background-color:transparent;font-weight:700;vertical-align:baseline;white-space:pre-wrap">10/13 Release Notes</span></p><br><p dir="ltr" style="line-height:1.656;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:arial;vertical-align:baseline;white-space:pre-wrap">Greetings everyone! It's been a short but busy week for us. We've landed a lot more bugfixes and some new features for you all to kick the tires. We're excited to push this week’s rollup as it contains the early work (alpha?) in consuming Ceph RBD volumes for persistent volume storage in your kubernetes workloads.</span></p><br><p dir="ltr" style="line-height:1.656;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:arial;vertical-align:baseline;white-space:pre-wrap">It’s missing from the readme, so here is a quick rundown below the release notes. As always, bugs/comments/questions are all welcome. </span><a href="https://github.com/juju-solutions/bundle-canonical-kubernetes/issues" style="text-decoration:none" target="_blank"><span style="font-size:14.6667px;font-family:arial;color:rgb(17,85,204);text-decoration:underline;vertical-align:baseline;white-space:pre-wrap">https://github.com/juju-<wbr>solutions/bundle-canonical-<wbr>kubernetes/issues</span></a></p><br><p dir="ltr" style="line-height:1.656;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:arial;vertical-align:baseline;white-space:pre-wrap">Or you can find us on irc in #juju on <a href="http://irc.freenode.net" target="_blank">irc.freenode.net</a></span></p><br><br><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:arial;background-color:transparent;font-weight:700;vertical-align:baseline;white-space:pre-wrap">Layer-docker</span></p><br><ul style="margin-top:0pt;margin-bottom:0pt"><li dir="ltr" style="list-style-type:disc;font-size:14.6667px;font-family:arial;background-color:transparent;vertical-align:baseline"><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;background-color:transparent;vertical-align:baseline;white-space:pre-wrap">Added DOCKER_OPTS passthrough config option. This enables end users to configure the runtime of their docker-engine (Such as insecure registries) without having to add python code to the layers and/or re-build a fork. </span></p></li></ul><ul style="margin-top:0pt;margin-bottom:0pt"><li dir="ltr" style="list-style-type:disc;font-size:14.6667px;font-family:arial;background-color:transparent;vertical-align:baseline"><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;background-color:transparent;vertical-align:baseline;white-space:pre-wrap">Corrected an immutable config when attempting to switch between archive docker package and the docker-engine package from upstream. </span></p></li></ul><br><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:arial;background-color:transparent;vertical-align:baseline;white-space:pre-wrap">Thanks @brianlbaird and @simonklb for driving this feature during dev/testing.</span></p><br><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:arial;background-color:transparent;font-weight:700;vertical-align:baseline;white-space:pre-wrap">Flannel</span></p><br><ul style="margin-top:0pt;margin-bottom:0pt"><li dir="ltr" style="list-style-type:disc;font-size:14.6667px;font-family:arial;background-color:transparent;vertical-align:baseline"><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;background-color:transparent;vertical-align:baseline;white-space:pre-wrap">Corrected the directory glob pattern on flannel which was failing and causing some false positives in the cloud weather report testing tool.</span></p></li></ul><br><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:arial;background-color:transparent;font-weight:700;vertical-align:baseline;white-space:pre-wrap">Kubernetes Master</span></p><ul style="margin-top:0pt;margin-bottom:0pt"><li dir="ltr" style="list-style-type:disc;font-size:14.6667px;font-family:arial;background-color:transparent;vertical-align:baseline"><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;background-color:transparent;vertical-align:baseline;white-space:pre-wrap">Added a create-rbd-pv action to enlist persistent storage from Ceph.</span></p></li><ul style="margin-top:0pt;margin-bottom:0pt"><li dir="ltr" style="list-style-type:disc;font-size:14.6667px;font-family:arial;background-color:transparent;vertical-align:baseline"><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;background-color:transparent;vertical-align:baseline;white-space:pre-wrap">This requires the use of the ceph-mon charm from the openstack-charmers-next branch. </span></p></li></ul><li dir="ltr" style="list-style-type:disc;font-size:14.6667px;font-family:arial;background-color:transparent;vertical-align:baseline"><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;background-color:transparent;vertical-align:baseline;white-space:pre-wrap">Closed a bug where running microbots would yield an EOF error due to proxy settings. Consult the README for limited egress environments. (Thanks @ryebot and @cynerva)</span></p></li></ul><br><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:arial;background-color:transparent;font-weight:700;vertical-align:baseline;white-space:pre-wrap">Kubernetes Worker</span></p><ul style="margin-top:0pt;margin-bottom:0pt"><li dir="ltr" style="list-style-type:disc;font-size:14.6667px;font-family:arial;background-color:transparent;vertical-align:baseline"><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;background-color:transparent;vertical-align:baseline;white-space:pre-wrap">Added a kubectl wrapper for context with manifests, and a kubectl wrapper for arbitrary keyword args.</span></p></li><li dir="ltr" style="list-style-type:disc;font-size:14.6667px;font-family:arial;background-color:transparent;vertical-align:baseline"><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;background-color:transparent;vertical-align:baseline;white-space:pre-wrap">Various lint fixes.</span></p></li><li dir="ltr" style="list-style-type:disc;font-size:14.6667px;font-family:arial;background-color:transparent;vertical-align:baseline"><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;background-color:transparent;vertical-align:baseline;white-space:pre-wrap">Worker nodes now cleanly remove themselves from the cluster during the stop hook. (Thanks to @ryebot and @cynerva)</span></p></li><li dir="ltr" style="list-style-type:disc;font-size:14.6667px;font-family:arial;background-color:transparent;vertical-align:baseline"><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;background-color:transparent;vertical-align:baseline;white-space:pre-wrap">The ingress controller now scales to the number of deployed worker units. 1 ingress controller per 1 worker unit. (Thanks to @ryebot and @cynerva)</span></p></li></ul><br><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:arial;background-color:transparent;font-weight:700;vertical-align:baseline;white-space:pre-wrap">Canonical Distribution of Kubernetes Bundle</span></p><br><ul style="margin-top:0pt;margin-bottom:0pt"><li dir="ltr" style="list-style-type:disc;font-size:14.6667px;font-family:arial;background-color:transparent;vertical-align:baseline"><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;background-color:transparent;vertical-align:baseline;white-space:pre-wrap">Added documentation for proxy settings in network limited environments to the bundle README. (Thanks to @ryebot and @cynerva)</span></p></li><li dir="ltr" style="list-style-type:disc;font-size:14.6667px;font-family:arial;background-color:transparent;vertical-align:baseline"><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;background-color:transparent;vertical-align:baseline;white-space:pre-wrap">Updated the README with additional limitation notes about which charms are not compatible enough to run in LXD at this time.</span></p></li><li dir="ltr" style="list-style-type:disc;font-size:14.6667px;font-family:arial;background-color:transparent;vertical-align:baseline"><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;background-color:transparent;vertical-align:baseline;white-space:pre-wrap">Bumped each charm to their latest revision.</span></p></li></ul><br><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:arial;background-color:transparent;font-weight:700;vertical-align:baseline;white-space:pre-wrap">Kubernetes Core Bundle</span></p><br><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:arial;background-color:transparent;vertical-align:baseline;white-space:pre-wrap">A minimalist bundle, only deploying the bare minimum required to evaluate kubernetes. Useful when doing laptop development or resource constrained environments. (Thanks @cynerva and @ryebot)</span></p><br><br><ul style="margin-top:0pt;margin-bottom:0pt"><li dir="ltr" style="list-style-type:disc;font-size:14.6667px;font-family:arial;background-color:transparent;vertical-align:baseline"><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;background-color:transparent;vertical-align:baseline;white-space:pre-wrap">The kubernetes core bundle has been updated with our latest release of the Canonical Distribution of Kubernetes (CDK) charms. </span></p></li><li dir="ltr" style="list-style-type:disc;font-size:14.6667px;font-family:arial;background-color:transparent;vertical-align:baseline"><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;background-color:transparent;vertical-align:baseline;white-space:pre-wrap">Brand new README imported from the CDK bundle.</span></p></li></ul><br><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><a href="https://github.com/juju-solutions/bundle-kubernetes-core" style="text-decoration:none" target="_blank"><span style="font-size:14.6667px;font-family:arial;color:rgb(17,85,204);background-color:transparent;text-decoration:underline;vertical-align:baseline;white-space:pre-wrap">https://github.com/juju-<wbr>solutions/bundle-kubernetes-<wbr>core</span></a><span style="font-size:14.6667px;font-family:arial;background-color:transparent;vertical-align:baseline;white-space:pre-wrap"> - we’re still testing this minimal bundle, and it will be published in the charm store as early as next week. Thanks for your early interest!</span></p><br><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:arial;background-color:transparent;font-weight:700;vertical-align:baseline;white-space:pre-wrap">Etcd</span></p><ul style="margin-top:0pt;margin-bottom:0pt"><li dir="ltr" style="list-style-type:disc;font-size:14.6667px;font-family:arial;background-color:transparent;vertical-align:baseline"><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;background-color:transparent;vertical-align:baseline;white-space:pre-wrap">Refactored the test to gate on the status messages before reading the deployment as ready and proceeding with executing tests.</span></p></li></ul><br><br><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:arial;background-color:transparent;font-weight:700;vertical-align:baseline;white-space:pre-wrap">Quick Rundown on how to enlist RBD PV’s</span></p><br><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:arial;background-color:transparent;vertical-align:baseline;white-space:pre-wrap">You’ll need to be running at bare-minimum the ceph-mon charm from the ~openstack-charmers-next namespace.</span></p><br><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:"ubuntu mono";background-color:transparent;vertical-align:baseline;white-space:pre-wrap">juju deploy cs:~openstack-charmers-next/<wbr>xenial/ceph-mon -n 3</span></p><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:"ubuntu mono";background-color:transparent;vertical-align:baseline;white-space:pre-wrap">juju deploy cs:ceph-osd -n 3</span></p><br><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:arial;background-color:transparent;vertical-align:baseline;white-space:pre-wrap">From here you will need to enlist the OSD storage devices:</span></p><br><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:arial;background-color:transparent;vertical-align:baseline;white-space:pre-wrap">For example on GCE you would fulfill this request with GCE Persistent Disks:</span></p><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:"ubuntu mono";background-color:transparent;vertical-align:baseline;white-space:pre-wrap">juju add-storage ceph-osd/0 osd-devices=gce,10gb</span></p><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:"ubuntu mono";background-color:transparent;vertical-align:baseline;white-space:pre-wrap">juju add-storage ceph-osd/1 osd-devices=gce,10gb</span></p><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:"ubuntu mono";background-color:transparent;vertical-align:baseline;white-space:pre-wrap">juju add-storage ceph-osd/2 osd-devices=gce,10gb</span></p><br><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:arial;background-color:transparent;vertical-align:baseline;white-space:pre-wrap">This will allocate 30gb of storage, across the 3 OSD device nodes, and begin your ceph replicated file storage cluster.</span></p><br><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:arial;background-color:transparent;vertical-align:baseline;white-space:pre-wrap">Next is to relate the storage cluster with the kubernetes master:</span></p><br><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:arial;background-color:transparent;vertical-align:baseline;white-space:pre-wrap">juju add-relation kubernetes-master ceph-mon</span></p><br><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:arial;background-color:transparent;vertical-align:baseline;white-space:pre-wrap">We’re now ready to enlist Persistent Volumes in Kubernetes which our workloads can consume via PersistentVolumeClaims</span></p><br><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:"ubuntu mono";background-color:transparent;vertical-align:baseline;white-space:pre-wrap">juju run-action kubernetes-master/0 create-rbd-pv name=test size=50</span></p><br><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:arial;background-color:transparent;vertical-align:baseline;white-space:pre-wrap">Tailing a watch on your kubernetes cluster like the following, you should see the PV become enlisted and be marked as available:</span></p><br><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:"ubuntu mono";background-color:transparent;vertical-align:baseline;white-space:pre-wrap">watch kubectl get pv --all-namespaces</span></p><br><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:"ubuntu mono";background-color:transparent;vertical-align:baseline;white-space:pre-wrap">NAME CAPACITY ACCESSMODES STATUS CLAIM REASON AGE</span></p><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:"ubuntu mono";background-color:transparent;vertical-align:baseline;white-space:pre-wrap">test 50M RWO Available <wbr>10s</span></p><br><br><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:arial;background-color:transparent;vertical-align:baseline;white-space:pre-wrap">To consume these Persistent Volumes, your pods will need an associated PVC with them, and is outside the scope of this tutorial. See: </span><a href="http://kubernetes.io/docs/user-guide/persistent-volumes/" style="text-decoration:none" target="_blank"><span style="font-size:14.6667px;font-family:arial;color:rgb(17,85,204);background-color:transparent;text-decoration:underline;vertical-align:baseline;white-space:pre-wrap">http://kubernetes.io/docs/<wbr>user-guide/persistent-volumes/</span></a><span style="font-size:14.6667px;font-family:arial;background-color:transparent;vertical-align:baseline;white-space:pre-wrap"> for more information.</span></p><br><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:arial;background-color:transparent;vertical-align:baseline;white-space:pre-wrap">This work is early so please let us know if you using storage and remember to open issues at: </span><a href="https://github.com/juju-solutions/bundle-canonical-kubernetes/issues" style="text-decoration:none" target="_blank"><span style="font-size:14.6667px;font-family:arial;color:rgb(17,85,204);background-color:transparent;text-decoration:underline;vertical-align:baseline;white-space:pre-wrap">https://github.com/juju-<wbr>solutions/bundle-canonical-<wbr>kubernetes/issues</span></a></p><span class="HOEnZb"><font color="#888888"><br></font></span></span></div><span class="HOEnZb"><font color="#888888"><div dir="ltr">-- <br></div><div data-smartmail="gmail_signature"><div dir="ltr"><span style="color:rgb(0,0,0);font-family:arial,helvetica,sans-serif;font-size:14.3px;line-height:17.6033px">Juju Charmer</span><br style="color:rgb(0,0,0);font-family:arial,helvetica,sans-serif;font-size:14.3px;line-height:17.6033px"><span style="color:rgb(0,0,0);font-family:arial,helvetica,sans-serif;font-size:14.3px;line-height:17.6033px">Canonical Group Ltd.</span><br style="color:rgb(0,0,0);font-family:arial,helvetica,sans-serif;font-size:14.3px;line-height:17.6033px"><span style="color:rgb(0,0,0);font-family:arial,helvetica,sans-serif;font-size:14.3px;line-height:17.6033px">Ubuntu - Linux for human beings | <a href="http://www.ubuntu.com" target="_blank">www.ubuntu.com</a></span><br><div><span style="color:rgb(0,0,0);font-family:arial,helvetica,sans-serif;font-size:14.3px;line-height:17.6033px">Juju - </span><span style="color:rgb(0,0,0);font-family:arial,helvetica,sans-serif;font-size:14.3px;line-height:17.6033px">The fastest way to model your application</span><span style="color:rgb(0,0,0);font-family:arial,helvetica,sans-serif;font-size:14.3px;line-height:17.6033px"> | <a href="http://www.jujucharms.com" target="_blank">www.jujucharms.com</a></span></div></div></div>
</font></span><br>--<br>
Juju mailing list<br>
<a href="mailto:Juju@lists.ubuntu.com">Juju@lists.ubuntu.com</a><br>
Modify settings or unsubscribe at: <a href="https://lists.ubuntu.com/mailman/listinfo/juju" rel="noreferrer" target="_blank">https://lists.ubuntu.com/<wbr>mailman/listinfo/juju</a><br>
<br></blockquote></div><br></div>