Re: Multi install with existing MAAS starts all services except for “IP Pending” on Glance Simplestreams Image Sync

[Jeff McLamb]

OK a quick look at the neutron-api/0 /var/log/neutron just shows the
neutron-server.log as before… but since I stepped away in the past
hour it’s now at 800MB and counting! ;)

I will play around with the relations a bit just to learn what’s going
on, but then I will take your advice and try various alternatives with
—edit-placement first, then finally just changing the underlying MAAS
deployment server to trusty and see where it takes me. Could also try
to install without —upstream-ppa which I imagine will install juno
instead of kilo?

Will keep you posted and continued thanks for all the help.

Jeff

On Wed, Jul 29, 2015 at 7:08 PM, Mike McCracken
<mike.mccracken at canonical.com> wrote:
> Jeff, based on the other logs you sent me, e.g. neutron-metadata-agent.log,
> it was pointed out to me that it's trying to connect to rabbitMQ on
> localhost, which is wrong.
> So something is failing to complete the juju relations.
> My hypothesis is that the failing vivid-series charm is messing up juju's
> relations.
> If you want to dig further, you can start looking at the relations using
> e.g. 'juju run --unit 'relation-get amqp:rabbitmq' ' (might just be 'amqp')
>
> Or if you'd like to try just redeploying without the sync charm using
> --edit-placement, that might get a healthy cluster going, just one without
> glance images.
> Then you could pretty easily deploy the charm manually, or just do without
> it and upload images you get from cloud-images.ubuntu.com manually .
>
> Sorry this is not as simple as it should be, yet :)
> -mike
>
> On Wed, Jul 29, 2015 at 4:00 PM, Mike McCracken
> <mike.mccracken at canonical.com> wrote:
>>
>> ok, so I just learned that the neutron-manage log should be in the
>> neutron-api unit, so can you 'juju ssh neutron-api/0' and look in
>> /var/log/neutron there?
>>
>> On Wed, Jul 29, 2015 at 3:34 PM, Jeff McLamb <mclamb at gmail.com> wrote:
>>>
>>> The neutron-server.log that is 500MB+ and growing is nonstop repeated
>>> output of the following, due to a database table that does not exist:
>>>
>>> http://paste.ubuntu.com/11962679/
>>>
>>> On Wed, Jul 29, 2015 at 6:30 PM, Jeff McLamb <mclamb at gmail.com> wrote:
>>> > Hey Mike -
>>> >
>>> > OK so here is the juju status output. The quantum-gateway doesn’t look
>>> > too strange, but I am new. The exposed status is false, but so it is
>>> > for all services, and I can definitely access, say, the dashboard,
>>> > even though it is not “exposed”. One thing of note is the
>>> > public-address lines that sometimes use the domain names, e.g.
>>> > downright-feet.maas in this case, whereas some services use IP
>>> > addresses. I have noticed that I cannot resolve the maas names from
>>> > the MAAS server (because I use the ISP’s DNS servers) but I can
>>> > resolve them from the deployed nodes.  Here is the output:
>>> >
>>> > http://paste.ubuntu.com/11962631/
>>> >
>>> > Here is the quantum gateway replay:
>>> >
>>> > http://paste.ubuntu.com/11962644/
>>> >
>>> > Where are the neutron-manage logs? I see lots of neutron stuff on
>>> > various containers and nodes — the neutron-server.log is what I pasted
>>> > before and it is 500+MB and growing across a few nodes, but I can’t
>>> > seem to fine neutron-manage.
>>> >
>>> > Thanks!
>>> >
>>> > Jeff
>>> >
>>> >
>>> > On Wed, Jul 29, 2015 at 5:26 PM, Mike McCracken
>>> > <mike.mccracken at canonical.com> wrote:
>>> >> Hi Jeff, I asked internally and was asked if you could share the juju
>>> >> charm
>>> >> logs from quantum-gateway and the neutron-manage logs in
>>> >> /var/log/neutron.
>>> >>
>>> >> the charm log can be replayed by using 'juju debug-log -i
>>> >> quantum-gateway/0
>>> >> --replay'
>>> >>
>>> >> On Wed, Jul 29, 2015 at 2:03 PM, Mike McCracken
>>> >> <mike.mccracken at canonical.com> wrote:
>>> >>>
>>> >>> Sorry this is so frustrating.
>>> >>> Can you check 'juju status' for this environment and see if it says
>>> >>> anything useful about the quantum-gateway service (aka neutron, the
>>> >>> juju
>>> >>> service name will be updated soon).
>>> >>>
>>> >>> -mike
>>> >>>
>>> >>> On Wed, Jul 29, 2015 at 1:15 PM, Jeff McLamb <mclamb at gmail.com>
>>> >>> wrote:
>>> >>>>
>>> >>>> OK, making progress now. Per your recommendation I removed and added
>>> >>>> back in the trusty sync charm manually.
>>> >>>>
>>> >>>> Now, I can log in to the horizon dashboard!
>>> >>>>
>>> >>>> However, several tabs result in a generic OpenStack (not
>>> >>>> Ubuntu-customized like the general dashboard pages) "Something went
>>> >>>> wrong! An unexpected error has occurred. Try refreshing the page..."
>>> >>>>
>>> >>>> The tabs in question that give those results are Compute -> Access &
>>> >>>> Security, Network -> Network Topology,
>>> >>>>
>>> >>>> When I go to pages like Network -> Routers, it does render, but
>>> >>>> there
>>> >>>> are error popup boxes in the page itself with:
>>> >>>>
>>> >>>> Error: Unable to retrieve router list.
>>> >>>>
>>> >>>> and
>>> >>>>
>>> >>>> Error: Unable to retrieve a list of external networks "Connection to
>>> >>>> neutron failed: HTTPConnectionPool(host='192.168.1.45', port=9696):
>>> >>>> Max retries exceeded with url:
>>> >>>> /v2.0/networks.json?router%3Aexternal=True (Caused by <class
>>> >>>> 'httplib.BadStatusLine'>: '')”.
>>> >>>>
>>> >>>> If I do a `juju ssh openstack-dashboard/0` and tail -f
>>> >>>> /var/log/apache2/error.log I get the following when accessing one of
>>> >>>> the failed pages:
>>> >>>>
>>> >>>> http://paste.ubuntu.com/11961863/
>>> >>>>
>>> >>>> Furthermore, looking at the neutron server logs, I see non-stop
>>> >>>> traces
>>> >>>> about the neutron.ml2_gre_allocations table not existing:
>>> >>>>
>>> >>>> http://paste.ubuntu.com/11961891/
>>> >>>>
>>> >>>> Getting closer, bit by bit.
>>> >>>>
>>> >>>> Thanks for all the help,
>>> >>>>
>>> >>>> Jeff
>>> >>>
>>> >>>
>>> >>>
>>> >>
>>
>>
>