[ubuntu-cloud] All instances remain in state "pending"

graziano obertelli graziano at eucalyptus.com
Thu Feb 3 06:32:02 UTC 2011


On Wed, Feb 02, 2011 at 05:49:26PM +0100, Andreas wrote:
> Hi Graziano,
> 
> here is an extract of the nc.log
> It says: error: insufficient disk capacity remaining (2043MB) in VM
> Type of instance i-432407BA for component disk
> To me this error message doesn't make sense.. The NC is running with
> 32Gb Ram and 70GB HDD..
> any ideas? THX

Hello Andreas,

the error seem pretty explicit. Can you post the result of df (or df -h)
on your NC machine? And how big is your image? And what are your instance
types (you can find them runnign as admin euca-describe-availability-zones
verbose)?

cheers
graziano

> 
> 
> [Wed Feb  2 16:11:25 2011][001820][EUCADEBUG ] doDescribeInstances() invoked
> [Wed Feb  2 16:11:31 2011][001820][EUCADEBUG ] doDescribeResource() invoked
> [Wed Feb  2 16:11:31 2011][001820][EUCADEBUG ] doDescribeInstances() invoked
> [Wed Feb  2 16:11:33 2011][001820][EUCADEBUG ] doStartNetwork() invoked
> [Wed Feb  2 16:11:33 2011][001820][EUCAINFO  ] StartNetwork():
> SUCCESS return from vnetStartNetwork 0
> [Wed Feb  2 16:11:33 2011][001820][EUCAINFO  ] StartNetwork(): done
> [Wed Feb  2 16:11:33 2011][001820][EUCAINFO  ] doRunInstance()
> invoked (id=i-432407BA cores=1 disk=2 memory=192)
> [Wed Feb  2 16:11:33 2011][001820][EUCAINFO  ] image=emi-E18C1086 at http://xx.xx.40.122:8773/services/Walrus/image-store-1296589157/image.manifest.xml
> [Wed Feb  2 16:11:33 2011][001820][EUCAINFO  ] krnel=eki-F7BD1105 at http://xx.xx.40.122:8773/services/Walrus/image-store-1296589157/kernel.manifest.xml
> [Wed Feb  2 16:11:33 2011][001820][EUCAINFO  ] rmdsk=eri-0C45116F at http://xx.xx.40.122:8773/services/Walrus/image-store-1296589157/ramdisk.manifest.xml
> [Wed Feb  2 16:11:33 2011][001820][EUCAINFO  ] vlan=10
> priMAC=D0:0D:43:24:07:BA privIp=172.19.1.2
> [Wed Feb  2 16:11:33 2011][001820][EUCADEBUG ] state change for
> instance i-432407BA: Unknown -> Staging (Pending)
> [Wed Feb  2 16:11:33 2011][001820][EUCAINFO  ] network started for
> instance i-432407BA
> [Wed Feb  2 16:11:33 2011][001820][EUCAINFO  ] retrieving images for
> instance i-432407BA (disk limit=2048MB)...
> [Wed Feb  2 16:11:33 2011][001820][EUCAINFO  ] verifying cached file
> in /var/lib/eucalyptus/instances//eucalyptus/cache/eki-F7BD1105/kernel...
> [Wed Feb  2 16:11:33 2011][001820][EUCAINFO  ] walrus_request():
> downloading /tmp/walrus-digest-9ptL1y
> [Wed Feb  2 16:11:33 2011][001820][EUCAINFO  ]
> from http://xx.xx.40.122:8773/services/Walrus/image-store-1296589157/kernel.manifest.xml
> [Wed Feb  2 16:11:33 2011][001820][EUCADEBUG ] walrus_request():
> writing GET output to /tmp/walrus-digest-9ptL1y on 'Wed Feb  2
> 16:11:33 2011'
> [Wed Feb  2 16:11:33 2011][001820][EUCADEBUG ] walrus_request():
> wrote 3506 bytes in 0 writes
> [Wed Feb  2 16:11:33 2011][001820][EUCAINFO  ] walrus_request():
> saved image in /tmp/walrus-digest-9ptL1y
> [Wed Feb  2 16:11:33 2011][001820][EUCAINFO  ] vrun(): [cp -a
> /var/lib/eucalyptus/instances//eucalyptus/cache/eki-F7BD1105/kernel
> /var/lib/eucalyptus/instances//AndreasF/i-432407BA/kernel]
> [Wed Feb  2 16:11:33 2011][001820][EUCAINFO  ] verifying cached file
> in /var/lib/eucalyptus/instances//eucalyptus/cache/eri-0C45116F/ramdisk...
> [Wed Feb  2 16:11:33 2011][001820][EUCAINFO  ] walrus_request():
> downloading /tmp/walrus-digest-B2VtxV
> [Wed Feb  2 16:11:33 2011][001820][EUCAINFO  ]
> from http://xx.xx.40.122:8773/services/Walrus/image-store-1296589157/ramdisk.manifest.xml
> [Wed Feb  2 16:11:34 2011][001820][EUCADEBUG ] walrus_request():
> writing GET output to /tmp/walrus-digest-B2VtxV on 'Wed Feb  2
> 16:11:33 2011'
> [Wed Feb  2 16:11:34 2011][001820][EUCADEBUG ] walrus_request():
> wrote 3509 bytes in 0 writes
> [Wed Feb  2 16:11:34 2011][001820][EUCAINFO  ] walrus_request():
> saved image in /tmp/walrus-digest-B2VtxV
> [Wed Feb  2 16:11:34 2011][001820][EUCAINFO  ] vrun(): [cp -a
> /var/lib/eucalyptus/instances//eucalyptus/cache/eri-0C45116F/ramdisk
> /var/lib/eucalyptus/instances//AndreasF/i-432407BA/ramdisk]
> [Wed Feb  2 16:11:34 2011][001820][EUCAINFO  ] walrus_request():
> downloading
> /var/lib/eucalyptus/instances//AndreasF/i-432407BA/disk-digest
> [Wed Feb  2 16:11:34 2011][001820][EUCAINFO  ]
> from http://xx.xx.40.122:8773/services/Walrus/image-store-1296589157/image.manifest.xml
> [Wed Feb  2 16:11:34 2011][001820][EUCADEBUG ] walrus_request():
> writing GET output to
> /var/lib/eucalyptus/instances//AndreasF/i-432407BA/disk-digest on
> 'Wed Feb  2 16:11:34 2011'
> [Wed Feb  2 16:11:34 2011][001820][EUCADEBUG ] walrus_request():
> wrote 6178 bytes in 0 writes
> [Wed Feb  2 16:11:34 2011][001820][EUCAINFO  ] walrus_request():
> saved image in
> /var/lib/eucalyptus/instances//AndreasF/i-432407BA/disk-digest
> [Wed Feb  2 16:11:34 2011][001820][EUCAFATAL ] error: insufficient
> disk capacity remaining (2043MB) in VM Type of instance i-432407BA
> for component disk
> [Wed Feb  2 16:11:34 2011][001820][EUCAERROR ] get_cached_file()
> failed (errno=0)
> [Wed Feb  2 16:11:34 2011][001820][EUCAFATAL ] Failed to prepare
> images for instance i-432407BA (error=1)
> [Wed Feb  2 16:11:34 2011][001820][EUCADEBUG ] state change for
> instance i-432407BA: Staging -> Shutoff (Extant)
> [Wed Feb  2 16:11:38 2011][001820][EUCADEBUG ] doDescribeResource() invoked
> [Wed Feb  2 16:11:38 2011][001820][EUCAERROR ] libvirt: Domain not
> found: no domain with matching name 'i-432407BA' (code=42)
> [Wed Feb  2 16:11:38 2011][001820][EUCAINFO  ] cleaning up state for
> instance i-432407BA
> [Wed Feb  2 16:11:38 2011][001820][EUCAINFO  ] vrun(): [rm -rf
> /var/lib/eucalyptus/instances//AndreasF/i-432407BA/]
> [Wed Feb  2 16:11:38 2011][001820][EUCAINFO  ] stopping the network
> (vlan=10)
> [Wed Feb  2 16:11:38 2011][001820][EUCADEBUG ] state change for
> instance i-432407BA: Shutoff -> Teardown (Teardown)
> [Wed Feb  2 16:11:38 2011][001820][EUCADEBUG ] doDescribeInstances() invoked
> [Wed Feb  2 16:11:38 2011][001820][EUCADEBUG ]
> doDescribeInstances(): instanceId=i-432407BA publicIp=0.0.0.0
> privateIp=172.19.1.2 mac=D0:0D:43:24:07:BA vlan=10 networkIndex=2
> [Wed Feb  2 16:11:44 2011][001820][EUCADEBUG ] doDescribeResource() invoked
> [Wed Feb  2 16:14:31 2011][001820][EUCADEBUG ]
> doDescribeInstances(): instanceId=i-432407BA publicIp=0.0.0.0
> privateIp=172.19.1.2 mac=D0:0D:43:24:07:BA vlan=10 networkIndex=2
> [Wed Feb  2 16:14:38 2011][001820][EUCADEBUG ] doDescribeResource() invoked
> [Wed Feb  2 16:14:38 2011][001820][EUCADEBUG ] doDescribeInstances() invoked
> [Wed Feb  2 16:14:38 2011][001820][EUCADEBUG ]
> doDescribeInstances(): instanceId=i-432407BA publicIp=0.0.0.0
> privateIp=172.19.1.2 mac=D0:0D:43:24:07:BA vlan=10 networkIndex=2
> [Wed Feb  2 16:14:43 2011][001820][EUCAINFO  ] forgetting about
> instance i-432407BA
> [Wed Feb  2 16:14:44 2011][001820][EUCADEBUG ] doDescribeResource() invoked
> [Wed Feb  2 16:14:44 2011][001820][EUCADEBUG ] doDescribeInstances() invoked
> [Wed Feb  2 16:14:50 2011][001820][EUCADEBUG ] doDescribeResource() invoked
> [Wed Feb  2 16:14:50 2011][001820][EUCADEBUG ] doDescribeInstances() invoked
> 
> 
> On 02.02.2011 07:54, graziano obertelli wrote:
> >On Tue, Feb 01, 2011 at 10:10:12PM +0100, Andreas wrote:
> >>Hi guys,
> >
> >Hello Andreas,
> >
> >>I need help with my Ubuntu Cloud Setup..
> >>My setup is as follows:
> >>Server 1: CLC and Walrus
> >>Server 2: CC and StorageController
> >>Server 3: NodeController
> >>
> >>I installed everything without problems.
> >>Loading of images works without a problem.
> >>
> >>
> >>However when starting an instance it remains in the state "pending"
> >>for over 30 minutes (i terminated after 30 mins):
> >>af at af:~/.euca$ euca-describe-instances
> >>RESERVATION	r-32CC06A5	Andreas		default INSTANCE	i-484209D6
> >>emi-E15D1086	144.XX.XX.XX	172.XX.XX.XX	pending	mykey	0		m1.small
> >>2011-02-01T19:44:56.751Z	cluster1	eki-F4BD6105	eri-0CD5516F
> >>
> >>
> >>Any ideas what is wrong?
> >
> >Have you looked into the nc.log ont the NC machines? It may give you some
> >clue on what si going on. Also which image are you trying to run?
> >
> >cheers
> >graziano
> >
> >>The minimal Hardware requirements are meet.
> >>Expecially the NodeController has sufficient resources. Its a Dell
> >>PowerEdge R410 Server.
> >>
> >>THX Guys
> >>Andreas
> >>
> >>
> >>
> >>--
> >>Ubuntu-cloud mailing list
> >>Ubuntu-cloud at lists.ubuntu.com
> >>Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-cloud
> >
> 
> 
> -- 
> Ubuntu-cloud mailing list
> Ubuntu-cloud at lists.ubuntu.com
> Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-cloud

-- 
Graziano Obertelli
Eucalyptus Systems, Inc.



More information about the Ubuntu-cloud mailing list