Update on porting autopilot tests to 1.3

Thu May 30 14:51:04 UTC 2013

Vasudevan, there is a basic nautilus testcase (very basic!) that is now 
in the production branch. Can't wait to see you expand it to test more :-)

Vasudevan, sounds like you want to use a tool called testdrive:

https://wiki.ubuntu.com/UsingDevelopmentReleases
http://www.youtube.com/watch?v=JGZF6UHhl4I

Your workflow is exactly what happens in the canonical QA lab everyday. 
The autopilot tests we're writing will be a part of that. So for your 
testing however, you don't need to install from an image everyday 
(unless you want to test installation, in which case use testdrive above 
to help!). So setup your vm and simply update on a regular basis, just 
like your stable version of ubuntu. Your installation will track the 
development release. You can then use it to develop autopilot testcases 
or do manual testing.

Does that help / make sense?

Nicholas

On 05/29/2013 06:55 PM, Vasudevan Kottilil wrote:
> Hi Nicholas, Dan,
> I am working on the nautilus script and was hoping to make some 
> progress by now but running into many issues(sorry, could not work 
> during the long weekend).
> I had downloaded a daily build image for saucy-desktop-amd64.iso on 
> 05/23 and tried to create a guest image using the following command: 
> (host is running 12.10 desktop)
>
> virt-install --connect qemu:///system --virt-type kvm --name 
> saucy-alpha-vm --ram 4096 --disk 
> path=/var/lib/libvirt/images/saucy-desktop-vm,size=30 --graphics vnc 
> --location /home/vkottilil/Downloads/saucy-desktop-amd64.iso and it 
> throws an error
> Starting install...
> ERROR    Could not find an installable distribution at 
> '/home/vkottilil/Downloads/saucy-desktop-amd64.iso'
> The location must be the root directory of an install tree.
> Domain installation does not appear to have been successful.
> If it was, you can restart your domain by running:
>   virsh --connect qemu:///system start saucy-alpha-vm
> otherwise, please restart your installation.
>
> What causes this error?
>
> After this, I burned the iso to dvd and from that location it was able 
> to create a vm using the same tool with option --cdrom /dev/sr0 
> instead of --location.
> After launching guest, I am unable to see anything typed out in the 
> vm's terminal - tried changing the profile settings with different 
> color etc and still does not work.
> I can ssh from the host to the vm. Is it possible to run autopliot on 
> the vm from ssh terminal - are there any x server/display options?
>
> I have heard of a totally different workflow this team is using to 
> test the daily image using testdrive - any pointers to that would be 
> great. Ideally it would be great if we can run a  predictable set of 
> steps similar to
> wget latestgood
> create vm
> spin it up
> install autopilot
> copy test scripts
> run tests
> tear down
>
> Thanks,
> Vasudevan Kottilil
>
> On Tue, May 28, 2013 at 8:21 AM, Dan Chapman <daniel at chapman-mail.com 
> <mailto:daniel at chapman-mail.com>> wrote:
>
>     Hi everyone,
>
>     just thought i would give a quick update on the status of porting
>     the autopilot test cases since the last hackfest (check out the
>     notes http://pad.ubuntu.com/CFXkuLR7Lb) and what is working/needs
>     reviewing and testing.
>
>     *Firefox: *nskaggs completed this and is now merged to the
>     production branch. The test was converted to using the
>     ProcessManager class as introspecting firefox was not possible.
>     *
>     Evince: *has been ported to 1.3 using introspection, the test is
>     working good and has been proposed for merge. Currently it could
>     still do with the open and print dialogs being introspected, as it
>     is still currently using keyboard shortcuts to navigate. Also i
>     think this test case could be further expanded as it still misses
>     some features that can be introspected
>     Currently it tests
>
>           * Display pdf
>           * Enter & Exit fullscreen
>           * Show & Hide sidebar
>           * Rotate document
>
>     Maybe we could add tests for zoom, bookmark and presentation
>     features? Whats your thoughts?
>
>     *File-Roller: *ported to 1.3 using introspection and has been
>     proposed for merge. It is currently using the archive created in
>     the first test across all the tests. So the tests are unable to be
>     called and run independently from each other. Could do with
>     modifying to make each test self contained.
>
>     I could not find a sane way to select/choose an archive format so
>     currently it works with whatever your default archive is and
>     collects the name of the archive from the window title so can be
>     deleted successfully.
>     Anyone have any ideas on accessing the items in a GtkComboBoxText
>     control and getting the selected item?
>
>     *Gedit: *Letozaf has been working on this and has proposed a merge.
>
>     *Nautilus: *Has been ported to 1.3 but unable to introspect due to
>     autopilot module not loading, So currently using the
>     ProcessManager. This test is still very basic in that it just
>     creates and deletes a directory. As this is probably the most used
>     application on ubuntu it should probably have an extensive test to
>     match the current manual-test-case as much as possible.
>
>     *Shotwell: *Still to be ported to autopilot 1.3
>
>     *Totem: *nskaggs is working on this.... I think??
>
>     *Screenshot:*when running autopilot launch gnome-screenshot it
>     automatically takes a screenshot of the whole screen and loads on
>     to the save screenshot window. This is the same when just running
>     gnome-screenshot in the terminal. Is this a bug i couldnt find a
>     bug like this. Or is this the default behaviour when launching it
>     from terminal?
>
>     Also the same when lauching the application with
>     launch_test_application()
>
>     screenshot can be introspected but cannot get into the main window
>     to test taking different shots. This needs looking into further.
>
>     *Terminal:*ported to 1.3 using ProcessManager, it would be great
>     to be able to introspect terminal in the near future, get some
>     more assertions in there then, and remove alot of the keyboard
>     calls. :) Like navigating the preferences dialog etc.
>
>     It would be great if people could test the current Production and
>     Proposed tests to get feedback. So if anyone has the time please
>     fell free to test them.
>
>     Regards
>
>     Dan Chapman
>     **
>
>
>
>     --
>     Ubuntu-quality mailing list
>     Ubuntu-quality at lists.ubuntu.com
>     <mailto:Ubuntu-quality at lists.ubuntu.com>
>     Modify settings or unsubscribe at:
>     https://lists.ubuntu.com/mailman/listinfo/ubuntu-quality
>
>

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.ubuntu.com/archives/ubuntu-quality/attachments/20130530/83b126d5/attachment.html>