[Testing] contents of Testing Digest, Vol 38, Issue 16

[Tabitha Roder]

> On Fri, Jun 18, 2010 at 01:24:12AM -0400, Michael Stone wrote:
> > 1. Will sugar-0.90 be better if it gets more and more serious testing
> > between now and its release?
>
> Better than it otherwise would be, yes.  In terms of quantity of latent
> defects on release.  We'd also have a better idea of the defects it is
> released with that won't be fixed before release.
>
> Yes.


> > 2. Might we get more meaningful testing done if we all agreed to
> > agree, on a roughly weekly basis, on *what to test* -- that is, on a
> > "sugar HEAD"?
>
> Yes, the testing would be more meaningful if it was anchored to some
> version concept, even if it was a hash.  What this begins to sound like
> is rapid releasing during development.  0.89.n this week, 0.89.n+1 next
> week.
>
> We meet every Saturday morning (NZ time 11am) and would like to know say
Thursday what to download on Friday for testing, or a similar pattern each
week.  Include any specifics of what you want tested, more detail the
better. Testing pattern is good - release on Thursday, test on Saturday with
results same day, analysis of tests and ask questions Sunday, and carry out
improvements and fixes before release on Thursday, and so on. It is worth
noting that if released Friday American time we cannot test for another
whole week.



> > 3. Might we get more comprehensive test results if "sugar HEAD" were
> > directly testable against the real software in use on all platforms of
> > interest? [2]
>
> Yes, test results would be more comprehensive.
>

We can test XO-1.0, XO-1.5, and SoaS easy enough, we have a bit of hardware
range (Acer, Asus, HP and 3 Mac laptops but the Mac testing is just too
hard). Easy installation is required because often we are doing the
installation during the testing time (in a bar once a week while all the XOs
are together). We are having success with reflashing XOs as a way of
installing the new version. We have limited internet during testing so doing
a 100MB yum upgrade on each laptop is not possible.


> > 4. Would you like to participate in a roughly-weekly social event
> > designed to accomplish these goals? (That is, for example, in a weekly
> > Sugar Labs "Friends in Testing"-style exploratory testing
> > opportunity?)
>
> Yes, subject to timezone considerations.  ;-}
>

We go on IRC at 11am on Saturday mornings (NZ time) and are online for a few
hours. After that it is sporadic, when I remember to start IRC client
basically.  I would be quite happy to do another IRC on Sunday (NZ time) to
follow up anything done.
Our testing is pretty social, it is in a cafe/bar in Auckland and in
Wellington, with food and coffee, lots of chatting (about other FOSS
education stuff too).


Tabitha
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.laptop.org/pipermail/testing/attachments/20100620/55619a0a/attachment.htm