Pre-release test

From Ekiga

Jump to: navigation, search

Contents

Ekiga pre-release test flow

It's a fact that we released buggy code in the past. A "normal" bug - something very hidden - is not the problem. That happens. But a bug that's something obvious and that just wasn't fixed because nobody tested some simple use-cases, is bad. To minimize that risk in future, we should follow a basic test-flow.

Basic source code review

  • configure[.in] checks for the right versions of PWLib/OPAL
  • configure script was generated

Compile time

For these tests, please compile with LC_ALL=C set in environment.

  • make >/dev/null - any error messages?

Runtime

For all runtime tests, please run Ekiga with LC_ALL=C set in environment. That ensures the strings specified in the code are used, and the error messages tell us something.

The basic structure of the runtime tests follows the categories describing the features of Ekiga.

GUI general

  • Obvious HIG violations?
  • Typos in strings?
  • Something written unclear? Everything makes sense?
  • Do all hotkeys work?
  • Breaking behaviour of popup-windows?
  • Does the tray icon work like intended?

Documentation

Verify the documentation follows recommendations from the GNOME Documentation Style Guide and the GNOME Handbook of Writing Software Documentation.

Ekiga 2.9 Pre-tests

test calls
Tester (date) Caller (software + version) Callee (software + version) Presence indication Text chat Audio (codec) Video (Codec + size)
Yannick

(16-08-2008)

Ekiga 2.9

(6617)

Ekiga 2.9

(6617)

Not tested

Test with myself: Ok

Ok Ok for all, but

SPEEX:Broken, G726-16:Crash

Theora 320x240:Ok
Freechelmi

(16-08-2008)

Ekiga 2.9

(16-08-08 )

Ekiga 2.9

(16-08-08)

3 Status & custom variants OK on Both Sides. NOK : Will Work till the end of the current Window lines available, new lines won't be displayed ( No automatic scrolling & refresh) TODO TODO
Yannick-Eugen

(20-08-2008)

Ekiga 2.9

20080814 (theora 640x480)

Ekiga 2.9

20080818 (theora 320x200)

ok, both way PCMU ok Theora 320x240 works (one way bug fixed as of 20080903)


quality slider fixed in 20080830

Yannick-Eugen

(20-08-2008)

Ekiga 2.9

20080814 (h264 640x480)

Ekiga 2.9

20080818 (h264 320x200)

ok, both way PCMU ok h264 320x240 works (one way bug fixes as of 20080903)


quality slider fixed on 20080830

Yannick-Eugen

(20-08-2008)

Ekiga 2.9

20080814 (h261 640x480)

Ekiga 2.9

20080818 (h261 320x200)

ok, both way PCMU ok h261 320x240 from eugen and qcif from yannick !! both way works no matter who call first

quality slider works with 20080830

Yannick-Eugen

(20-08-2008)

Ekiga 2.0.12 Eugen, libpt-1.10.10

(h261)

Ekiga 2.9 Yannick

20080818 (h261 320x240)

chat ok, both way Eugen calls me: with no audio codecs=no audio and no video!! (h261 was selected)

Eugen calls me: PCMU and PCMA , GSM ok

Eugen calls me: h323+IP : ms-gsm works with h261

Eugen calls me with LPC: no LPC in 2.9 thus another audio codec was selected (GSM)

Speex Y. send audio and video but receive nothing from eugen because E. client (2.0.12) crashed (bug reported)

SPEEX was selected even if not on top list->codec negociation issue !! (bug reported)

g721 unavailable in ekiga 2.9

g726-16k Y. send audio and video but receive nothing from eugen because E. client (2.0.12) crashed (bug reported)

Y. call E. = crash for E. (??bug reported??)

Y call E: PCMU/h261 Y cannot get the call and 2.9 cannot hang up!! (bug reported)

Y call E: PCMA, PCMU, GSM are ok (if only h261 selected)

iLBC is not present in 2.0.12-debian

2.9 calls 2.0.12: If no audio codec in common there is no communication even if video codec h261 is available on both sides!

If audio works (pcmu, pcma) video is good both way, quality slider works for 2.0.12, quality slider for 2.9=freeze and no more video transmission from 2.9
Yannick-Eugen

(31-08-2008)

Ekiga 2.9 Yannick Ekiga 2.0.12 Eugen 2.9 call 2.0.12: it rings on 2.0.12 side, call can be accepted (PCMU-h261), on 2.9 side there is "call redirected", no video or audio transmission. 2.9 can *not* hangup. ref. http://bugzilla.gnome.org/show_bug.cgi?id=550116
Personal tools