==================
Elisa Testing Page
==================

List of tests Elisa should pass successfully before any release with a
system wide installation.

If any of these tests fails, please file a ticket describing the issue
following these `instructions`_. **Do not forget** to mention in the
ticket that it breaks a test here.

Then, update the following tables without forgetting to link to the
ticket in the *Notes* column.

.. _instructions: BugReportingHowTo


Regression Tests
================

Functionality-oriented tests aiming at keeping a desired
feature/behaviour from breaking.

local_media component Tests
---------------------------

You have to use the testing suite for these tests. see `media testing
suite`_

.. _media testing suite: Testing/MediaTestingSuite

+-------------------------------------+---------------+--------------+------------+----------+------------------------------+
|         Test                        |  with plugin  |    Status    |   Tester   |   Date   |             Notes            |
+=====================================+===============+==============+============+==========+==============================+
| `Browsing directories`_             |audio_activity |    passed    | florian    |2008/01/11|                              |
+-------------------------------------+---------------+--------------+------------+----------+------------------------------+
| `Add, remove medias at runtime`_    |audio_activity |  **broken**  | florian    |2008/01/11| `#807`:trac:                 |
+-------------------------------------+---------------+--------------+------------+----------+------------------------------+
| `Playing single and several files`_ |audio_activity |  **broken**  | florian    |2007/01/11| `#881`:trac: + needs update  |
+-------------------------------------+---------------+--------------+------------+----------+------------------------------+
| `Browsing directories`_             |video_activity |    passed    | florian    |2008/01/11|                              |
+-------------------------------------+---------------+--------------+------------+----------+------------------------------+
| `Add, remove medias at runtime`_    |video_activity |  **broken**  | florian    |2008/01/11| `#807`:trac:                 |
+-------------------------------------+---------------+--------------+------------+----------+------------------------------+
| `Browsing directories`_             |image_activity |    passed    | florian    |2008/01/11|                              |
+-------------------------------------+---------------+--------------+------------+----------+------------------------------+
| `Add, remove medias at runtime`_    |image_activity |  **broken**  | florian    |2008/01/11| `#807`:trac:                 |
+-------------------------------------+---------------+--------------+------------+----------+------------------------------+

Others components tested here : base.enqueue_action, base.play_action 

.. _Browsing directories: Testing/BrowseDirectories
.. _Add, remove medias at runtime: Testing/AddRemoveLocalMedias
.. _Playing single and several files: Testing/PlayEnqueueAction

aspect ratio test
-----------------

+-------------------------------------+---------------------+--------------+------------+----------+------------------------+
|         Test                        |     with plugin     |    Status    |   Tester   |   Date   |          Notes         |
+=====================================+=====================+==============+============+==========+========================+
| `4:3 screen mode 800x600`_          |pigment_context      |    passed    | lionel     |2007/10/01|                        |
+-------------------------------------+---------------------+--------------+------------+----------+------------------------+
| `16:10 screen with square pixels`_  |pigment_context      |    passed    | lionel     |2007/10/01|                        |
+-------------------------------------+---------------------+--------------+------------+----------+------------------------+
| `16:10 screen, mode 800x600`_       |pigment_context      |    passed    | lionel     |2007/10/01|                        |
+-------------------------------------+---------------------+--------------+------------+----------+------------------------+

.. _4:3 screen mode 800x600: Testing/AspectRatio43_800x600
.. _16:10 screen with square pixels: Testing/AspectRatio1610_SP
.. _16:10 screen, mode 800x600: Testing/AspectRatio1610_800x600

fspot_media component Tests
---------------------------

+-------------------------------------+--------------+------------+----------+------------------------------+
|         Test                        |    Status    |   Tester   |   Date   |             Notes            |
+=====================================+==============+============+==========+==============================+
| `No F-Spot DB`_                     |   passed     |  Philippe  |2007/10/04|                              |
+-------------------------------------+--------------+------------+----------+------------------------------+
| `Browsing tags`_                    |   passed     |  Philippe  |2007/10/04|                              |
+-------------------------------------+--------------+------------+----------+------------------------------+
| `F-Spot slideshow`_                 |   passed     |  Philippe  |2007/10/04|                              |
+-------------------------------------+--------------+------------+----------+------------------------------+

.. _No F-Spot DB: Testing/FSpotNotFound
.. _Browsing tags: Testing/FSpotBrowse
.. _F-Spot slideshow: Testing/FSpotSlideshow

shoutcast_media component Tests
-------------------------------

+-------------------------------------+--------------+------------+----------+------------------------------+
|         Test                        |    Status    |   Tester   |   Date   |             Notes            |
+=====================================+==============+============+==========+==============================+
| `Shoutcast test`_                   |    passed    |  Philippe  |2007/10/04|                              |
+-------------------------------------+--------------+------------+----------+------------------------------+

.. _Shoutcast test: Testing/Shoutcast


stage6_media component Tests
-------------------------------

+-------------------------------------+--------------+------------+----------+------------------------------+
|         Test                        |    Status    |   Tester   |   Date   |             Notes            |
+=====================================+==============+============+==========+==============================+
| `Generic Stage6 test`_              |    passed    |  Philippe  |2007/10/04|                              |
+-------------------------------------+--------------+------------+----------+------------------------------+
| `Stage6 queueing test`_             |   **broken** |  Benjamin  |2007/10/02| `#691`:trac:                 |
+-------------------------------------+--------------+------------+----------+------------------------------+

.. _Generic Stage6 test: Testing/Stage6
.. _Stage6 queueing test: Testing/Stage6/Queueing

flickr_media component Tests
----------------------------

+-------------------------------------+--------------+------------+----------+------------------------------+
|         Test                        |    Status    |   Tester   |   Date   |             Notes            |
+=====================================+==============+============+==========+==============================+
| `Browsing in Flickr`_               |    passed    |  Philippe  |2007/10/04|                              |
+-------------------------------------+--------------+------------+----------+------------------------------+

.. _Browsing in Flickr: Testing/Flickr



i18n tests
----------

+-------------------------------------+--------------+------------+----------+------------------------------+
|         Test                        |    Status    |   Tester   |   Date   |             Notes            |
+=====================================+==============+============+==========+==============================+
| `i18n main test`_                   |    passed    |  Philippe  |2007/10/04|                              |
+-------------------------------------+--------------+------------+----------+------------------------------+
| `i18n auto setting`_                |    passed    |  Philippe  |2007/10/04|  tested: fr, de, ca          |
+-------------------------------------+--------------+------------+----------+------------------------------+
| `i18n wrong code`_                  |    passed    |  Philippe  |2007/10/04|                              |
+-------------------------------------+--------------+------------+----------+------------------------------+

.. _i18n main test: Testing/i18n
.. _i18n auto setting: Testing/i18n/AutoSet
.. _i18n wrong code: Testing/i18n/WrongCode

media_scanner
-------------

+-------------------------------------+--------------+------------+----------+------------------------------+
|         Test                        |    Status    |   Tester   |   Date   |             Notes            |
+=====================================+==============+============+==========+==============================+
| `Media scanning`_                   |    passed    |  Philippe  |2007/10/04|                              |
+-------------------------------------+--------------+------------+----------+------------------------------+

.. _Media scanning: Testing/MediaScanning

tests to dispatch
-----------------

+-------------------------------------+--------------+------------+----------+------------------------------+
|         Test                        |    Status    |   Tester   |   Date   |             Notes            |
+=====================================+==============+============+==========+==============================+
| `Audio CD playback`_                |    passed    |  Florian   |2007/10/04|                              |
+-------------------------------------+--------------+------------+----------+------------------------------+
| `Player on screen display`_         |    passed    |  Florian   |2007/10/04|                              |
+-------------------------------------+--------------+------------+----------+------------------------------+
| `General player support`_           |    passed    |  Philippe  |2007/10/04|                              |
+-------------------------------------+--------------+------------+----------+------------------------------+
| `Subtitles for videos`_             |    passed    |  Philippe  |2007/10/04|                              |
+-------------------------------------+--------------+------------+----------+------------------------------+
| `Album covers`_                     |  **broken**  |  Philippe  |2007/09/20| `#545`:trac:                 |
+-------------------------------------+--------------+------------+----------+------------------------------+
| `Pictures slideshow`_               |    passed    |  Philippe  |2007/10/04|                              |
+-------------------------------------+--------------+------------+----------+------------------------------+
| `Slideshow faulty image`_           |  **broken**  |  Philippe  |2007/10/04| `#716`:trac:                 |
+-------------------------------------+--------------+------------+----------+------------------------------+
| `System wide deployment`_           |    passed    |  Philippe  |2007/10/04|                              |
+-------------------------------------+--------------+------------+----------+------------------------------+
| `USB hotplug`_                      |    passed    |  Philippe  |2007/10/04|                              |
+-------------------------------------+--------------+------------+----------+------------------------------+
| `Theme swichting`_                  |    passed    |  Florian   |2007/10/04| Not detailled enough         |
+-------------------------------------+--------------+------------+----------+------------------------------+
| `Fresh default configuration`_      |    passed    |  Philippe  |2007/10/04|                              |
+-------------------------------------+--------------+------------+----------+------------------------------+
| `Seeking test`_                     |    passed    |  Benjamin  |2007/09/27|                              |
+-------------------------------------+--------------+------------+----------+------------------------------+
| `Playing the same uri`_             |    passed    |  Benjamin  |2007/10/04|                              |
+-------------------------------------+--------------+------------+----------+------------------------------+

.. _Audio CD playback: Testing/AudioCDPlayback
.. _Player on screen display: Testing/PlayerOnScreenDisplay
.. _General player support: Testing/Player
.. _Subtitles for videos: Testing/Subtitles
.. _Album covers: Testing/AlbumCovers
.. _Pictures slideshow: Testing/Slideshow
.. _Slideshow faulty image: Testing/SlideshowFaulty
.. _System wide deployment: Testing/SystemWide
.. _USB hotplug: Testing/USBHotplug
.. _Theme swichting: Testing/ThemeSwichting
.. _Fresh default configuration: Testing/FreshConfiguration
.. _Seeking test: Testing/Seeking
.. _Playing the same uri: Testing/Player/SameUri

.


`Performance Tests <Testing/Performance>`_
==========================================

Hardware usage tests aiming at complying with the requirements set for Elisa.

+-------------------------------------+--------------+------------+----------+------------------------------+
|         Test                        |    Status    |   Tester   |   Date   |             Notes            |
+=====================================+==============+============+==========+==============================+
| CPU usage while Elisa idles         |  *untested*  |   nobody   |YYYY/MM/DD|                              |
+-------------------------------------+--------------+------------+----------+------------------------------+
| CPU usage playing music             |  *untested*  |   nobody   |YYYY/MM/DD|                              |
+-------------------------------------+--------------+------------+----------+------------------------------+

.


Portability Tests
=================

Description.

+-------------------------------------+--------------+------------+----------+------------------------------+
|         Test                        |    Status    |   Tester   |   Date   |             Notes            |
+=====================================+==============+============+==========+==============================+
+-------------------------------------+--------------+------------+----------+------------------------------+

.


Security Tests
==============

Description.

+-------------------------------------+--------------+------------+----------+------------------------------+
|         Test                        |    Status    |   Tester   |   Date   |             Notes            |
+=====================================+==============+============+==========+==============================+
+-------------------------------------+--------------+------------+----------+------------------------------+

.


Usability Tests
---------------

User tests aiming at keeping the user interface easy and pleasant to discover and to use. Their form is not yet clearly defined.

+-------------------------------------+--------------+------------+----------+------------------------------+
|         Test                        |    Status    |   Tester   |   Date   |             Notes            |
+=====================================+==============+============+==========+==============================+
| `Test summary`_                     |  **broken**  |   You      |YYYY/MM/DD| `#1024`:trac:                |
+-------------------------------------+--------------+------------+----------+------------------------------+

.. _Test summary: Testing/TestPage

.


