User:Dan Nessett/Technical/Notes on Regresssion Testing

From Citizendium
Jump to navigation Jump to search


The account of this former contributor was not re-activated after the server upgrade of March 2022.


Selenium

SeleniumFramework

General Notes

  • For linux wmctrl allows the manipulation of windows from the command line. This is useful for running tests that start up a browser window (and console, such as Selenium), since it is possible to create a wrapper that starts up the browser and then immediately minimizes its window. This keeps the main window uncluttered during test runs. To install wmctrl on Ubuntu:
sudo apt-get install wmctrl

Notes on getting MW Selenium worked examples to work

Installing the necessary software

  • Need to install PHPUnit. Use pear (comes installed with latest version of PHP)
sudo pear upgrade pear
sudo pear channel-discover pear.phpunit.de
sudo pear install phpunit/PHPUnit

Pear files are in (Ubuntu): /usr/share/php/PEAR PHPUnit files are in (Ubuntu): /usr/share/php/PHPUnit

  • Need to install Selenium
  • Selenium Remote Control (RC) is found at: http://seleniumhq.org/download/
  • Need java jvm installed (at least version 1.5)
  • Selenium RC only requires running selenium-server:
  • java -jar /path/to/selenium-server.jar
  • Selenium-IDE is also found at: http://seleniumhq.org/download/
  • It is a plugin for Firefox (only works on Firefox).
  • Need to install Testing/Selenium:
sudo pear install Testing_Selenium
  • You may need to specify a specific version. To find out the most recent verion:
pear remote-info Testing_Selenium

Setting up RunSeleniumTests.php (for Ubuntu)

  • Make sure the require_once() of PagedTiffHandler in LocalSetings.php comes after the setting of $wgFileExtensions; otherwise that setting will clobber the addtion of .tiff and .tif by PagedTiffHandler
  • Copy the file .../tests/selenium/LocalSeleniumSettings.php.sample to .../tests/selenium/LocalSeleniumSettings.php
  • Edit LocalSeleniumSettings.php and change the line:
set_include_path( get_include_path() . PATH_SEPARATOR . 'PEAR' );
to read:
set_include_path( get_include_path() . PATH_SEPARATOR . '/usr/share/php/PEAR' );
  • In the file LocalSeleniumSettings.php, make the following modifications (leave the other lines alone):
$wgSeleniumTestsSeleniumHost = 'http://localhost';
$wgSeleniumTestsWikiUrl = 'http://localhost/<relative URL of wiki>';
For example, if in /etc/apache2/sites-enabled/000-default the directory relative URL to all wikis is:
Alias /mediawiki/ "/usr/local/src/mediawiki/"
and the specific wiki containing the selenium test directory is:
/usr/local/src/mediawiki/CZ_RF_1_13_2
then $wgSeleniumTestsWikiUrl should be set to:
$wgSeleniumTestsWikiUrl = 'http://localhost/mediawiki/CZ_refactor_1_13_2/phase3';
Set the following variables to the db user and pw
$wgSeleniumTestsWikiUser      = '';
$wgSeleniumTestsWikiPassword  = '';
Set:
$wgSeleniumTestsBrowsers['firefox']   = '*firefox /usr/bin/firefox';
$wgSeleniumTestsUseBrowser = 'firefox';
Set the tests. Assuming you have loaded the PagedTiffHandler extension (and uploaded the file Multipage.tiff to the Images namespace as Multipage.tiff)
$wgSeleniumTestIncludes = array(
'selenium/SimpleSeleniumTest.php',
'/<path/to/wiki>/phase3/extensions/PagedTiffHandler/selenium/PagedTiffHandler_tests.php'

Some useful URLs

  • Netbeans, Selenium and PHPUnit: 
    http://netbeans.org/kb/docs/php/phpunit.html

Selenium meeting notes 5/14/2010

  • The Selenium framework testing code in the latest trunk of MW (r66751 ) is designed to work with 1.13 and has been tested on 1.13 and 1.15.
  • In order to allow tests to dynamically configure the wiki, create an extension that is called by a hook at the end of LocalSettings. This extension then sets any necessary global variables and returns.
  • Each test needs to establish the db in a state suitable for testing. How this will be accomplished is yet undefined.
  • Discussion of the Selenium Framework for MW will be conducted on Wikitech-l
  • There exists RC scripts for the Selenium-Grid machines. These will be checked into the main trunk.
  • Some relevant links from Ryan Lane:
Retrieved from "https://citizendium.org/wiki/index.php?title=User:Dan_Nessett/Technical/Notes_on_Regresssion_Testing&oldid=905056"