testdriven.com Wrangling quality out of chaos

FunkLoad 1.0 has been released.

FunkLoad is a functional and load web tester, written in Python, whose main use cases are:

- Functional testing of web projects and thus regression testing.
- Performance testing tool by loading the web application and monitoring your servers it helps you to pinpoint bottlenecks, giving a detail report of performance measurement.
- Load testing tool to expose bugs that do not surface in cursory testing, like volume testing or longevity testing.
- Stress testing tool to overwhelming the web application resources and test the application recoverability.
- Writing web agents by scripting any web repetitive task, like checking if a site is alive.Main FunkLoad features are:

- Functional tests are pure Python scripts using the pyUnit framework like normal unit tests. Python enable complex scenarios to handle real world app.
- Truly emulates a web browser (single-threaded) using Richard Jones’ Mechanical Cat WebUnit: basic authentication support; cookies support; fetching css, javascript and images; emulate a browser cache; file upload and multipart/form-data submission; https support.
- Advanced test runner with many command line options: set the target server url; display the fetched page in real time in your browser; debug mode; green/red color mode.
- Turn a functional test into a load test, just by invoking the bench runner you can identify scalability and performance problems.
- Detail bench report in ReST or HTML (PDF via ps2pdf) containing: bench configuration; tests, pages, requests stats and charts; 5 slowest requests; servers cpu usage, load average, memory/swap usage and network traffic charts; http error summary list.
- Easy test customization using configuration file or command line options.
- Easy test creation using TestMaker / maxq recorder, you can use your web browser and produce a FunkLoad test automatically.

- Provide web assertion helpers.
- Provide a funkload.CPSTestCase to ease Zope and Nuxeo CPS testing.
- Easy to use, see examples in the demo folder.

Funkload is free/open source software, available under the GPL license at funkload.nuxeo.org.

This release contains the first version of the new JCA test framework developed by Gábor Lipták. The framework can be used to simulate backend systems that are accessed through a JCA connector, e.g. mainframes.Other changes include:

- The mock object factories now use factory methods to create mock objects making them more extensible. This allows the use of custom mock objects.
- Mockrunner is now officially Java 5 (aka 1.5) compatible. Java 5, 1.4. and 1.3 are supported from now on.
- The Struts test framework now supports custom ActionMapping subclasses.
- The JDBC test framework now supports generated keys
- Improved out parameter handling for callable statements
- Added new ArrayResultSetFactory implemented by Erick G. Reid
- Added a method to easily preload JMS mock destinations with test messages
- Refactored JMS session handling so that closed session are removed from destinations (preventing a memory leak that may occur in special cases)
- Many minor improvements and bug fixes

Please check out the release on our site for the new version and examples for the new JCA test framework.

PHP test coverage tool

Semantic Designs has released Test Coverage and Profiling tools for PHP5 and PHP4. Now you can perform unit testing on your PHP scripts and determine how effectively you have tested your entire site.

I would like to inform you that a new version of the actiWATE: Actimind Web Application Testing Environment, is available as a free download.

actiWATE is a freeware software platform intended to simplify the test automation process.

It consists of:
– an advanced framework for writing tests in Java
– a Test Writing Assistant (web browser plug-in module which is aimed to assist the test writing process)actiWATE R0.99 build 3 contains the following changes and additional features:

- Extended implementation of JavaScript Object Model
- Support of HTML Image Maps and Areas
- DOM Level 1 properties and methods implementation
- Ability to check the existence of non-HTML resources (images, objects, css files)
- Rhino updated to 1.6R1
- Language header in HTTP request
- Improved detection of installed Java by TWA installer

and others…

Do not hesitate to contact me in case of any questions
regarding this software.

Regards,

Vladimir Kornev.
Actimind, Inc.
vladimir.kornev@actimind.com

Version 0.9.0, September 16, 2005

NEW: CruiseControl Monitor can invoke JMX actions on projects if CruiseControl server is started with JMX enabled (you need to specify JMX console URL in Options dialog)

NEW: Mozilla Deer Park Beta 1 (Firefox 1.5) supported

Go to the Extension home page.

Hamburg, Germany – 2005-08-29 froglogic GmbH today announced the availability of Squish 2.0, the new version of the most advanced automated GUI testing framework for Qt applications.

With Squish 2.0, creating and running automated tests for Qt-based applications is easier than ever. While Squish’s excellent script support continues to provide great flexibility when coding test scripts it now is also possible to create sophisticated test scripts using the Squish IDE without writing a single line of script code. This spans from recording a test case to inserting advanced verification points via a greatly improved point & click user interface. The combination of both worlds gives test engineer an easy-to-use tool with all the flexibility needed."This second major release of Squish will strengthen our position as the leading and most used Qt GUI testing tool even more", said Reginald Stadlbauer, froglogic’s CEO. "We have implemented many new and useful features, dramatically improved performance and added support for Qt 4.0."

During Squish 2.0′s development phase many customers and evaluators already started using the new version because of its major improvements. So Squish 2.0 is already used in production at many sites today.

"During our purchase evaluation, I compared our home-brewed testing tool to Squish (1.3 at the time) and found the speed difference similar to that of the tortoise & the hare. But now with Squish 2.0, it’s like the hare hopped into an F-16 and hit the afterburner! Squish 2.0 is fast!", said Marc Seter, CTO at Selden Integrated Systems. "Inserting verification points is greatly improved! Not only is it easier than Squish 1.3, it’s much, much faster! In less than 2 months of development time, we’ve achieved with Squish 2.0 what we were unable to achieve in 2 years with our own solution."

The main new features of Squish 2.0 are:

- Support for Trolltech’s new Qt 4.0 on all platforms has been added in addition to Qt 2.3/Embedded, Qt 3.x (all platforms) support. The Qt 4.0 support is equal to Qt 2.3 and 3.x support including event compression for new complex widgets such as the item view widgets.

- Major speed improvements when executing tests or using Squish Spy.

- Major improvements for Squish on MacOS X.

- Completely reworked and extended documentation.

- Major usability improvements in Squish Spy when inserting verification points for object properties and screen shots.

- Also non-QObject objects such as list view and menu items can be accessed in Squish Spy now to allow inserting verification points for such objects without the need of writing script code.

- Improved verification point handling with additional script API and a verification point editor in the Squish IDE.

- Support for executing and controlling/testing multiple applications from one test script. This is specially useful when testing the interaction between different applications or multiple instances of the same applications such as in a client/server environment.

- New script API for advanced synchronization points such as waiting for a condition to become true (e.g. the value of a property changes, an object becomes visible, etc.)

- New script API to install event handlers. This allows to e.g. deal with error messages popping up unexpectedly during a test run.

- Improved error handling and diagnostics.

Demo

A flash demo of Squish 2.0 can be viewed here.

Availability

Squish customers and evaluators can now find Squish 2.0 packages in their download area. For more information about Squish and its price and licensing, visit froglogic Squish. If you would like to evaluate or purchase Squish, please contact us at squish@froglogic.com.

About froglogic

froglogic GmbH is a software company offering Qt consultancy services and Qt-based development tools. froglogic was founded by two former Trolltech senior engineers, Reginald Stadlbauer and Harri Porten, who now use their experience and skills to serve the Qt 3rd party market. froglogic is based in Hamburg, Germany. More about froglogic at www.froglogic.com.

A preview of EasyMock 2 is available at the EasyMock web site.

EasyMock 2 has a lot of new features, among them refactoring safe per-argument matchers and a new syntax that relies on Java 5.0. It has 100% unit test coverage, and the release includes updated documentation.

CruiseControl Monitor extension starting from version 0.8 supports Mozilla Thunderbird.

Available for download from here.

Available for download here.

New in this version:

* Support for sorting of projects in tooltip by name or last build time
* Support for including only failed projects in tooltip
* Proportional font is back, now with proper alignment
* Visual indication of failed projects (*) in addition to color, for colorblind users or users with monochrome monitors

Support for retrieving projects build status from multiple CruiseControl servers is planned for future major release.

Monitor your CruiseControl build status in Firefox status bar.

Available for download here.

New in this version:
* Proportional font in tooltip with alignment
* Support for include/exclude project lists (with regexp)
* Update mechanism rewritten to update status faster after Options change
* Extension icon

The TestNG team is happy to announce the release of TestNG 2.4 at testng.org.

The complete announcement (with links) can be found here.

A lot of fixes and improvements have gone into this release (see the complete list) but the most important feature is the new Web site (testng.org) and the new packaging (org.testng.*).

There are also a couple of items I want to mention briefly:

* A Flash demo of the Eclipse plug-in, created by Andrew Glover (who also set up a TestNG site with articles and resources).
* A TestNG Maven plug-in. I couldn’t include it in this release, but it is now part of our CVS depot and will be included in 2.4.1.

Big thanks go to Alexandru Popescu, Andrew Glover, Thierry Janaudy and Russel Winder for their participation to this new release!

You can download TestNG 2.4 here. The Eclipse plug-in has also been updated to this new version and can be obtained from the update site.

[url=http://www.testdriven.com/modules/mylinks/visit.php?cid=4&lid=1038]Toplink In Memory[/url] is an open source project that allows you to run your database tests in memory. If you’re using toplink and TDD, this package can help you reduce the amount of time it takes you to run all your tests.

Fewer failing tests due to test interaction, Toplink in Memory automatically deletes all the objects you created during the test – but leaves the fixtures in the database untouched.

How does it do this? Well, it stubs out the database. When in production, ToplinkInMemory calls Oracles Toplink normally – which uses the database. During testing all the objects are created in memory and only in memory. NOTHING is written to a disk. And none of those pesky transactions (expensive) are used to save even more time during test runs.

This library was created out of need. We are currently running 4700 tests which take multiple hours to run against the database. Our in memory framework allows us to run them in as little as five minutes. We hope it will be of use to you.

Ted O’Grady

Rhino Mocks has a new version out, this one takes a lot after NMock2, but retains the strong typing, the Record()/Replay() model and adds many improvements, not the least of them is useful documentation (at last)

What Rhino Mocks offers?

- Explicit record & replay model for expectations
- Strongly typed mocks.
- Expectations based on:
- – Arguments matching
- – Constraints matching
- – Custom callback to verify the expected arguments using your own code
- Sets actions on methods, returns a specific value, or throws an exception.

I am pleased to announce the first release of Python Mock (version 0.1.0) on SourceForge:

http://sourceforge.net/projects/python-mock/

The Python Mock library enables the easy creation and use of mock objects for Python unit testing, inspired by the various Java mock object tools.Mock objects facilitate unit testing by acting as replacements for classes that the object being tested must interact with. The Mock object can accept any method call and return a canned value. The call is recorded by the Mock object and can be examined later by the test code.

The Mock objects can have expectations about how they are used, and will assert that they are being used correctly. The Mock objects can also can validate themselves against the class being mocked, checking that the methods called exist on the real object and have the right parameters. This ensures that the tests stay in sync with the classes being mocked.

The Mock class can also be used to as a mixin with a regular Python class to provide recording of method calls and setting expectations on non-Mocked methods. This enables the Mock class to be used for diagnostic purposes as well as for testing.

AnyUnit version 1.3 is now released and available for download at anyunit.com.

AnyUnit is an unit testing environment that allows developers to work with virtually any type of test frameworks, commercial and open source and supports C/C++/Managed C++/C# and VB.NET. This release adds test-from-code generation, JUnit-style XML output for integration with CruiseControl and performance improvements.

A discussion on mock objects and mock objects frameworks, including a new one, Rhino Mocks.

Article download (pdf): Mocking Frameworks

Rhino Mocks:

A dynamic mock object framework for the .Net platform. Its purpose is to ease testing by allowing the developer to create mock implementations of custom objects and verify the interactions using unit testing.

Rhino.Mocks is based on EasyMock.Net and released under the same BSD license. It’s free for use and modification for free and commercial software. Rhino.Mocks is an attempt to create easier way to build and use mock objects and allow better refactoring support from the current tools. It’s a hybrid approach between the pure Record/Replay of EasyMock.Net’s model and NMock’s expectation based model.

Rhino.Mocks allows easier injection of custom code into the validation code.
{Free/BSD} r

IETest, an open source testing framework for Internet Explorer based web applications has been released.
It is written in C#.
See IETest.

AnyUnit version 1.2 is now released and ready for download at www.anyunit.com.

AnyUnit is an unit testing environment that allows developers to work with virtually any type of test frameworks, commercial and open source. This release adds VB.NET support, command line test execution, tasklist propagation with test failures, more detailed test runners and a choice to store UT-related information in separate files or directly in solution and projects.

The TestNG team is happy to announce the availability of TestNG 2.3.

The version is available here as well as the new documentation, which has been considerably improved (highlighted code snippets, detailed DTD, ant task and description of all the new features).What’s new:

* beforeSuite, afterSuite, beforeTest, afterTest
* Revamped ant task with haltonfailure and other helpful flags
* Better stack traces and improved level control for verbosity
* Better syntax for including and excluding methods in testng.xml
* Test classes can be invoked on the command line
* … and many bug fixes.

For Eclipse users, a new version (1.1.1) of the Eclipse plug-in that includes this new TestNG version is available on the remote update site or for direct download.

Also, TestNG has joined OpenSymphony (big thanks to Patrick and Hani for setting this up). As a consequence of this move, there is now a TestNG users forum as well as a Wiki and JIRA for issue tracking.

The users mailing-list has been moved to Google Groups and is connected to the forum, so you only need to subscribe to one.

Try it and let us know what you think!

[First, this news is not about the alphaworks JUnitX project (assertions extensions) but about the original extreme-java.de one (private/protected methods testing).]

I just wrote a little tutorial explaining how to use JUnitX to test private parts of your code. Its purpose is not to choose a camp (testing private parts or not), but to explain how to use JUnitX in case you need it, not the "why" of its use.

For our project needs, I’ve recently played with the JUnitX source code and patched it to make it easier to use: combined with javassist, this version not longer needs you to create TestProxy classes in your production code. (see section " JUnitX 5.2 -> No need for TestProxy !", to download this version)

Original version was created by Andreas Heilwagen but this project doesn’t seem to be supported anymore

Changelog for this version:
.avoid TestProxy classes creation
.static private methods testing.

Comments and remarks welcome.

JUnitX How to

The TestNG team is happy to announce the first release of the TestNG plug-in for Eclipse.

This first release covers the basic functionalities of TestNG, among which:

* Multiple ways to launch tests (from a method, from a class, groups or an entire suite).
* Convenient report view that lets you directly jump to failed tests.

A more detailed overview can be found here, and the documentation and snapshots here.

–
Cedric

JunitScenario is an automation framework on top of JUnit to perform functional tests and stressing tests. JUnitScenario is a tool to simulate real life usage of applications. It allows you to describe scenarios that are composed of unit tests calls and simulate several users following those scenarios.

Visit JUnitScenario for more details.

SimpleTest is a PHP unit tester, web tester and mock objects generator. It has finally reached a stable version 1.0 release.

The tool can be downloaded from the SimpleTest Sourceforge project page and tutorials can be read in English and French.

Enhance your automated testing solution, VisualCoder v1.0 allows non-developers, QA or non-techies to author tests visually, i.e. – drag & drop simplicity programming. Reuse your NUnit tests visually to create new tests programs adding another dimension to your testing.

VisualCoder v1.0 introduces "V" programming that is "real" visual and simple, plus it has built-in class and member functions generator helping out under the curtain to extract and make available for reuse in UI, any reusable block of code in your (test) program, further simplifying layout and structure of your otherwise possibly complex test program.XML results streaming also guarantees scalability in execution and storage of results of your long running and results "hog" test program. Plus, your team will find the rich and "drilldown" generated reports to be an indispensable tool in after-run analyses. Once you lay your hands in this tool, you’ll never do auto-testing without it again.

Don’t worry if you’re not an NUnit enthusiast, your environment and test framework is just a plugin away to be supported by VisualCoder. NUnit plugin ships w/ the tool to serve as a pattern in writing a test plugin and we can also help out if you stumble in the process.

Highly recommended! Try out now and reap the benefits of "real" visual programming.

4A Technologies
[email]4atechies@yahoogroups.com[/email]

The PHP unit tester, mock objects generator and web tester, SimpleTest has positively definitely released its final candidate before hitting the 1.0 milestone.

This variant includes a large number of minor HTTP fixes and improvements such as more tolerant matching of page text. It also has a workaround for the "nesting too deep" bug (#31449) in the PHP language when comparing mocks.

Pending the publication of the API documentation and the French translations the final release will happen in a few weeks. In other regards the project is now stable.

Yours, Marcus