testdriven.com Wrangling quality out of chaos

Archive for November, 2009

UquoniTest 2.0 released

11.30.2009 · Posted in Tools

Q-Mentum just released UquoniTest 2.0, an advanced unit testing library for C++, that provides many features that other unit testing frameworks don’t have.

Major features:

* Rich Booleans in assertions for easier checks and more information about failures
* Easy creation of (reusable) test directories
* A powerful mock framework
* Parameterized and template tests
* Automatic registering of tests
* Orthodoxy tests
* Reporting of failing assertions in domain code
* Checking if an expression remains constant throughout all tests
* Custom test listeners and test wrappers
* Abstract test (also multiple levels and multiple inheritance)

Platforms:
Visual C++ 6, 2003, 2005, 2008, MingW gcc, gcc on Linux

More info: UquoniTest.

Qt and Java GUI Test Automation: Many Years of Squish Success at ARM Ltd.

11.12.2009 · Posted in Tools

Introduction

ARM Ltd., is a well-established company that designs the technology that lies at the heart of many advanced digital products. ARM’s product offering includes RISC microprocessors, graphics processors, enabling software, cell libraries, embedded memories, high-speed connectivity products, peripherals, and development tools.

We had the pleasure of discussing ARM’s use of Squish with Dave Dextor, one of ARM’s Staff Validation Engineers.

Why Squish?

ARM originally evaluated Squish several years ago, and bought their first licenses around 2005. We asked Dave what motivated ARM to choose Squish, and he told us:

The ease of use of Squish along with the object map which can be used to reduce the maintenance of tests were two key factors. And support of multiple operating systems and technologies—especially for Qt and Linux—was also very important.

Squish’s unique object map makes it possible to identify application objects. When application objects change, the object map makes it possible for test engineers to make simple changes to the object map so that objects continue to be correctly identified by test scripts—without having to modify the tests themselves.

Dave also mentioned some of the other features that made Squish attractive to ARM, in particular the ease with which it is possible to do data driven testing, Squish’s support for multiple standard scripting languages, and the fact that Squish has better features than competing tools.

Squish at ARM

ARM started out by using Squish for GUI testing of a proprietary debugger and an Eclipse-based IDE. The debugger was written using Qt and it was when looking for a suitable testing tool for this that ARM first came across Squish. They are now developing a new Eclipse-based debugger in Java and plan to use Squish to provide automated GUI testing for that tool.

The software that Squish is used to test runs on Windows and Linux (specifically, Windows XP, Windows Vista, and Red Hat Enterprise Linux 3 and 4).

Dave told us that one of the biggest challenges ARM had encountered when it came to creating and maintaining tests was keeping the tests current in the face of changes to the software across build cycles. Another challenge was to automate the testing process as much as possible based on the ARM cluster they use as a centralized server for development and testing.

At present, ARM make most use of Squish’s command line tools to provide the maximum amount of test automation possible. Dave said that Squish had been particularly helpful in making testing cycles shorter, and also reducing the amount of human resources needed for testing.

Other than Squish, ARM support their testing process and test automation using in-house developed scripts (in Perl and Python), and proprietary debugger automation software. They also make extensive use of JUnit (a unit testing framework for Java) and CXXTest (a JUnit-like unit testing framework for C and C++).

Regarding froglogic’s technical support, Dave told us:

It’s been very helpful on the few occasions I’ve needed it.

Conclusion

ARM produce cross-platform tools based on Qt and Java technologies. Squish has enabled them to use the same testing tool chain on all the platforms they support and using both the GUI technologies they use—as well as giving their test engineers the freedom to use the scripting languages they prefer. ARM now have several years of experience using Squish, and Dave tells us that in future they plan to use Squish even more than they do now.

froglogic’s team would like to thank Dave for taking the time to share ARM’s experience with Squish, and we are looking forward to a continued successful relationship.

Visit http://www.froglogic.com to learn more about Squish and to get your free and supported evaluation copy!

JetBrains releases YouTrack 1.0, keyboard-centric issue tracker

11.07.2009 · Posted in Tools

JetBrains has released its brand new bug and issue tracker, YouTrack 1.0!

YouTrack helps solve most issue-handling tasks with two simple, keyboard-driven controls: a search box and a command window.

YouTrack key features include:

* Issue reporting with a single shortcut from anywhere within the product.
* Query-based search with query completion and highlighting.
* Powerful commands to quickly modify multiple issues.
* Natural-language-like query and command syntax.
* Extensive keyboard support for creating, editing, and navigating between issues easily.
* AJAX-based user interface for extremely fast issue handling.
* Importing existing projects from JIRA 3.x.
* Integration with external tools, including LDAP, OpenID, and JetBrains TeamCity.

YouTrack 1.0 is available in two editions, Enterprise Edition and Professional Edition. Both editions sell at 50% off before the New Year.

[url=http://www.jetbrains.com/youtrack/?utm_source=testdriven&utm_medium=News&utm_campaign=YouTrack]Learn more and download YouTrack[/url] at JetBrains web site.

Testing TV

11.07.2009 · Posted in Links

Testing TV is a directory of software testing and software quality assurance videos and tutorials. It covers unit testing, functional testing, load testing, performance testing, test driven development. configuration management.
link

Tags:

Automation support for Exploratory Testing

11.01.2009 · Posted in Advisories

From http://tech.groups.yahoo.com/group/aa-ftt/ mailing list:

I attended Michael Bolton’s session on exploratory testing a few years ago and it’s fair to say it inspired me, even though my job duty specifically is as an automation guy. I built a series of Ruby modules to allow our exploratory testers to use the Ruby IRB, in combination with Watir, to make their exploratory testing more efficient.

Have there been any (or many) presentations specifically on this? I thought it might make a nice 40-minute presentation to show how you can create helper modules and have them auto-loaded when you load the watir-console, and then use them to help with ET. Some ways we’ve used a helper method for the watir-console are:

– Allowing the user to go to a specific spot in the web application by calling a single method.
– Calling a method with an integer as a parameter to tell it to do something multiple times
– Calling a method with a list as a parameter to send a collection of values to a method (such as creating users with specific names).

Anyway…does this sound like something that would be of value? Or too elementary? I’d love some feedback.

Thanks,

Jim