CallMation WerkMATE FAQs

CallMation's WerkMATE Test Automation Framework is very easy to deploy and use. But, in case you have any questions, here is a list of FAQs that we have found will most often provide you with the answer you need.

  1. Why automate my test environment?
  2. How does WerkMATE's web feature work?
  3. Can I use more than one vendors' testing equipment at one time to manage my DUTs and DITs?
  4. What operating system do I need on my PC to load WerkMATE?
  5. What Browser do I need if I want to use the web access?
  6. What programs or scripts can I run?
  7. Why do I need a central repository?
  8. What are the minimum system and network requirements to load WerkMATE?
  9. How many tests can WerkMATE run simultaneously?
  10. I installed WerkMATE but when I click the icon it doesn't start. Is my license valid?
  11. I started the tomcat server but nothing happens after that. How do I start using WerkMATE?

1. Why automate my test environment?

WerkMATE allows you to run tests all day, every day, instead of only over the course of an 8 hour day. This fully utilizes equipment that is idle overnight, on weekends and on holidays, giving you a 300% improvement on hardware usage and efficiency! And, you don't have to purchase more equipment to support test teams during their 8–hour day.

Automation also allows you to batch scripts together from individual testers to assure test consistency, and synchronize and repeat functions so that simulated testing loads are more like a real world environment.

Automation processes perform multiple and concurrent provisioning and query function–type tests, consolidate results from all of the devices, analyze results, generate reports, and even email results to users upon completion.

So, automation helps you maximize productivity, improve reporting, assure consistency of results and product quality, and minimize labor time and costs. These greater efficiencies streamline processes, significantly reducing time to market of revenue generating products.

2. How does WerkMATE's web feature work?

WerkMATE, the ONLY test framework solution that offers a web interface to your entire testing framework, means 7 x 24 access! It is accessible from any Internet browser–capable device, including a PC, MAC, UNIX or Linux servers, iPhone, PDA, or G1 mobile device.

Access, manage and automate multiple test scripts for VoIP, IMS, IPTV, PSTN, and Wireless devices, at any time, from anywhere!

Access, monitor and control all Devices Under Test and Devices Involved in Test, via telnet, SSH and Web GUIs from anywhere in the world, and can perform concurrent tests and gather results across multiple devices.

You also have access to the complete online repository to easily share test information (cases, results, reports) across organizations.

3. Can I use more than one vendors' testing equipment at one time to manage my DUTs and DITs?

Yes. WerkMATE allows you to simultaneously manage and control all Devices Under Test (DUT) and Devices Involved in Test (DIT) on test equipment from all of the major test equipment vendors.

WerkMATE has been tested with such notable test equipment manufacturers as Empirix (Hammer), NetHawk (EAST), Spirent (ABACUS) and many more, including generic devices. You can easily create your own adapter to any piece of test equipment or device under test.

4. What operating system do I need on my PC to load WerkMATE?

You can load WerkMATE onto any PC with Windows® XP or Vista™. You can also use Linux or Unix.

5. What Browser do I need if I want to use the web access?

You can use any industry–recognized browser including IE6, IE7, Firefox, Safari, Opera, Chrome, and Netscape. You don't need to install any client or proprietary software.

6. What programs or scripts can I run?

WerkMATE allows you to have concurrent automated control of test equipment and DUTs

  • WerkMATE allows you to run any Windows program, including wireshark, SIPp, hyperterm, .bat, and Perl
  • You can also run any Linux/Unix command or script, including Bash, Perl, Expect, TCL, Python
  • You can execute command line and/or GUI record record/playback for Sahi, Selenium, etc.
  • You can also execute DUT CLI sequences, such as iteration, response analysis, command files

7. Why do I need a central repository?

Users around the campus or around the world can instantly share test information without transferring any data.

A central repository ensures accurate reporting. You can view current or historical test results, and get completion summary reports. You can also obtain testing metrics by test case, user, release#, defect #, date.

More importantly you can consolidate existing and new test scripts into a centralized automation framework.

WerkMATE offers:

  • Sophisticated results analysis and a flexible reporting module;
  • Real–time progress tracking and test monitoring;
  • Summary reports, periodic reports, flexible report engine using iReports;
  • Online test status monitoring;
  • Exportable results to PDF, HTML, XML, CSV.

8. What are the minimum system and network requirements to load WerkMATE?

Below are our recommended and minimum system requirements:

Hardware Specifications:
Minimum
Recommended
Memory: 512 MB 2 GB
Disk: 20 GB 160 GB
Network: 10 MB 100 MB
Processor: P4 2.5 GHz Server Sizing Table Below*

Server Sizing Table*:

(WerkMATE device adapters are threaded and performance scales linearly as the number of processors increase. Performance estimates are based on the number of users running tests simultaneously.)

  • 1–10 Simultaneous Users – 1 Dual Core Intel® Xeon®, 2 Gb memory
  • 10–50 Simultaneous Users – 2 Dual Core Intel® Xeon® 5110, 2 Gb memory
  • 50–100 Simultaneous Users – Intel® Core™1 Quad Core processor Q6600 with 4 processing cores, 2 Gb memory
  • Over 100 Simultaneous Users – Intel® Core™2 Quad Core processor Q6600 with 4 processing cores, 4 Gb memory

9. How many tests can WerkMATE run simultaneously?

Measurements were taken for 1, 10, 50, 100, 150, 200, 250, 300, 400, and 500 simultaneous test cases. On a low end ($399) PC, WerkMATE reached its maximum capacity at 150 simultaneous tests.

WerkMATE Performance

10. I installed WerkMATE but when I click the icon it doesn't start. Is my license valid?

Once installed, you'll need to save the attached license file in:
 C:\Tomcat5\webapps\WerkMate\WEB–INF\classes.

WerkMate will not run without a valid license file installed. A valid file license.LIC must be present in the folder shown below. To obtain a valid license file, contact sales@callmation.net

example

Evaluation Licenses

An evaluation license will be emailed to you at the start of your agreed test evaluation period. Your license file contains limitations on the time period the software will function properly and is limited by the number of times tests can be executed. The evaluation software will expire when the time period or the number of runs is reached, whichever comes first. Contact sales@callmation.net for any licensing questions.

  • Licensor=CallMation
  • Licensee=Customer
  • Host ID=AABBC
  • Number of Devices=Unlimited
  • Number of Users=5
  • Number of Test Cases=Unlimited
  • Number of Runs=25
  • Feature Package=eval
  • Expiration=2008–xx–yy–zz

 

Purchased License

WerkMate product licenses are created to enable the purchased feature set.

  • Licensor=CallMation
  • Licensee=Customer
  • Host ID=AABBC
  • Number of Devices=5
  • Number of Users=5
  • Number of Test Cases=1000
  • Number of Runs=unlimited
  • Feature Package=WerkMate 1.4A
  • Expiration=Never

 

11. I started the tomcat server but nothing happens after that. How do I start using WerkMATE?

Once you start the tomcat server, you will see INFO: Server startup 6218 ms. At that point you are ready to login to the WerkMATE application using any web browser.

From the server where WerkMate is installed, use the following URL to access the WerkMate applications:

Local Operation
http://localhost:8080/werkmate/login.html

If you run your browser from any host other than the WerkMate server (localhost), use the IP address of the WerkMate server instead of localhost in the URL.

Remote Operation
http:// your.server.ip.address /werkmate/login.html

You should see the following login screen if WerkMate is running properly.

**** The default username is admin and the default password is admin until changed by the system administrator.