Negative Testing with Selenium JUnit 4 Remote Control and Eclipse

[Claudiu Barbulescu]

Hi,
I created the following script. I use Eclipse and JUnit 4:

package com.example.tests;

import com.thoughtworks.selenium.*;
import org.junit.After;
import org.junit.Before;
import org.junit.Test;
import java.util.regex.Pattern;

public class SeleniumJUnit extends SeleneseTestCase {
@Before
public void setUp() throws Exception {
selenium = new DefaultSelenium ("localhost", 4444, "*chrome", "http://dev.server.com/");
selenium.setSpeed("2000");// to run the script slow
selenium.start();
}

@Test
public void testFoobar() throws Exception {
selenium.open("/company/login");
selenium.click("link=I want to create an account");
selenium.waitForPageToLoad("30000");
selenium.type("name=username", "Claudiu");
selenium.type("name=email", "An email address");
selenium.type("name=password", "test");
selenium.type("name=retype_password", "test");
selenium.type("name=security", "XYZ");
selenium.click("name=submit_register");
selenium.waitForPageToLoad("30000");
selenium.click("name=terms_submit");
selenium.waitForPageToLoad("30000");
System.out.println("Sleeping for 9 seconds");
Thread.sleep(9000);
}


@After
public void tearDown() throws Exception {
selenium.stop();
}
}


The script will try to create an Business account to a website for example.
I want to to build a new script for Negative Testing (enter wrong data in the fields, a wrong email format etc).
I know what is Negative Testing but I used most in Manual Testing.
Now I want to learn Negative Testing on Automated Testing. I am beginner with Automated Testing.
So, my first question is: How to modify the attached code to make Negative Testing on that page?
Second question: for Negative Testing is more OK to make a new script or can be added to Positive Testing script( to the same code)?
In Eclipse -> JUnit Test Validation bar(Pass or Fail) should be red when make negative testing or green?
Can you modify for me the above code to make Negative Testing to understand exactly how it's works?

I wait for an response,
Thank you very much!
Claudiu

[dennis deems]

Claudiu Barbulescu wrote:

The script will try to create an Business account to a website for example.
I want to to build a new script for Negative Testing (enter wrong data in the fields, a wrong email format etc).
I know what is Negative Testing but I used most in Manual Testing.
Now I want to learn Negative Testing on Automated Testing. I am beginner with Automated Testing.
So, my first question is: How to modify the attached code to make Negative Testing on that page?

First I want to point out that the existing test method doesn't make any assertions. I consider this bad form. I would complete the test case by verifying that an account was actually created, or at least that a confirmation message is displayed to the user. The negative test would submit invalid data in the form and then, perhaps, verify that an account was not created.

Second question: for Negative Testing is more OK to make a new script or can be added to Positive Testing script( to the same code)?

Yes, you can simply add another test method to the class, something like testWrongData, and fill out the form with invalid data.

In Eclipse -> JUnit Test Validation bar(Pass or Fail) should be red when make negative testing or green?

In any test case, we are testing that our application behaves the way we want it to. Red means the test failed -- the application did NOT behave the way we want. Green means the test passed. In a lot of tests we assume the user is interacting with the application exactly as we expect him to. But a negative test tries to suppose the user makes mistakes, and our application handles those situations gracefully. So we always want to see green, regardless of the condition that's being tested.

Can you modify for me the above code to make Negative Testing to understand exactly how it's works?

No, because I don't know the validation rules. But all you need to do is enter invalid data in the form instead of valid data. A friendly application would then display some message to the user informing them that the entered data is bad, and you can write assertions that those messages exist on the page.

[Claudiu Barbulescu]

There are no special validation rules. In general for example the User?Email field: the system will check if a user or email already exists in system(database). If the user/email is already registered a message will appears in the site.
Below I build a new test on another web site. The user try to create an account with username and email that already exists. In this case the system must return a message. The same situation when add invalid data like wrong email format, etc.

package com.example.tests;

import com.thoughtworks.selenium.*;
import org.junit.After;
import org.junit.Before;
import org.junit.Test;
import java.util.regex.Pattern;

public class CreateAccount extends SeleneseTestCase {
	@Before
	public void setUp() throws Exception {
		selenium = new DefaultSelenium("localhost", 4444, "*firefox", "http://1.2.3.4/");
		selenium.setSpeed("2000");// to run the script slow
		selenium.start();
		System.out.println("SetUp is running");//
	}

	@Test
	public void testCreateAccount() throws Exception {
		System.out.println("test CreateAccount is running");//
		selenium.open("/ss/");
		selenium.click("css=a.jqTransformSelectOpen");
		selenium.click("link=Register");
		selenium.waitForPageToLoad("30000");
		selenium.type("name=name", "Claudiu Barbulescu");
		selenium.type("name=email", "An email address");
		selenium.type("name=security_code", "super");
		selenium.click("name=new_user");
		selenium.waitForPageToLoad("30000");
		selenium.type("name=password", "test123");
		selenium.type("name=retype_password", "test123");
		selenium.click("name=new_user");
		selenium.waitForPageToLoad("30000");
		Thread.sleep(6000);
	}

	
	@After
	public void tearDown() throws Exception {
		System.out.println("TearDown is running");//
		selenium.stop();
	}
}

And here is Negative Testing for the above code when try to create an account:

// Negative Testing for Register page

package com.example.tests;

import com.thoughtworks.selenium.*;
import org.junit.After;
import org.junit.Before;
import org.junit.Test;
import java.util.regex.Pattern;

public class NegativeTesting extends SeleneseTestCase {
	@Before
	public void setUp() throws Exception {
		selenium = new DefaultSelenium("localhost", 4444, "*chrome", "http://1.2.3.4/");
		selenium.setSpeed("2000");
		selenium.start();
	}

	@Test
	public void testRegister() throws Exception {
		selenium.open("/ss/home");
		selenium.click("css=a.jqTransformSelectOpen");
		selenium.click("link=Register");
		selenium.waitForPageToLoad("30000");
//Verify if an account already contain the email
		selenium.type("name=name", "Claudiu");
		selenium.type("name=email", "An email address");
		selenium.type("name=security_code", "asdfg");
		selenium.click("name=new_user");
		selenium.waitForPageToLoad("30000");
		assertTrue(selenium.isTextPresent("This email address already exists);
		selenium.type("name=security_code", "asdfg"); 
		selenium.click("name=new_user");
		selenium.waitForPageToLoad("30000");
		assertTrue(selenium.isTextPresent("› The security code you typed isn't correct"));
		Thread.sleep(6000);
	}

	@After
	public void tearDown() throws Exception {
		selenium.stop();
	}
}

I use assertTextPresent command to assert warning messages from the site. It correct to use this command?If not, give me another example.
Thanks!