TestON/logs/OnosScale4nodes_21_Nov_2013_15_59_17/OnosScale4nodes_21_Nov_2013_15_59_17.log

                                +----------------+
------------------------------ { Script And Files }  ------------------------------
                                +----------------+

	Script Log File : /home/admin/ONLabTest/TestON/logs/OnosScale4nodes_21_Nov_2013_15_59_17/OnosScale4nodes_21_Nov_2013_15_59_17.log
	Report Log File : /home/admin/ONLabTest/TestON/logs/OnosScale4nodes_21_Nov_2013_15_59_17/OnosScale4nodes_21_Nov_2013_15_59_17.rpt
	ONOS4 Session Log : /home/admin/ONLabTest/TestON/logs/OnosScale4nodes_21_Nov_2013_15_59_17/ONOS4.session
	Cassandra3 Session Log : /home/admin/ONLabTest/TestON/logs/OnosScale4nodes_21_Nov_2013_15_59_17/Cassandra3.session
	ONOS2 Session Log : /home/admin/ONLabTest/TestON/logs/OnosScale4nodes_21_Nov_2013_15_59_17/ONOS2.session
	ONOS3 Session Log : /home/admin/ONLabTest/TestON/logs/OnosScale4nodes_21_Nov_2013_15_59_17/ONOS3.session
	ONOS1 Session Log : /home/admin/ONLabTest/TestON/logs/OnosScale4nodes_21_Nov_2013_15_59_17/ONOS1.session
	Cassandra1 Session Log : /home/admin/ONLabTest/TestON/logs/OnosScale4nodes_21_Nov_2013_15_59_17/Cassandra1.session
	Cassandra2 Session Log : /home/admin/ONLabTest/TestON/logs/OnosScale4nodes_21_Nov_2013_15_59_17/Cassandra2.session
	Mininet1 Session Log : /home/admin/ONLabTest/TestON/logs/OnosScale4nodes_21_Nov_2013_15_59_17/Mininet1.session
	Cassandra4 Session Log : /home/admin/ONLabTest/TestON/logs/OnosScale4nodes_21_Nov_2013_15_59_17/Cassandra4.session
	Zookeeper1 Session Log : /home/admin/ONLabTest/TestON/logs/OnosScale4nodes_21_Nov_2013_15_59_17/Zookeeper1.session
	Test Script :/home/admin/ONLabTest/TestON/Tests/OnosScale4nodes.py
	Test Params : /home/admin/ONLabTest/TestON/Tests/OnosScale4nodes.params
	Topology : /home/admin/ONLabTest/TestON/Tests/OnosScale4nodes.tpl
                              +------------------+
---------------------------  { Script Exec Params }  ---------------------------
                              +------------------+

	
	'TargetTime': '50'
	 'testcases': '1
	2
	3
	4'
	 'WaitTime': '50'
	 'NR_Links': '198'
	 'RestIP': '10.128.100.4'
	 'NR_Switches': '100'
	 'Iterations': '2'
	

                               +---------------+
----------------------------- { Components Used }  -----------------------------
                               +---------------+
	ONOS4
	Cassandra3
	ONOS2
	ONOS3
	ONOS1
	Cassandra1
	Cassandra2
	Mininet1
	Cassandra4
	Zookeeper1


                              +--------+
---------------------------- { Topology }  ----------------------------
                              +--------+

	
	'ONOS4': 
	'connect_order': '10'
	 'password': None
	 'type': 'OnosCliDriver'
	 'host': '10.128.100.6'
	 'user': 'admin'
	
	 'Cassandra3': 
	'connect_order': '5'
	 'password': None
	 'type': 'CassandraCliDriver'
	 'host': '10.128.100.5'
	 'user': 'admin'
	
	 'ONOS2': 
	'connect_order': '8'
	 'password': None
	 'type': 'OnosCliDriver'
	 'host': '10.128.100.4'
	 'user': 'admin'
	
	 'ONOS3': 
	'connect_order': '9'
	 'password': None
	 'type': 'OnosCliDriver'
	 'host': '10.128.100.5'
	 'user': 'admin'
	
	 'ONOS1': 
	'connect_order': '7'
	 'password': None
	 'type': 'OnosCliDriver'
	 'host': '10.128.100.1'
	 'user': 'admin'
	
	 'Cassandra1': 
	'connect_order': '3'
	 'password': None
	 'type': 'CassandraCliDriver'
	 'host': '10.128.100.1'
	 'user': 'admin'
	
	 'Cassandra2': 
	'connect_order': '4'
	 'password': None
	 'type': 'CassandraCliDriver'
	 'host': '10.128.100.4'
	 'user': 'admin'
	
	 'Mininet1': 
	'connect_order': '25'
	 'host': '10.128.100.11'
	 'user': 'admin'
	 'COMPONENTS': 
	'arg1': ''
	 'arg2': '--topo linear
	100 --arp'
	 'controller': 'remote
	ip=10.128.100.1
	port=6633'
	
	 'password': None
	 'type': 'MininetCliDriver'
	
	 'Cassandra4': 
	'connect_order': '6'
	 'password': None
	 'type': 'CassandraCliDriver'
	 'host': '10.128.100.6'
	 'user': 'admin'
	
	 'Zookeeper1': 
	'connect_order': '2'
	 'host': '10.128.100.1'
	 'user': 'admin'
	 'COMPONENTS': ''
	 'password': None
	 'type': 'ZookeeperCliDriver'
	
	
------------------------------------------------------------


******************************
 CASE INIT 
******************************

2013-11-21 15:59:17,995 - OnosScale4nodes - INFO - Creating component Handle: Zookeeper1
2013-11-21 15:59:18,070 - OnosScale4nodes - INFO - Password not required logged in
2013-11-21 15:59:18,173 - OnosScale4nodes - INFO - Starting Zookeeper
2013-11-21 15:59:20,879 - OnosScale4nodes - WARNING - zookeeper ... already running
2013-11-21 15:59:20,880 - OnosScale4nodes - INFO - Creating component Handle: Cassandra1
2013-11-21 15:59:20,941 - OnosScale4nodes - INFO - Password not required logged in
2013-11-21 15:59:21,045 - OnosScale4nodes - INFO - Creating component Handle: Cassandra2
2013-11-21 15:59:21,106 - OnosScale4nodes - INFO - Password not required logged in
2013-11-21 15:59:21,209 - OnosScale4nodes - INFO - Creating component Handle: Cassandra3
2013-11-21 15:59:21,265 - OnosScale4nodes - INFO - Password not required logged in
2013-11-21 15:59:21,369 - OnosScale4nodes - INFO - Creating component Handle: Cassandra4
2013-11-21 15:59:21,415 - OnosScale4nodes - INFO - Password not required logged in
2013-11-21 15:59:21,518 - OnosScale4nodes - INFO - Creating component Handle: ONOS1
2013-11-21 15:59:21,582 - OnosScale4nodes - INFO - Password not required logged in
2013-11-21 15:59:21,685 - OnosScale4nodes - INFO - Creating component Handle: ONOS2
2013-11-21 15:59:21,744 - OnosScale4nodes - INFO - Password not required logged in
2013-11-21 15:59:21,848 - OnosScale4nodes - INFO - Creating component Handle: ONOS3
2013-11-21 15:59:21,901 - OnosScale4nodes - INFO - Password not required logged in
2013-11-21 15:59:22,006 - OnosScale4nodes - INFO - Creating component Handle: ONOS4
2013-11-21 15:59:22,067 - OnosScale4nodes - INFO - Password not required logged in
2013-11-21 15:59:22,171 - OnosScale4nodes - INFO - Creating component Handle: Mininet1
2013-11-21 15:59:22,236 - OnosScale4nodes - INFO - Password not required logged in
2013-11-21 15:59:22,339 - OnosScale4nodes - INFO - Clearing any residual state or processes
2013-11-21 15:59:25,379 - OnosScale4nodes - INFO - Clean
2013-11-21 15:59:25,380 - OnosScale4nodes - INFO - building fresh mininet
2013-11-21 15:59:25,627 - OnosScale4nodes - INFO -  Creating network
2013-11-21 15:59:25,627 - OnosScale4nodes - INFO -  Adding controller
2013-11-21 15:59:25,814 - OnosScale4nodes - INFO -  Adding hosts:
2013-11-21 15:59:26,971 - OnosScale4nodes - INFO -  Adding switches:
2013-11-21 15:59:30,999 - OnosScale4nodes - INFO -  Adding links:
2013-11-21 16:00:02,018 - OnosScale4nodes - INFO -  Configuring hosts
2013-11-21 16:01:06,154 - OnosScale4nodes - INFO -  Starting controller
2013-11-21 16:01:06,154 - OnosScale4nodes - INFO -  Starting 100 switches
2013-11-21 16:02:07,742 - OnosScale4nodes - INFO -  Starting CLI:
2013-11-21 16:02:07,759 - OnosScale4nodes - INFO - mininet built


******************************
 Result summary for Testcase1
******************************

2013-11-21 16:02:09,040 - OnosScale4nodes - WARNING - ONOS wasn't running
2013-11-21 16:02:09,810 - OnosScale4nodes - WARNING - ONOS wasn't running
2013-11-21 16:02:10,735 - OnosScale4nodes - WARNING - ONOS wasn't running
2013-11-21 16:02:11,508 - OnosScale4nodes - WARNING - ONOS wasn't running
2013-11-21 16:02:11,509 - OnosScale4nodes - INFO - Starting Cassandra
2013-11-21 16:02:17,144 - OnosScale4nodes - INFO - Cassandra Started 
2013-11-21 16:02:17,145 - OnosScale4nodes - INFO - Starting Cassandra
2013-11-21 16:02:22,913 - OnosScale4nodes - INFO - Cassandra Started 
2013-11-21 16:02:22,913 - OnosScale4nodes - INFO - Starting Cassandra
2013-11-21 16:02:28,547 - OnosScale4nodes - INFO - Cassandra Started 
2013-11-21 16:02:28,548 - OnosScale4nodes - INFO - Starting Cassandra
2013-11-21 16:02:34,194 - OnosScale4nodes - INFO - Cassandra Started 
2013-11-21 16:02:56,579 - OnosScale4nodes - INFO - Keyspace dropped
2013-11-21 16:03:06,250 - OnosScale4nodes - INFO - ONOS Started 
2013-11-21 16:03:26,436 - OnosScale4nodes - INFO - ONOS Started 
2013-11-21 16:03:36,688 - OnosScale4nodes - INFO - ONOS Started 
2013-11-21 16:03:48,456 - OnosScale4nodes - INFO - ONOS Started 
2013-11-21 16:03:50,892 - OnosScale4nodes - INFO - Executed :~/ONOS/start-rest.sh start 		 Expected Prompt '\$' Found
2013-11-21 16:03:50,894 - OnosScale4nodes - INFO - Rest Server Started Successfully
2013-11-21 16:04:01,149 - OnosScale4nodes - INFO - Executed :~/ONOS/start-rest.sh status  		 Expected Prompt 'running' Found
2013-11-21 16:04:01,151 - OnosScale4nodes - INFO - Rest Server is running
2013-11-21 16:04:01,252 - OnosScale4nodes - INFO - Executed :
 		 Expected Prompt '\$' Found

[2013-11-21 16:04:01.369854] [OnosScale4nodes] [CASE]  Checking if the startup was clean...

[2013-11-21 16:04:01.372337] [OnosScale4nodes] [STEP]  INIT : Initializing the test case :Checking if the startup was clean...

[2013-11-21 16:04:01.375057] [OnosScale4nodes] [STEP]  1.1: Testing startup Zookeeper
2013-11-21 16:04:01,720 - OnosScale4nodes - INFO - Executed :
 		 Expected Prompt '\$' Found
2013-11-21 16:04:02,461 - OnosScale4nodes - INFO - Executed :~/zookeeper-3.4.5/bin/zkServer.sh status  		 Expected Prompt 'Mode' Found
2013-11-21 16:04:02,466 - OnosScale4nodes - INFO - Verifying the Expected is equal to the actual or not using assert_equal
2013-11-21 16:04:02,466 - OnosScale4nodes - INFO - Zookeeper is up!
2013-11-21 16:04:02,467 - OnosScale4nodes - INFO - Assertion Passed

[2013-11-21 16:04:02.468133] [OnosScale4nodes] [STEP]  1.2: Testing startup Cassandra
2013-11-21 16:04:02,470 - OnosScale4nodes - INFO - trying 5 times
2013-11-21 16:04:02,782 - OnosScale4nodes - INFO - Executed :
 		 Expected Prompt '\$' Found
2013-11-21 16:04:04,634 - OnosScale4nodes - INFO - Verifying the Expected is equal to the actual or not using assert_equal
2013-11-21 16:04:04,635 - OnosScale4nodes - INFO - Cassandra is up!
2013-11-21 16:04:04,635 - OnosScale4nodes - INFO - Assertion Passed

[2013-11-21 16:04:04.636891] [OnosScale4nodes] [STEP]  1.3: Testing startup ONOS
2013-11-21 16:04:04,740 - OnosScale4nodes - INFO - Executed :
 		 Expected Prompt '\$' Found
2013-11-21 16:04:05,635 - OnosScale4nodes - INFO - Executed :~/ONOS/start-onos.sh status  		 Expected Prompt 'running' Found
2013-11-21 16:04:05,737 - OnosScale4nodes - INFO - Executed :
 		 Expected Prompt '\$' Found
2013-11-21 16:04:05,839 - OnosScale4nodes - INFO - Executed :tail ~/ONOS/onos-logs/onos.*.log 		 Expected Prompt '\$' Found
2013-11-21 16:04:35,957 - OnosScale4nodes - INFO - Executed :
 		 Expected Prompt '\$' Found
2013-11-21 16:04:36,059 - OnosScale4nodes - INFO - Executed :tail ~/ONOS/onos-logs/onos.*.log 		 Expected Prompt '\$' Found
2013-11-21 16:04:36,061 - OnosScale4nodes - INFO - ONOS process is running...
2013-11-21 16:04:36,062 - OnosScale4nodes - INFO - Assertion Passed
2013-11-21 16:04:36,072 - OnosScale4nodes - INFO - Onos log is moving! It's looking good!
2013-11-21 16:04:36,225 - OnosScale4nodes - INFO - Executed :
 		 Expected Prompt '\$' Found
2013-11-21 16:04:36,878 - OnosScale4nodes - INFO - Executed :~/ONOS/start-onos.sh status  		 Expected Prompt 'running' Found
2013-11-21 16:04:36,982 - OnosScale4nodes - INFO - Executed :
 		 Expected Prompt '\$' Found
2013-11-21 16:04:37,085 - OnosScale4nodes - INFO - Executed :tail ~/ONOS/onos-logs/onos.*.log 		 Expected Prompt '\$' Found
2013-11-21 16:05:07,204 - OnosScale4nodes - INFO - Executed :
 		 Expected Prompt '\$' Found
2013-11-21 16:05:07,306 - OnosScale4nodes - INFO - Executed :tail ~/ONOS/onos-logs/onos.*.log 		 Expected Prompt '\$' Found
2013-11-21 16:05:07,307 - OnosScale4nodes - INFO - ONOS process is running...
2013-11-21 16:05:07,308 - OnosScale4nodes - INFO - Assertion Passed
2013-11-21 16:05:07,322 - OnosScale4nodes - INFO - Onos log is moving! It's looking good!
2013-11-21 16:05:07,510 - OnosScale4nodes - INFO - Executed :
 		 Expected Prompt '\$' Found
2013-11-21 16:05:08,172 - OnosScale4nodes - INFO - Executed :~/ONOS/start-onos.sh status  		 Expected Prompt 'running' Found
2013-11-21 16:05:08,274 - OnosScale4nodes - INFO - Executed :
 		 Expected Prompt '\$' Found
2013-11-21 16:05:08,376 - OnosScale4nodes - INFO - Executed :tail ~/ONOS/onos-logs/onos.*.log 		 Expected Prompt '\$' Found
2013-11-21 16:05:38,487 - OnosScale4nodes - INFO - Executed :
 		 Expected Prompt '\$' Found
2013-11-21 16:05:38,590 - OnosScale4nodes - INFO - Executed :tail ~/ONOS/onos-logs/onos.*.log 		 Expected Prompt '\$' Found
2013-11-21 16:05:38,591 - OnosScale4nodes - INFO - ONOS process is running...
2013-11-21 16:05:38,591 - OnosScale4nodes - INFO - Assertion Passed
2013-11-21 16:05:38,611 - OnosScale4nodes - INFO - Onos log is moving! It's looking good!
2013-11-21 16:05:38,820 - OnosScale4nodes - INFO - Executed :
 		 Expected Prompt '\$' Found
2013-11-21 16:05:39,464 - OnosScale4nodes - INFO - Executed :~/ONOS/start-onos.sh status  		 Expected Prompt 'running' Found
2013-11-21 16:05:39,567 - OnosScale4nodes - INFO - Executed :
 		 Expected Prompt '\$' Found
2013-11-21 16:05:39,669 - OnosScale4nodes - INFO - Executed :tail ~/ONOS/onos-logs/onos.*.log 		 Expected Prompt '\$' Found
2013-11-21 16:06:09,788 - OnosScale4nodes - INFO - Executed :
 		 Expected Prompt '\$' Found
2013-11-21 16:06:09,890 - OnosScale4nodes - INFO - Executed :tail ~/ONOS/onos-logs/onos.*.log 		 Expected Prompt '\$' Found
2013-11-21 16:06:09,891 - OnosScale4nodes - INFO - ONOS process is running...
2013-11-21 16:06:09,891 - OnosScale4nodes - INFO - Assertion Passed
2013-11-21 16:06:09,903 - OnosScale4nodes - INFO - Onos log is moving! It's looking good!
2013-11-21 16:06:09,903 - OnosScale4nodes - INFO - Verifying the Expected is equal to the actual or not using assert_equal
2013-11-21 16:06:09,904 - OnosScale4nodes - INFO - ONOS is up and running!
2013-11-21 16:06:09,904 - OnosScale4nodes - INFO - Assertion Passed


*****************************
 Result: Pass 
*****************************



******************************
 Result summary for Testcase2
******************************


[2013-11-21 16:06:09.909843] [OnosScale4nodes] [CASE]  Timing Onos Convergence for switch -> a single ONOS node in the cluster

[2013-11-21 16:06:09.911545] [OnosScale4nodes] [STEP]  INIT : Initializing the test case :Timing Onos Convergence for switch -> a single ONOS node in the cluster

[2013-11-21 16:06:09.913291] [OnosScale4nodes] [STEP]  2.1: Bringing ONOS down...
2013-11-21 16:06:09,914 - OnosScale4nodes - INFO - all switch no controllers
2013-11-21 16:06:23,088 - OnosScale4nodes - INFO - bringing ONOS down
2013-11-21 16:06:24,326 - OnosScale4nodes - WARNING - ONOS wasn't running
2013-11-21 16:06:25,151 - OnosScale4nodes - WARNING - ONOS wasn't running
2013-11-21 16:06:25,954 - OnosScale4nodes - WARNING - ONOS wasn't running
2013-11-21 16:06:26,760 - OnosScale4nodes - WARNING - ONOS wasn't running
2013-11-21 16:06:26,760 - OnosScale4nodes - INFO - Dropping keyspace...
2013-11-21 16:06:28,893 - OnosScale4nodes - INFO - Keyspace dropped
2013-11-21 16:06:33,899 - OnosScale4nodes - INFO - Bringing ONOS up
2013-11-21 16:06:43,427 - OnosScale4nodes - INFO - ONOS Started 
2013-11-21 16:06:58,542 - OnosScale4nodes - INFO - ONOS Started 
2013-11-21 16:07:09,184 - OnosScale4nodes - INFO - ONOS Started 
2013-11-21 16:07:19,960 - OnosScale4nodes - INFO - ONOS Started 
2013-11-21 16:07:20,267 - OnosScale4nodes - INFO - Executed :
 		 Expected Prompt '\$' Found
2013-11-21 16:07:21,201 - OnosScale4nodes - INFO - Executed :~/ONOS/start-onos.sh status  		 Expected Prompt 'running' Found
2013-11-21 16:07:21,304 - OnosScale4nodes - INFO - Executed :
 		 Expected Prompt '\$' Found
2013-11-21 16:07:21,407 - OnosScale4nodes - INFO - Executed :tail ~/ONOS/onos-logs/onos.*.log 		 Expected Prompt '\$' Found
2013-11-21 16:07:51,540 - OnosScale4nodes - INFO - Executed :
 		 Expected Prompt '\$' Found
2013-11-21 16:07:51,644 - OnosScale4nodes - INFO - Executed :tail ~/ONOS/onos-logs/onos.*.log 		 Expected Prompt '\$' Found
2013-11-21 16:07:51,646 - OnosScale4nodes - INFO - ONOS process is running...
2013-11-21 16:07:51,647 - OnosScale4nodes - INFO - Assertion Passed
2013-11-21 16:07:51,676 - OnosScale4nodes - INFO - Onos log is moving! It's looking good!
2013-11-21 16:07:51,901 - OnosScale4nodes - INFO - Executed :
 		 Expected Prompt '\$' Found
2013-11-21 16:07:52,583 - OnosScale4nodes - INFO - Executed :~/ONOS/start-onos.sh status  		 Expected Prompt 'running' Found
2013-11-21 16:07:52,687 - OnosScale4nodes - INFO - Executed :
 		 Expected Prompt '\$' Found
2013-11-21 16:07:52,790 - OnosScale4nodes - INFO - Executed :tail ~/ONOS/onos-logs/onos.*.log 		 Expected Prompt '\$' Found
2013-11-21 16:08:22,899 - OnosScale4nodes - INFO - Executed :
 		 Expected Prompt '\$' Found
2013-11-21 16:08:23,001 - OnosScale4nodes - INFO - Executed :tail ~/ONOS/onos-logs/onos.*.log 		 Expected Prompt '\$' Found
2013-11-21 16:08:23,002 - OnosScale4nodes - INFO - ONOS process is running...
2013-11-21 16:08:23,003 - OnosScale4nodes - INFO - Assertion Passed
2013-11-21 16:08:23,022 - OnosScale4nodes - INFO - Onos log is moving! It's looking good!
2013-11-21 16:08:23,265 - OnosScale4nodes - INFO - Executed :
 		 Expected Prompt '\$' Found
2013-11-21 16:08:24,020 - OnosScale4nodes - INFO - Executed :~/ONOS/start-onos.sh status  		 Expected Prompt 'running' Found
2013-11-21 16:08:24,122 - OnosScale4nodes - INFO - Executed :
 		 Expected Prompt '\$' Found
2013-11-21 16:08:24,224 - OnosScale4nodes - INFO - Executed :tail ~/ONOS/onos-logs/onos.*.log 		 Expected Prompt '\$' Found
2013-11-21 16:08:54,357 - OnosScale4nodes - INFO - Executed :
 		 Expected Prompt '\$' Found
2013-11-21 16:08:54,461 - OnosScale4nodes - INFO - Executed :tail ~/ONOS/onos-logs/onos.*.log 		 Expected Prompt '\$' Found
2013-11-21 16:08:54,463 - OnosScale4nodes - INFO - ONOS process is running...
2013-11-21 16:08:54,463 - OnosScale4nodes - INFO - Assertion Passed
2013-11-21 16:08:54,475 - OnosScale4nodes - INFO - Onos log is moving! It's looking good!
2013-11-21 16:08:54,713 - OnosScale4nodes - INFO - Executed :
 		 Expected Prompt '\$' Found
2013-11-21 16:08:55,394 - OnosScale4nodes - INFO - Executed :~/ONOS/start-onos.sh status  		 Expected Prompt 'running' Found
2013-11-21 16:08:55,496 - OnosScale4nodes - INFO - Executed :
 		 Expected Prompt '\$' Found
2013-11-21 16:08:55,598 - OnosScale4nodes - INFO - Executed :tail ~/ONOS/onos-logs/onos.*.log 		 Expected Prompt '\$' Found
2013-11-21 16:09:25,730 - OnosScale4nodes - INFO - Executed :
 		 Expected Prompt '\$' Found
2013-11-21 16:09:25,832 - OnosScale4nodes - INFO - Executed :tail ~/ONOS/onos-logs/onos.*.log 		 Expected Prompt '\$' Found
2013-11-21 16:09:25,833 - OnosScale4nodes - INFO - ONOS process is running...
2013-11-21 16:09:25,834 - OnosScale4nodes - INFO - Assertion Passed
2013-11-21 16:09:25,846 - OnosScale4nodes - INFO - Onos log is moving! It's looking good!
2013-11-21 16:09:25,846 - OnosScale4nodes - INFO - Making some rest calls...
2013-11-21 16:09:27,815 - OnosScale4nodes - INFO - 
-----
switch: network 1 : 0 switches 0 active
switch fail: network 1 should have 100 switches but has 0
switch fail: network 1 should have 100 active switches but has 0
link: total 0 links (correct : 198)
link fail
-----

2013-11-21 16:09:27,818 - OnosScale4nodes - INFO - Pointing the Switches at ONE controller... then BEGIN time
2013-11-21 16:09:40,163 - OnosScale4nodes - INFO - Executed :sh ~/ONOS/scripts/test-ctrl-local.sh  		 Expected Prompt 'mininet' Found
2013-11-21 16:09:40,164 - OnosScale4nodes - INFO - Making some rest calls...
2013-11-21 16:09:46,109 - OnosScale4nodes - INFO - 
-----
switch: network 1 : 23 switches 23 active
switch fail: network 1 should have 100 switches but has 23
switch fail: network 1 should have 100 active switches but has 23
link: total 26 links (correct : 198)
link fail
-----

2013-11-21 16:09:47,113 - OnosScale4nodes - INFO - Making some rest calls...
2013-11-21 16:09:56,366 - OnosScale4nodes - INFO - 
-----
switch: network 1 : 58 switches 58 active
switch fail: network 1 should have 100 switches but has 58
switch fail: network 1 should have 100 active switches but has 58
link: total 47 links (correct : 198)
link fail
-----

2013-11-21 16:09:57,370 - OnosScale4nodes - INFO - Making some rest calls...
2013-11-21 16:10:08,551 - OnosScale4nodes - INFO - 
-----
switch: network 1 : 100 switches 100 active
link: total 198 links (correct : 198)
-----

2013-11-21 16:10:08,554 - OnosScale4nodes - INFO - Making some rest calls...
2013-11-21 16:10:18,306 - OnosScale4nodes - INFO - Time is less then supplied target time
2013-11-21 16:10:18,308 - OnosScale4nodes - INFO - Verifying the Expected is equal to the actual or not using assert_equal
2013-11-21 16:10:18,308 - OnosScale4nodes - INFO - None
2013-11-21 16:10:18,310 - OnosScale4nodes - INFO - Assertion Passed


*****************************
 Result: Pass 
*****************************



******************************
 Result summary for Testcase3
******************************


[2013-11-21 16:10:18.318181] [OnosScale4nodes] [CASE]  Timing Onos Convergence for switch -> all ONOS nodes in cluster

[2013-11-21 16:10:18.319283] [OnosScale4nodes] [STEP]  INIT : Initializing the test case :Timing Onos Convergence for switch -> all ONOS nodes in cluster

[2013-11-21 16:10:18.321316] [OnosScale4nodes] [STEP]  3.1: Bringing ONOS down...
2013-11-21 16:10:18,322 - OnosScale4nodes - INFO - all switch no controllers
2013-11-21 16:10:31,519 - OnosScale4nodes - INFO - bringing ONOS down
2013-11-21 16:10:32,331 - OnosScale4nodes - WARNING - ONOS wasn't running
2013-11-21 16:10:33,188 - OnosScale4nodes - WARNING - ONOS wasn't running
2013-11-21 16:10:34,583 - OnosScale4nodes - WARNING - ONOS wasn't running
2013-11-21 16:10:35,411 - OnosScale4nodes - WARNING - ONOS wasn't running
2013-11-21 16:10:40,418 - OnosScale4nodes - INFO - Bringing ONOS up
2013-11-21 16:10:50,109 - OnosScale4nodes - INFO - ONOS Started 
2013-11-21 16:11:04,749 - OnosScale4nodes - INFO - ONOS Started 
2013-11-21 16:11:07,013 - OnosScale4nodes - INFO - Executed :~/ONOS/start-rest.sh start 		 Expected Prompt '\$' Found
2013-11-21 16:11:07,014 - OnosScale4nodes - INFO - Rest Server Started Successfully
2013-11-21 16:11:22,708 - OnosScale4nodes - INFO - ONOS Started 
2013-11-21 16:11:33,490 - OnosScale4nodes - INFO - ONOS Started 
2013-11-21 16:11:33,763 - OnosScale4nodes - INFO - Executed :
 		 Expected Prompt '\$' Found
2013-11-21 16:11:34,509 - OnosScale4nodes - INFO - Executed :~/ONOS/start-onos.sh status  		 Expected Prompt 'running' Found
2013-11-21 16:11:34,611 - OnosScale4nodes - INFO - Executed :
 		 Expected Prompt '\$' Found
2013-11-21 16:11:34,715 - OnosScale4nodes - INFO - Executed :tail ~/ONOS/onos-logs/onos.*.log 		 Expected Prompt '\$' Found
2013-11-21 16:12:04,823 - OnosScale4nodes - INFO - Executed :
 		 Expected Prompt '\$' Found
2013-11-21 16:12:04,925 - OnosScale4nodes - INFO - Executed :tail ~/ONOS/onos-logs/onos.*.log 		 Expected Prompt '\$' Found
2013-11-21 16:12:04,926 - OnosScale4nodes - INFO - ONOS process is running...
2013-11-21 16:12:04,926 - OnosScale4nodes - INFO - Assertion Passed
2013-11-21 16:12:04,945 - OnosScale4nodes - INFO - Onos log is moving! It's looking good!
2013-11-21 16:12:05,183 - OnosScale4nodes - INFO - Executed :
 		 Expected Prompt '\$' Found
2013-11-21 16:12:05,815 - OnosScale4nodes - INFO - Executed :~/ONOS/start-onos.sh status  		 Expected Prompt 'running' Found
2013-11-21 16:12:05,919 - OnosScale4nodes - INFO - Executed :
 		 Expected Prompt '\$' Found
2013-11-21 16:12:06,022 - OnosScale4nodes - INFO - Executed :tail ~/ONOS/onos-logs/onos.*.log 		 Expected Prompt '\$' Found
2013-11-21 16:12:36,155 - OnosScale4nodes - INFO - Executed :
 		 Expected Prompt '\$' Found
2013-11-21 16:12:36,258 - OnosScale4nodes - INFO - Executed :tail ~/ONOS/onos-logs/onos.*.log 		 Expected Prompt '\$' Found
2013-11-21 16:12:36,260 - OnosScale4nodes - INFO - ONOS process is running...
2013-11-21 16:12:36,261 - OnosScale4nodes - INFO - Assertion Passed
2013-11-21 16:12:36,278 - OnosScale4nodes - INFO - Onos log is moving! It's looking good!
2013-11-21 16:12:36,444 - OnosScale4nodes - INFO - Executed :
 		 Expected Prompt '\$' Found
2013-11-21 16:12:37,170 - OnosScale4nodes - INFO - Executed :~/ONOS/start-onos.sh status  		 Expected Prompt 'running' Found
2013-11-21 16:12:37,273 - OnosScale4nodes - INFO - Executed :
 		 Expected Prompt '\$' Found
2013-11-21 16:12:37,376 - OnosScale4nodes - INFO - Executed :tail ~/ONOS/onos-logs/onos.*.log 		 Expected Prompt '\$' Found
2013-11-21 16:13:07,506 - OnosScale4nodes - INFO - Executed :
 		 Expected Prompt '\$' Found
2013-11-21 16:13:07,610 - OnosScale4nodes - INFO - Executed :tail ~/ONOS/onos-logs/onos.*.log 		 Expected Prompt '\$' Found
2013-11-21 16:13:07,612 - OnosScale4nodes - INFO - ONOS process is running...
2013-11-21 16:13:07,613 - OnosScale4nodes - INFO - Assertion Passed
2013-11-21 16:13:07,630 - OnosScale4nodes - INFO - Onos log is moving! It's looking good!
2013-11-21 16:13:07,779 - OnosScale4nodes - INFO - Executed :
 		 Expected Prompt '\$' Found
2013-11-21 16:13:08,422 - OnosScale4nodes - INFO - Executed :~/ONOS/start-onos.sh status  		 Expected Prompt 'running' Found
2013-11-21 16:13:08,525 - OnosScale4nodes - INFO - Executed :
 		 Expected Prompt '\$' Found
2013-11-21 16:13:08,628 - OnosScale4nodes - INFO - Executed :tail ~/ONOS/onos-logs/onos.*.log 		 Expected Prompt '\$' Found
2013-11-21 16:13:38,739 - OnosScale4nodes - INFO - Executed :
 		 Expected Prompt '\$' Found
2013-11-21 16:13:38,841 - OnosScale4nodes - INFO - Executed :tail ~/ONOS/onos-logs/onos.*.log 		 Expected Prompt '\$' Found
2013-11-21 16:13:38,842 - OnosScale4nodes - INFO - ONOS process is running...
2013-11-21 16:13:38,842 - OnosScale4nodes - INFO - Assertion Passed
2013-11-21 16:13:38,853 - OnosScale4nodes - INFO - Onos log is moving! It's looking good!
2013-11-21 16:13:38,853 - OnosScale4nodes - INFO - Making some rest calls...
2013-11-21 16:13:47,011 - OnosScale4nodes - INFO - 
-----
switch: network 1 : 100 switches 0 active
switch fail: network 1 should have 100 active switches but has 0
link: total 0 links (correct : 198)
link fail
-----

2013-11-21 16:13:47,014 - OnosScale4nodes - INFO - Pointing the Switches at ALL controllers... then BEGIN time
2013-11-21 16:14:00,794 - OnosScale4nodes - INFO - Executed :sh ~/ONOS/scripts/test-ctrl-add-ext.sh 		 Expected Prompt 'mininet' Found
2013-11-21 16:14:00,796 - OnosScale4nodes - INFO - Making some rest calls...
2013-11-21 16:14:09,623 - OnosScale4nodes - INFO - 
-----
switch: network 1 : 100 switches 99 active
switch fail: network 1 should have 100 active switches but has 99
link: total 198 links (correct : 198)
-----

2013-11-21 16:14:10,625 - OnosScale4nodes - INFO - Making some rest calls...
2013-11-21 16:14:19,403 - OnosScale4nodes - INFO - 
-----
switch: network 1 : 100 switches 100 active
link: total 198 links (correct : 198)
-----

2013-11-21 16:14:19,405 - OnosScale4nodes - INFO - Making some rest calls...
2013-11-21 16:14:26,928 - OnosScale4nodes - INFO - Time is less then supplied target time
2013-11-21 16:14:26,930 - OnosScale4nodes - INFO - Verifying the Expected is equal to the actual or not using assert_equal
2013-11-21 16:14:26,931 - OnosScale4nodes - INFO - None
2013-11-21 16:14:26,931 - OnosScale4nodes - INFO - Assertion Passed


*****************************
 Result: Pass 
*****************************



******************************
 Result summary for Testcase4
******************************


[2013-11-21 16:14:26.938457] [OnosScale4nodes] [CASE]  Timing Onos Convergence for even single controller distribution

[2013-11-21 16:14:26.941003] [OnosScale4nodes] [STEP]  INIT : Initializing the test case :Timing Onos Convergence for even single controller distribution

[2013-11-21 16:14:26.943809] [OnosScale4nodes] [STEP]  4.1: Bringing ONOS down...
2013-11-21 16:14:26,944 - OnosScale4nodes - INFO - all switch no controllers
2013-11-21 16:14:40,346 - OnosScale4nodes - INFO - bringing ONOS down
2013-11-21 16:14:41,228 - OnosScale4nodes - WARNING - ONOS wasn't running
2013-11-21 16:14:42,138 - OnosScale4nodes - WARNING - ONOS wasn't running
2013-11-21 16:14:42,993 - OnosScale4nodes - WARNING - ONOS wasn't running
2013-11-21 16:14:43,805 - OnosScale4nodes - WARNING - ONOS wasn't running
2013-11-21 16:14:48,811 - OnosScale4nodes - INFO - Bringing ONOS up
2013-11-21 16:14:58,496 - OnosScale4nodes - INFO - ONOS Started 
2013-11-21 16:15:13,759 - OnosScale4nodes - INFO - ONOS Started 
2013-11-21 16:15:16,092 - OnosScale4nodes - INFO - Executed :~/ONOS/start-rest.sh start 		 Expected Prompt '\$' Found
2013-11-21 16:15:16,093 - OnosScale4nodes - INFO - Rest Server Started Successfully
2013-11-21 16:15:31,555 - OnosScale4nodes - INFO - ONOS Started 
2013-11-21 16:15:42,431 - OnosScale4nodes - INFO - ONOS Started 
2013-11-21 16:15:42,568 - OnosScale4nodes - INFO - Executed :
 		 Expected Prompt '\$' Found
2013-11-21 16:15:43,295 - OnosScale4nodes - INFO - Executed :~/ONOS/start-onos.sh status  		 Expected Prompt 'running' Found
2013-11-21 16:15:43,397 - OnosScale4nodes - INFO - Executed :
 		 Expected Prompt '\$' Found
2013-11-21 16:15:43,499 - OnosScale4nodes - INFO - Executed :tail ~/ONOS/onos-logs/onos.*.log 		 Expected Prompt '\$' Found
2013-11-21 16:16:13,632 - OnosScale4nodes - INFO - Executed :
 		 Expected Prompt '\$' Found
2013-11-21 16:16:13,736 - OnosScale4nodes - INFO - Executed :tail ~/ONOS/onos-logs/onos.*.log 		 Expected Prompt '\$' Found
2013-11-21 16:16:13,738 - OnosScale4nodes - INFO - ONOS process is running...
2013-11-21 16:16:13,739 - OnosScale4nodes - INFO - Assertion Passed
2013-11-21 16:16:13,761 - OnosScale4nodes - INFO - Onos log is moving! It's looking good!
2013-11-21 16:16:13,997 - OnosScale4nodes - INFO - Executed :
 		 Expected Prompt '\$' Found
2013-11-21 16:16:14,642 - OnosScale4nodes - INFO - Executed :~/ONOS/start-onos.sh status  		 Expected Prompt 'running' Found
2013-11-21 16:16:14,746 - OnosScale4nodes - INFO - Executed :
 		 Expected Prompt '\$' Found
2013-11-21 16:16:14,849 - OnosScale4nodes - INFO - Executed :tail ~/ONOS/onos-logs/onos.*.log 		 Expected Prompt '\$' Found
2013-11-21 16:16:44,969 - OnosScale4nodes - INFO - Executed :
 		 Expected Prompt '\$' Found
2013-11-21 16:16:45,071 - OnosScale4nodes - INFO - Executed :tail ~/ONOS/onos-logs/onos.*.log 		 Expected Prompt '\$' Found
2013-11-21 16:16:45,072 - OnosScale4nodes - INFO - ONOS process is running...
2013-11-21 16:16:45,072 - OnosScale4nodes - INFO - Assertion Passed
2013-11-21 16:16:45,090 - OnosScale4nodes - INFO - Onos log is moving! It's looking good!
2013-11-21 16:16:45,298 - OnosScale4nodes - INFO - Executed :
 		 Expected Prompt '\$' Found
2013-11-21 16:16:46,062 - OnosScale4nodes - INFO - Executed :~/ONOS/start-onos.sh status  		 Expected Prompt 'running' Found
2013-11-21 16:16:46,164 - OnosScale4nodes - INFO - Executed :
 		 Expected Prompt '\$' Found
2013-11-21 16:16:46,266 - OnosScale4nodes - INFO - Executed :tail ~/ONOS/onos-logs/onos.*.log 		 Expected Prompt '\$' Found
2013-11-21 16:17:16,375 - OnosScale4nodes - INFO - Executed :
 		 Expected Prompt '\$' Found
2013-11-21 16:17:16,477 - OnosScale4nodes - INFO - Executed :tail ~/ONOS/onos-logs/onos.*.log 		 Expected Prompt '\$' Found
2013-11-21 16:17:16,478 - OnosScale4nodes - INFO - ONOS process is running...
2013-11-21 16:17:16,478 - OnosScale4nodes - INFO - Assertion Passed
2013-11-21 16:17:16,495 - OnosScale4nodes - INFO - Onos log is moving! It's looking good!
2013-11-21 16:17:16,703 - OnosScale4nodes - INFO - Executed :
 		 Expected Prompt '\$' Found
2013-11-21 16:17:17,370 - OnosScale4nodes - INFO - Executed :~/ONOS/start-onos.sh status  		 Expected Prompt 'running' Found
2013-11-21 16:17:17,472 - OnosScale4nodes - INFO - Executed :
 		 Expected Prompt '\$' Found
2013-11-21 16:17:17,574 - OnosScale4nodes - INFO - Executed :tail ~/ONOS/onos-logs/onos.*.log 		 Expected Prompt '\$' Found
2013-11-21 16:17:47,679 - OnosScale4nodes - INFO - Executed :
 		 Expected Prompt '\$' Found
2013-11-21 16:17:47,781 - OnosScale4nodes - INFO - Executed :tail ~/ONOS/onos-logs/onos.*.log 		 Expected Prompt '\$' Found
2013-11-21 16:17:47,783 - OnosScale4nodes - INFO - ONOS process is running...
2013-11-21 16:17:47,783 - OnosScale4nodes - INFO - Assertion Passed
2013-11-21 16:17:47,795 - OnosScale4nodes - INFO - Onos log is moving! It's looking good!
2013-11-21 16:17:47,795 - OnosScale4nodes - INFO - Making some rest calls...
2013-11-21 16:17:54,988 - OnosScale4nodes - INFO - 
-----
switch: network 1 : 100 switches 0 active
switch fail: network 1 should have 100 active switches but has 0
link: total 0 links (correct : 198)
link fail
-----

2013-11-21 16:17:54,991 - OnosScale4nodes - INFO - Pointing the Switches to alternating controllers... then BEGIN time
2013-11-21 16:18:07,607 - OnosScale4nodes - INFO - Executed :sh ~/ONOS/scripts/ctrl-divide.sh  		 Expected Prompt 'mininet' Found
2013-11-21 16:18:07,609 - OnosScale4nodes - INFO - Making some rest calls...
2013-11-21 16:18:15,915 - OnosScale4nodes - INFO - 
-----
switch: network 1 : 100 switches 96 active
switch fail: network 1 should have 100 active switches but has 96
link: total 198 links (correct : 198)
-----

2013-11-21 16:18:16,921 - OnosScale4nodes - INFO - Making some rest calls...
2013-11-21 16:18:24,482 - OnosScale4nodes - INFO - 
-----
switch: network 1 : 100 switches 100 active
link: total 198 links (correct : 198)
-----

2013-11-21 16:18:24,484 - OnosScale4nodes - INFO - Making some rest calls...
2013-11-21 16:18:31,887 - OnosScale4nodes - INFO - Time is less then supplied target time
2013-11-21 16:18:31,889 - OnosScale4nodes - INFO - Verifying the Expected is equal to the actual or not using assert_equal
2013-11-21 16:18:31,890 - OnosScale4nodes - INFO - None
2013-11-21 16:18:31,890 - OnosScale4nodes - INFO - Assertion Passed


*****************************
 Result: Pass 
*****************************




*************************************
	Test Execution Summary

************************************* 

 Test Start           : 21 Nov 2013 15:59:17
 Test End             : 21 Nov 2013 16:18:31
 Execution Time       : 0:19:13.919748
 Total tests planned  : 4
 Total tests RUN      : 4
 Total Pass           : 4
 Total Fail           : 0
 Total No Result      : 0
 Success Percentage   : 100%
 Execution Result     : 100%
2013-11-21 16:18:33,267 - OnosScale4nodes - INFO - Disconnecting mininet...
2013-11-21 16:18:33,370 - OnosScale4nodes - INFO - Executed :exit 		 Expected Prompt '(.*)' Found
2013-11-21 16:18:33,473 - OnosScale4nodes - INFO - Executed :exit 		 Expected Prompt '(.*)' Found