CKTester/Users Guide - Revision history

Garryyao at 09:25, 24 September 2009

2009-09-24T09:25:36Z

Garryyao: /* Installation */

2009-09-24T09:18:15Z

‎Installation

Garryyao at 09:14, 24 September 2009

2009-09-24T09:14:47Z

Garryyao at 09:04, 24 September 2009

2009-09-24T09:04:58Z

Garryyao at 08:54, 24 September 2009

2009-09-24T08:54:49Z

Garryyao at 08:25, 24 September 2009

2009-09-24T08:25:17Z

Garryyao at 08:02, 24 September 2009

2009-09-24T08:02:42Z

Garryyao: /* Installation */

2009-09-24T07:43:48Z

‎Installation

Garryyao: /* Installation */

2009-09-24T07:42:05Z

‎Installation

Garryyao: /* Installation */

2009-09-24T07:31:45Z

‎Installation

@@ Line 4: / Line 4: @@
 == How It Works  ==
 === Test Cell  ===
@@ Line 127: / Line 128: @@
 '''Note''': All the following tasks are assuming you already have CKTester properly installed.<br>
-=== Running a specific ticket test<br>  ===
+=== Running a specific ticket test ===
-It's quite a frequent usecase when you're working on a particular ticket and quite straight forward that you can just point the browser to the location of that ticket test cell(e.g. [http://ckeditor.t/tt/4385/1.html http://ckeditor.t/tt/4385/1.html]), CKTester will redirect you to the fort as single cell criterial.
+It's quite a frequent usecase when you're working on a particular ticket and quite straight forward that you can just point the browser to the location of that ticket test cell(e.g. [http://ckeditor.t/tt/4385/1.html http://ckeditor.t/tt/4385/1.html]), CKTester will redirect you to the fort as single cell criteria.
 == History  ==

@@ Line 117: / Line 117: @@
         'CKEDITOR_TEST_BRANCH_ROOT'&nbsp;: '/'
 </pre>
-At last, run the script {CKTESTER_ROOT}/_dev/gen-profile.bat(.sh) ( you'll need install [http://ant.apache.org/ Apache Ant] ) which helps you to generate the testing profile automatically by scanning the resources within {CKEDITOR_TEST_ROOT}. After that, you'll get a file created at {CKTESTER_ROOT}/template.js which looks basically like:
+At last, run the script {CKTESTER_ROOT}/_dev/gen-profile.bat(.sh) ( you'll need install [http://ant.apache.org/ Apache Ant and configure the ANT_HOME variable of your system ] ) which helps you to generate the testing profile automatically by scanning the resources within {CKEDITOR_TEST_ROOT}. After that, you should get a file created at {CKTESTER_ROOT}/profile.js.
-</pre>
+And it's done, now point your web browser at {CKEDITOR_TEST_ROOT}/index.html, there're already a few pilot links which help you to kick start.<br>
 <br>
 == Common Tasks  ==

← Older revision		Revision as of 09:14, 24 September 2009
Line 138:		Line 138:

	== Common Tasks ==		== Common Tasks ==
		+
		+	'''Note''': All the following tasks are assuming you already have CKTester properly installed.<br>
		+
		+	=== Running a specific ticket test<br> ===
		+
		+	It's quite a frequent usecase when you're working on a particular ticket and quite straight forward that you can just point the browser to the location of that ticket test cell(e.g. [http://ckeditor.t/tt/4385/1.html http://ckeditor.t/tt/4385/1.html]), CKTester will redirect you to the fort as single cell criterial.

	== History ==		== History ==

@@ Line 7: / Line 7: @@
 === Test Cell  ===
-A '''test cell''' is the basic unit of a project's testing, a plain HTML file reside in individual project's testing source, in which test suites/cases are written. It will be loaded and executed inside an iframe or popup window depends on the running of choice, so '''full page life cycle''' ( from page load to page destroy ) is guaranteed.
+A '''test cell''' is the basic unit of a project's testing, a plain HTML file reside in individual project's testing sources, in which test suites/cases are written. It will be loaded and executed inside an iframe or popup window depends on the running of choice, so '''full page life cycle''' ( from page load to page destroy ) is guaranteed.<br>
 Each cell has one key responsibility of '''reporting''' the sucess/failure/time of it's execution to the fort, this is done by cross-frame communication with parent/opener window. For this, the cell is required to include a bootstrap file:
 <pre>&lt;script type="text/javascript" src="{CKTester_ROOT}/bootstrap.js"&gt;&lt;/script&gt;
 </pre>
-The cell's entire testing environment, including testing target, runtime libraries, etc. will mostly be injected by the fort, which are declared by a meta tag of the HTML file.
+The cell's entire testing environment, including testing target, runtime libraries, etc. will mostly be injected by the fort, which are declared by a meta tag of the HTML file. This inversion of control feature (IoC) make the cell testing framework neutral.<br>
 <pre>// I'm a unit test for the editor(CKEditor) and the TCs within me are stable( been finalized ).
 &lt;meta name="tags" content="editor,unit,stable"&gt;
 </pre>
 === Profile  ===
-A '''testing profile''' is a JavaScript configuration file which specify how a project is to be tested by CKTester. It contains a function which return a configuration object.&nbsp;<br>
+A '''testing profile''' is a JavaScript configuration file which specify how a project is to be tested by CKTester. It contains a function which returns a configuration object including.&nbsp;<br>
-#Cells list&nbsp;: A list of key/values which tells where are the cells and what are the tags of each cell.<br>Key&nbsp;: The test cell '''file path''', where all the paths are relative to the runner; <br>Value&nbsp;: An array of '''tags''' of that cell.<br>
+#'''Cells list'''&nbsp;: A list of key/values which tells where are the cells and what are the tags of each cell.<br>Key&nbsp;: The test cell '''file path''', where all the paths are relative to the runner; <br>Value&nbsp;: An array of '''tags''' of that cell.<br>
-#Cell resolvers&nbsp;: An array of function which were used to manipulate each cell's attributes, e.g. Inject necessary dependencies for cells which have certain tags. These are the complementary of those resolvers that the '''fort '''already has.<br>
+#'''Cell Resolvers&nbsp;''': An array of functions which were used to manipulate each cell's attributes, e.g. Inject necessary dependencies for cells which have certain tags. These are the complementary of the default resolvers that the '''fort '''already has.<br>
 The file content will basically looks like:
@@ Line 67: / Line 58: @@
+}
 </pre>
-'''Note''': the testing profile is recommanded to be generated automatically by the gen-profile tool script, but it could be altered manually as well.<br>
+'''Note''': the testing profile is recommanded to be generated automatically by the gen-profile tool script, though it could be altered manually.<br>
 === Tags  ===
-'''Tag''' is playing an important role as the indicator of a cell with the following aspects:
+'''Tag''' is playing an important role as the '''annotation '''of a cell with the following aspects:
 #Environments( dependencies ) of a cell, e.g. if the cell has tags 'unit' and 'editor', it denote it must be running under a unit test runner( e.g. YUITest ), and the testing target is CKEditor;
-#Categories of the cell, could be used to grouping similar cells. E.g. A cell with a path 'dt/core/dom/documentfragment' denote it's design test for the core codes of dom module about document-fragment.
+#Categories of the cell, useful to grouping similar cells. E.g. A cell with a path 'dt/core/dom/documentfragment' denote it's a design test for the core codes of dom module about document-fragment.
 #Any other reasonable denotation.
 === Fort  ===
-The '''Test Fort''' is a central hub for registering and running all the cells, which also consist of a UI to specific criteria and providing report.
+The '''Test Fort''' is a central hub for registering and running all the cells, which also consists of a UI to specifiy criterias and viewing report.
-The runner is driven by the specified profile( use the default one if not specified ), from which all cells are registering. Upon requesting by a specific criteria, it filtering down the registered cells to only execute the satisfied ones.
+The runner is driven by a specified profile( use the default one if not specified ), from which all cells are registering. Upon requesting by a specific testing criteria, it filtering down the registered cells to only execute the satisfied ones.
 During the loading of each cell before running, an extensible '''cell resolver''' will manipulate ( to figure out the required/requested resources of a specific cell ) the cell by analysing it's tags, guarantee the cell always has all the environment it should receive. These resources are typically composed of&nbsp;:
@@ Line 92: / Line 83: @@
 #Managed Mode&nbsp;: It's the default mode when it's running in a batch of cells by the forge, where the cell is running in an iframe.
-#Standalone Mode&nbsp;: When a cell is running separately, on the opposite of 'Managed Mode', the cell will be running inside a popup window, this is
+#Standalone Mode&nbsp;: When a cell is running separately, on the opposite of 'Managed Mode', the cell will be running inside a popup window, this is often used when it's a manual test case or detailed information about the TCs is required to be reviewed( e.g. which exactly test method failed in the TC? ).
 === Testing Criteria  ===
-A criteria is simply a URL request to the fort which specify which cells to be run.
+A criteria is simply a URL request to the fort, tells which cells to be run.
-#It could contains a path to the profile to be used.
+#It could contains a path to a '''profile''' to be used.
-#It could contains certain tags only with which the cells to be run.
+#It could contains certain tags, so only with which the cells to be run.
 #It could explicitly specify a single cell location along with certain tags.
@@ Line 108: / Line 97: @@
 *Running all cells defined in a specified profile file: http://ckeditor.t/cktester/fort.html?profile=../myprofile.js
 *Running all the stable unit tests of the default profile: http://ckeditor.t/cktester/fort.html?cells=stable,unit
-*Running a specific ticket test with tags 'editor','unit','all' : http://ckeditor.t/cktester/fort.html?cells=http://ckeditor.t/tt/4397/1.html&amp;tags=editor,unit,all<br>( '''Note''': It's a shortcut to achieved the same criteria by just open the url of that individual cell (http://ckeditor.t/tt/4397/1.html) and it will be redirected correctly back to the forge. )<br>
+*Running a specific ticket test with tags 'editor','unit','all'&nbsp;: http://ckeditor.t/cktester/fort.html?cells=http://ckeditor.t/tt/4397/1.html&amp;tags=editor,unit,all<br>( '''Note''': It's a shortcut to achieved the same criteria by just open the url of that individual cell (http://ckeditor.t/tt/4397/1.html) and it will be redirected correctly back to the forge. )<br>
 == Installation  ==

@@ Line 27: / Line 27: @@
 === Profile  ===
 A '''testing profile''' is a JavaScript configuration file which specify how a project is to be tested by CKTester. It contains a function which return a configuration object.&nbsp;<br>
 #Cells list&nbsp;: A list of key/values which tells where are the cells and what are the tags of each cell.<br>Key&nbsp;: The test cell '''file path''', where all the paths are relative to the runner; <br>Value&nbsp;: An array of '''tags''' of that cell.<br>
@@ Line 67: / Line 67: @@
+}
 </pre>
 '''Note''': the testing profile is recommanded to be generated automatically by the gen-profile tool script, but it could be altered manually as well.<br>
 === Tags  ===
@@ Line 77: / Line 77: @@
 #Any other reasonable denotation.
-<br>
+=== Fort  ===
 == Installation  ==

← Older revision		Revision as of 08:02, 24 September 2009
Line 2:		Line 2:

	'''CKTester''' is our internal testing hub, created to provide seamless and integrated testing experience to our developers, been capable of managing and interfacing tests from various projects which may potentially rely on different testing frameworks/runners. Been designed with convenient authoring and ease of viewing the test cases in mind, it could be running independently in all situation from a browser : locally, on a web server or via secure connections.		'''CKTester''' is our internal testing hub, created to provide seamless and integrated testing experience to our developers, been capable of managing and interfacing tests from various projects which may potentially rely on different testing frameworks/runners. Been designed with convenient authoring and ease of viewing the test cases in mind, it could be running independently in all situation from a browser : locally, on a web server or via secure connections.
		+
		+	== How It Works ==
		+
		+	=== Test Cell ===
		+
		+	A '''test cell''' is the basic unit of a project's testing, a plain HTML file reside in individual project's testing source, in which test suites/cases
		+	are written. It will be loaded and executed inside an iframe or popup window depends on the running of choice, so '''full page life cycle'''
		+	( from page load to page destroy ) is guaranteed.
		+
		+	Each cell has one key responsibility of '''reporting''' the sucess/failure/time of it's execution to the fort, this is
		+	done by cross-frame communication with parent/opener window. For this, the cell is required to include a bootstrap file:
		+	<pre>
		+	<script type="text/javascript" src="{CKTester_ROOT}/bootstrap.js"></script>
		+	</pre>
		+
		+	The cell's entire testing environment, including testing target, runtime libraries, etc. will mostly be injected by the fort,
		+	which are declared by a meta tag of the HTML file.
		+	<pre>
		+	// I'm a unit test for the editor(CKEditor) and the TCs within me are stable( been finalized ).
		+	<meta name="tags" content="editor,unit,stable">
		+	</pre>
		+
		+	A cell could be running in '''two modes''':
		+	# Managed Mode : It's the default mode when it's running in a batch of cells by the forge, where the cell is running in an iframe.
		+	# Standalone Mode : When a cell is running separately, on the opposite of 'Managed Mode', the cell will be running inside a popup window, this is
		+	often used when it's a manual test case or detailed information about the TCs is required to be reviewed( e.g. which exactly test method failed in the TC? ).
		+

	== Installation ==		== Installation ==

@@ Line 9: / Line 9: @@
 First of all, checking out these three component: the staging project, it's test suites and CKTester eventually.
-#Checkout CKEditor's testing branch from SVN ( We name the working copy path as CKEDITOR_TEST_ROOT below ). <br>
+#Checkout CKEditor's testing branch from [http://svn.fckeditor.net/CKEditor/tests SVN] ( We name the working copy path as CKEDITOR_TEST_ROOT below ). <br>
 #Checkout CKEditor trunk( or any other version are subjected to test ) from [http://svn.fckeditor.net/CKEditor/trunk/ SVN] into a folder ( e.g. ckeditor ) under CKEDITOR_TEST_ROOT ( We name the working copy path as CKEDITOR_ROOT below ).<br>
 #Checkout CKTester from [http://svn.fckeditor.net/CKTester SVN]&nbsp;into a folder( e.g. cktester ) under CKEDITOR_TEST_ROOT( We name the working copy path as CKTESTER_ROOT below ).
@@ Line 17: / Line 17: @@
 	'CKEDITOR_ROOT'&nbsp;: '/ckeditor',
-         // Point to the root path of CKEditor test branch.( You don't need to alter it if your web server's serving root from CKEDITOR_TEST_ROOT.
+         // Point to the root path of CKEditor test branch.
         'CKEDITOR_TEST_BRANCH_ROOT'&nbsp;: '/'
 </pre>

@@ Line 5: / Line 5: @@
 == Installation  ==
-Below we'll take the CKEditor project as an example to illustrate the install process:
+'''Note''': Below we'll take the CKEditor project as an example to illustrate the install process.
 #Checkout CKEditor's testing branch from SVN ( We name the working copy path as CKEDITOR_TEST_ROOT below ). <br>
 #Checkout CKEditor trunk( or any other version are subjected to test ) from [http://svn.fckeditor.net/CKEditor/trunk/ SVN] into a folder ( e.g. ckeditor ) under CKEDITOR_TEST_ROOT ( We name the working copy path as CKEDITOR_ROOT below ).<br>
-#Checkout CKTester from [http://svn.fckeditor.net/CKTester SVN]&nbsp;into a folder( e.g. cktester ) under CKEDITOR_TEST_ROOT( We name the working copy path as CKTESTER_ROOT below ). <br>
+#Checkout CKTester from [http://svn.fckeditor.net/CKTester SVN]&nbsp;into a folder( e.g. cktester ) under CKEDITOR_TEST_ROOT( We name the working copy path as CKTESTER_ROOT below ).
-#Open the file {CKTESTER_ROOT}/variables.js.tpl with modification to the following variables:<br>
 <pre>	// Absolute path point to the root path of CKEditor project.
 	'CKEDITOR_ROOT'&nbsp;: '/ckeditor',
@@ Line 17: / Line 20: @@
         'CKEDITOR_TEST_BRANCH_ROOT'&nbsp;: '/'
 </pre>
-#At last, run the script {CKTESTER_ROOT}/_dev/gen-profile.bat(.sh) ( you'll need install [http://ant.apache.org/ Apache Ant] ) which helps you to generate the testing profile automatically by scanning the resources within {CKEDITOR_TEST_ROOT}.<br><br>After that, you'll get a file created at {CKTESTER_ROOT}/template.js which looks basically like:
 <pre>	CKTESTER.fort.getProfile = function ()
+	{
@@ Line 33: / Line 37: @@
 </pre>
-#It's done, now point your web browser at {CKEDITOR_TEST_ROOT}/index.html, a few pilot links there to kick start you testing.<br>
+It's done, now point your web browser at {CKEDITOR_TEST_ROOT}/index.html, a few pilot links there to kick start you testing.<br>
 <br>