Forum Discussion

johntaylor's avatar
johntaylor
Occasional Contributor
15 years ago

Test Log Output

Related to my previous threads and other similar threads, what I really want to do is this



Following a Test Run, produce a text file that contains the following.



Lists all tests in the project - whether they passed, failed or were ignored

and the summary sheet at the bottom (as per the current summary sheet).



I have tried writing some script using the examples provided in the Help playing about with the [Logs] collection, but although I can get lots of information out, this has only the tests run and not those ignored.



Something like this



Test Log 03/12/2009 11:06:43



Test        Description        Start        Finish        Status



Test1      xxxxxxxx            11:07      11:10        Passed

Test2      Test 2                -----        -----         Ignored

Test3      Big test              11:11       11:30        Passed



Summary




Total number of project test items: 3

Executed project test items: 2

Project test items executed successfully: 2

Failed project test items: 0

Ignored project test items: 1



Whilst, if you have online access the hierarchy of the Test Output is excellent, if you just want to print something off and stick it in a test folder, it is not obvious (if at all) if this cane be done (easily).



Thanks, John

     

11 Replies

Sort By
  • syedsafvan's avatar
    syedsafvan
    Contributor
    15 years ago
    John,



    Sorry if I did not get your question, but I dont understand how can you get any info about a test that is ignored. When a test is ignored there is obviously no start time or end time for it rite?



    And about storing your logs you can export your logs into a .mht file and save it in the folder you want. Have you tried that?
  • johntaylor's avatar
    johntaylor
    Occasional Contributor
    15 years ago
    From a quality point of view, you should be able to print on paper, or to a text file, or an Excel spreadsheet......



    1. A list of all of the tests, and those that are set to Ignored, prior to running the tests.



    2. After running the tests, you should be able to get a list of all tests that were run and what their status was - Passed or Failed.  Additionally, someone who witnessed the tests should be able to print out the tests that were ignored during the test run - they may have been set to ignored unintentially.

      Ideally there should be NO ignored tests.



    NUnit output has this sort of output.



    I have looked further -- e.g., www.sqaforums.com where there seems to be lots of posts regarding TestComplete and it looks as if paper reporting is a major deficiency of Test Complete.



    Regarding exporting to MHT - yes I can do that but I still can't print (well I can print what is on the screen).  I have organised my 200 tests into neat categorised groups, and the only way to print out is to drill down and print what is the screen - which is not acceptable.



    That make sense?

  • AlexeyKolosov's avatar
    AlexeyKolosov
    Staff
    15 years ago

    Hi John,


    >>>

    it looks as if paper reporting is a major deficiency of Test Complete

    <<<

    Actually, you can print test logs from TestComplete as it is described in the "Printing Test Results" help topic. However, it looks like there is a problem with this functionality in TestComplete 7.50. If you are using this version, please contact me via our Contact Support form (http://www.automatedqa.com/support/message) so I can provide you with steps necessary to print test results from this version of TestComplete.


    Also, I recommend that you see our reply in the following SQAforums thread, it contains some links which may be useful for you:

    http://www.sqaforums.com/showflat.php?Cat=0&Number=593635&an=0&page=0&gonew=1#UNREAD


    In addition to that, there is a suggestion to improve exporting capabilities in our DB, and your request has increased its rating. Thank you.


  • johntaylor's avatar
    johntaylor
    Occasional Contributor
    15 years ago
    That patch seems to have got the print functionality back again.



    However, I still think there is a deficiency in the printing functionality of the test logs (unless I'm missing something), as having arranged my hundreds of tests into nice neat groups, the only way to print out test results is by a group at a time.

    I.e., you can't just go to the top node of the log and get a great big printout of all of the test results.



    Thanks,

       John
  • AlexeyKolosov's avatar
    AlexeyKolosov
    Staff
    15 years ago

    Hi John,


    Sorry, I'm not sure that I understand what functionality you are missing. Could you please describe the difference between the current and the needed behavior in detail? A simple example would be appreciated.


  • johntaylor's avatar
    johntaylor
    Occasional Contributor
    15 years ago
    It's really simple.



    I have a project with 250 tests - some nested within groups. Running the tests is really easy. You go the TestComplete project in the left hand pane, do a right click and do 'Run XXXX [Project]'.



    When the tests finish you get two panes: the Summary pane and the Project Log pane.



    The Summary pane shows that I have executed 230 test items, out of a total of 288 test items: That's great for a summary.

    If I go to the Project Log Pane, I see 10 green ticks against tests - but these are not tests, these are groups of tests.

    To see an individual test item, I have to double click on the test group and it expands and shows the test items in that group (or more groups).



    So what I am saying is that all of the test results are there in the User Interface, but you have to drill down/up to see them all.



    [What I'd like to do is print off an A4 printout on paper or export to a text file, something tht can be printed off and attached to the back of an Acceptance Test Specification, that has the following:

    1. An itemised list of all of the tests that were run (and whether they passed or failed)

    2. An itemised list of those tests that were ignored (i.e., disabled)]



    As far as I am aware, TestComplete allows me to do the following:



    1. Export to XML, View in IE and send in an email.  Whilst this works fine, it's all electronic, and you can drill up and down.

    2. Whilst selecting test results on the right hand side pane, and selecting Print from the menu bar, you can print, but it only seems to be able the level that is viewed.

      So in my particular case I have groups as follows:

        Tests

             ....

             Arithmetic Tests

                Addition Tests

                    Test 1..n

                Subtraction Tests

                    Test 1..m

                etc.

    I am unable to select Tests and go the print icon and print all of the expanded tests.  To print Test 1..n I have to drill down two levels and then Print.  (the Collapse All, Expand All, Filter menu items don't seem to have an effect on the print functionality)



    Does that make sense?
  • AlexeyKolosov's avatar
    AlexeyKolosov
    Staff
    15 years ago

    Hi John,


    I have registered your request in our DB as a suggestion. Thanks a lot for the detailed description.


  • dhanapal1's avatar
    dhanapal1
    Contributor
    14 years ago
    If i execute 500 test script means those project results will get display on left hand side of the pane. In right hand side pane gave testlog result for selected script. What to do  to get for all 500 test script test log results? Is it possible in TestComplete?
  • ory_z's avatar
    ory_z
    Contributor
    14 years ago
    John,



    I'm not 100% sure, but I think you could do what you are looking for yourself via scripts:

    Write a script that Adds a line to a file with the information you want.

    Put that script in the OnStopTest event

    At the end of the run you should have a file with information about all the tests that have been executed.

    Getting the tests that have not been executed could be tricky, but not impossible IMO.

    For example, you could have an excel file that lists all your tests, when a test is executed you can mark it as such (in the excel file). At the end of the run you can check which tests have not been executed. This could also be done with scripts and you could add the information to the end of the file created in the first script.



    So obviously this approach will take some work, but seeing the amounts of tests you are speaking off, it might be worth it.
  • dhanapal1's avatar
    dhanapal1
    Contributor
    14 years ago

    Hi

      

       I am facing some problem in TC while using framwork.

        I am using testcomplete 8.0 using implemented with framework.  I am having driver script  calls  the function which is given below.  like login few action will be there. after driver script ran the project log and test log result contains Driver script main function name .  programatically wrote generic function  export the result to testresult folder consist of folder names with  "ExcelName+TimeStamp". 



     In this way i got testlog result but I couldn't get project log result ( list of test script ran, status count by pass fail & warnings ) because all ran project log result consists of Driver script main function name only. 



      1. Any one guide me how to programe in such a way to get above project log result by using TC builtin function.  Is there is any function to alter the unit name while run-time.



     Whenever test got failed I couldn't get test log result with specfied format. once test execution got interupt onstopTest event will trigger In that event I call this export function. I called like that testresult folder names with undefined +timestamp. 



    2. How can a pass current execution excel or excel-sheet name to event handler?  suggest me some better option.





    login.xls
























































    ScreenName

    Function Name

    Window Name

    Object Name

    DataSet1

    Log into application and Navigating to Home Page.

     

     

     

     

    User Signon ID

    txt_SetText

     

     

    dpl

    password

    txt_SetText

     

     

     1234

    OK

    btn_Click

     

     

     

    #Now verifying for the correct login

     

     

     

    ExcelName

    ExportResultHTML