VirtualBox

Ignore:
Timestamp:
Sep 1, 2022 9:06:13 AM (3 years ago)
Author:
vboxsync
svn:sync-xref-src-repo-rev:
153434
Message:

Validation Kit/docs: Corrected typos.

File:
1 edited

Legend:

Unmodified
Added
Removed
  • trunk/src/VBox/ValidationKit/docs/AutomaticTestingRevamp.txt

    r82972 r96564  
    242242other words, cygwin will not be used on Windows!
    243243
    244 The testbox will provide the unixy utilties that ships with kBuild and possibly
     244The testbox will provide the unixy utilities that ships with kBuild and possibly
    245245some additional ones from tools/*.*/bin in the VirtualBox tree (wget, unzip,
    246 zip, and so on).  The test drivers will avoid invoking any of these utilites
     246zip, and so on).  The test drivers will avoid invoking any of these utilities
    247247directly and instead rely on generic utility methods in the test driver
    248248framework.  That way we can more easily reimplement the functionality of the
    249 core utilites and drop the dependency on them.  It also allows us to quickly
     249core utilities and drop the dependency on them.  It also allows us to quickly
    250250work around platform specific oddities and bugs.
    251251
     
    257257run under the testbox script, they can be executed in the VirtualBox development
    258258environment.  This is important for bug analysis and for simplifying local
    259 testing by the developers before commiting changes.  It also means the test
     259testing by the developers before committing changes.  It also means the test
    260260drivers can be developed locally in the VirtualBox development environment.
    261261
     
    335335
    336336  - Two level testing - L1 quick smoke tests and L2 longer tests performed on
    337     builds passing L1.  (Klaus (IIRC) ment this could be realized using
     337    builds passing L1.  (Klaus (IIRC) meant this could be realized using
    338338    test dependency.)
    339339  - Black listing builds (by revision or similar) known to be bad.
     
    344344  - Useful to be able to partition testboxes (run specific builds on some
    345345    boxes, let an engineer have a few boxes for a while).
    346   - Interation with ILOM/...: reset systems.
    347   - Be able to suspend testing on selected testboxes when doing maintance
     346  - Interaction with ILOM/...: reset systems.
     347  - Be able to suspend testing on selected testboxes when doing maintenance
    348348    (where automatically resuming testing on reboot is undesired) or similar
    349349    activity.
    350   - Abort testing on seleced testboxes.
     350  - Abort testing on selected testboxes.
    351351  - Scheduling of tests requiring more than one testbox.
    352352  - Scheduling of tests that cannot be executing concurrently on several
     
    357357  - Configure tests with variable configuration to get better coverage. Two modes:
    358358      - TM generates the permutations based on one or more sets of test script arguments.
    359       - Each configuration permuation is specified manually.
     359      - Each configuration permutation is specified manually.
    360360  - Test specification needs to be flexible (select tests, disable test, test
    361361    scheduling (run certain tests nightly), ... ).
     
    367367    primary log associated with it.
    368368  - Test sets stores further result as a recursive collection of:
    369       - hierachical subtest name (slash sep)
     369      - hierarchical subtest name (slash sep)
    370370      - test parameters / config
    371371      - bool fail/succ
     
    448448for a testcase.  It will schedule on a testcase level, using the combined
    449449priority of the testcase in the test group and the test group with the testbox
    450 partition, trying to spread the test case argument varation out accordingly
     450partition, trying to spread the test case argument variation out accordingly
    451451over the whole scheduilng queue.  Which argument variation to start with, is
    452452not undefined (random would be best).
     
    486486the end (exclusive).
    487487
    488 Tuple-versioning has a shortcomming wrt to keys, both primary and foreign.
     488Tuple-versioning has a shortcoming wrt to keys, both primary and foreign.
    489489The primary key of a table employing tuple-versioning is really
    490490'id' + 'valid_period', where the latter is expressed using two fields
     
    494494
    495495Foreign key references to a table using tuple-versioning is running into
    496 trouble because of the time axsis and that to our knowledge foreign keys
     496trouble because of the time axis and that to our knowledge foreign keys
    497497must reference exactly one row in the other table.  When time is involved
    498498what we wish to tell the database is that at any given time, there actually
     
    634634
    6356353. If the testbox was marked as disabled, respond with an IDLE command to the
    636    testbox [done]. (Note! Must do this after TestBoxStatuses maintainance from
     636   testbox [done]. (Note! Must do this after TestBoxStatuses maintenance from
    637637   point 2, or abandoned tests won't be cleaned up after a testbox is disabled.)
    638638
     
    740740
    741741Also, we need some way of dealing with 'abort' and 'reboot' commands being
    742 issued while waiting.  The easy way out is pretent it's a time out.
     742issued while waiting.  The easy way out is pretend it's a time out.
    743743
    744744When changing the status to 'gang-timeout' we have to be careful.  First of all,
     
    789789This is a subfunction of scenario #1 and #2.  The actions taken are the same in
    790790both situations.  The precondition for taking this path is that the row in the
    791 testboxstatus table is refering to a testset (i.e. testset_id is not NULL).
     791testboxstatus table is referring to a testset (i.e. testset_id is not NULL).
    792792
    793793
     
    795795
    7967961. If the testset is incomplete, we need to completed:
    797         a) Add a message to the root TestResults row, creating one if necesary,
     797        a) Add a message to the root TestResults row, creating one if necessary,
    798798           that explains that the test was abandoned.  This is done
    799799           by inserting/finding the string into/in TestResultStrTab and adding
     
    939939------------
    940940
    941 The goal for this milestone is configuration and converting current testscases,
     941The goal for this milestone is configuration and converting current testcases,
    942942the result will be the a minimal test deployment (4-5 new testboxes).
    943943
     
    983983
    984984Once deployed, a golden rule will be that all new features shall have test
    985 coverage.  Preferrably, implemented by someone else and prior to the feature
     985coverage.  Preferably, implemented by someone else and prior to the feature
    986986implementation.
    987987
     
    10601060:Status: $Id$
    10611061:Copyright: Copyright (C) 2010-2020 Oracle Corporation.
    1062 
Note: See TracChangeset for help on using the changeset viewer.

© 2025 Oracle Support Privacy / Do Not Sell My Info Terms of Use Trademark Policy Automated Access Etiquette