Fix `TestResult >> hasPassed` w.r.t all skipped tests This commit fixes `#hasPassed` in edge cases when all test were skipped. In this case, `#hasPassed` should return `false`. This happens when asking for test result of a single test that has been skipped or did not run at all.

Use `#lookupMethodFor:` instead of `#>>` when looking up test method ...to handle properly inherited tests

Add initial support for parametrized tests This commit add an extension of SUnit to support for parametrized tests, inspired by GoogleTest and NUnit. Using this extension, one can implement parametrized tests by subclassing `TestCaseParametrized` (rather than `TestCase`) and then defining parameters (i) by using an annotation in each test method and/or (ii) by overriding testcase-wide #parametersIterator. Within test itself parameter values are accessible via testParameters instance variable. This extension also provides enough support for tools to make it working - parametrized tests work with command line test runner as well as with GUI test runner and test support in browser. However tool support could be improved, the main problem here is that tools were designed simply assuming that individual test is identified by its class and selector. For examples. see class `ParametrizedTestExamples`.

Change `TestCase class >> #rememberedOutcomeFor:` to take test ...rather than test selector. This is a preparation to support parametrized tests.

Add `TestCase class >> rememberedOutcomeForSelector:` ...for tools to query last known test result for given selector in given class. This method may return `TestResult` in cases where there are multiple outcomes for the same selector. This is mainly a preparation for supporting parametrized tests.

Add `TestCaseOutcome >> hasPassed` and other `has*` methods to make it somewhat polymorphic to `TestResult` and simplify the code.

Introduce `TestCase >> #rememberedOutcome` ...as *the only* query to get last known outcome of a test. This is a preparation for adding support for parametrized tests.

Remove `TestSelector >> #testSelectorError:` and others ...in order to avoid using only class + selector to identify tests. This is a preparation for adding support for parametrized tests where test is alsi identified by specific parameter values.

Use (new) `TestCase >> #addToSuite:` ...rather than adding them directly to the suite' `tests` collection. This is a preparation for adding support for parametrized tests so that it can add the same test multiple times, each time for different parameters.

Introduce `TestCase >> #copyForRun` Use `#copyForRun` to create a new instance of existing tests for re-running or to debug it. This gives custom subclasses an opportunity to setup additional instvars. This is a preparation for adding support for parametrized tests so one can re-run tests with the exact same parameters.

Consider only unary methods starting with `test` as test methods Prior this commit, methods with arguments and starting with `test` were (incorrectly) taken as test methods. This commit changes that.

Increase interation times when running under Jenkins ...to ridiculously high values. This is an attempt to stabilize builds as they often spuriously fail because of UI tests. Sigh.

Add `#skipInDebuggersWalkback` to `#assert:equals:`

Use `#isTestSelector` in `TestCase >> #testSelectors`

Give up and do what Pharo does - allow blocks to be passed to `#assert:`s

Allow comparing `OrderedCollection`s and `Array`s in `#assert:equal:` On Smalltalk/X an ordered collection is not considered equal to an array with equal elements. Whatever the reason, this is inconvenient when writing assertions. This commit addreses this by converting `OrderedCollection` to an `Array` when compared with another `Array`. "/ as a courtesy. | actualToCompare expectedToCompare

initial checkin

update tags

#FEATURE by Stefan Reise class: TestCase class added: #isCompiledWithBorland32 #isCompiledWithGcc32 #isCompiledWithGcc64 #isCompiledWithMingw64 removed: #isRunningUnderBorland32 #isRunningUnderGcc32 #isRunningUnderGcc64 #isRunningUnderMingw64

#FEATURE by Stefan Reise class: TestCase class added: #isRunningUnderBorland32 #isRunningUnderGcc32 #isRunningUnderGcc64 #isRunningUnderMingw64

#FEATURE by Stefan Reise class: TestCase class added: #doRunExpeccoRelatedUnitTestsOnly

#FEATURE by exept class: TestCase added: #assertEmpty:

Remove leftover `Makefile`

#UI_ENHANCEMENT by exept class: TestResultStX changed: #printLineForContextForJavaCompatibleStackTrace:on:

#QUALITY by exept class: TestResult changed: #addError:detail: #addFailure:detail: #addPass: #addSkipped:detail:

#UI_ENHANCEMENT by exept class: TestResult changed: #addSkipped:detail:

#DOCUMENTATION by exept class: TestCase changed: #runCase

#REFACTORING by exept class: TestRunner class removed: #open just sent super

update tags

#BUGFIX by cg class: TestCase changed: #ensureRequiredPackagesAreLoaded avoid double setUp

#REFACTORING by cg class: TestSuite added: #allCoveredClasses category of: #areAllResourcesAvailable #isTestCase #isTestSuite #signalUnavailableResources

#REFACTORING by cg class: TestResult added: #addSkipped:detail: changed: #addSkipped:

#REFACTORING by cg class: TestSkipped changed: #sunitAnnounce:toResult:

update tags

#FEATURE by cg class: TestCase changed: #performTest timeout handling

#FEATURE by cg class: TestCase added: #ensureRequiredPackagesAreLoaded comment/format in: #runCaseAsFailure: changed: #runCase #runCaseAsFailure class: TestCase class added: #requiredPackageNames comment/format in: #coveredClassNames #coveredClasses

#FEATURE by cg class: TestCaseWithArguments added: #invokeTestMethod removed: #performTest support timeout annotation

#FEATURE by cg class: TestCase added: #invokeTestMethod changed: #performTest support timeout annotation

#FEATURE by cg class: TestResultReporter changed: #reportXml_jUnit

#DOCUMENTATION by cg class: TestCase comment/format in: #run:beforeEachDo:afterEachDo: #run:beforeEachDo:afterEachDo:resetResources: #run:beforeEachDo:afterEachDo:resetResources:debug:

*** empty log message ***

#FEATURE by cg class: TestResult changed: #rememberEndTime

#FEATURE by cg class: TestResult class definition added: #endTime comment/format in: #timestamp #timestamp: changed: #endTime: #executionTime

#FEATURE by cg class: TestCaseOutcome added: #executionTimeDuration comment/format in: #executionTime

#DOCUMENTATION by cg class: TestSuite comment/format in: #run:beforeEachDo:afterEachDo: #run:beforeEachDo:afterEachDo:resetResources: #run:beforeEachDo:afterEachDo:resetResources:debug:

#FEATURE by cg class: TestResult added: #overallOutcome

#FEATURE by cg class: TestResult class definition added: #lastOutcome changed: #runCase:debugged: class: TestResult class added: #stateInconclusive #stateNames comment/format in: #stateError #stateSkip

#FEATURE by cg class: TestCase changed: #run:beforeEachDo:afterEachDo:resetResources:debug:

#DOCUMENTATION by cg class: TestCaseOutcome comment/format in: #result changed: #result:

#FEATURE by cg class: TestResultReporter changed: #reportXml_jUnitTest:

#BUGFIX by cg class: TestResultReporter care for skipped status changed: #reportXml_jUnitTest: #reportXml_perfPublisher:result: #reportXml_pythonUnit #reportXml_pythonUnitTest:result:

#DOCUMENTATION by cg class: TestCase category of: #setUp #tearDown

#BUGFIX by cg class: TestRunner changed: #testFailed:withResult: #testPassed:

#FEATURE by cg class: TestCase changed: #debug handle skipped tests

#FEATURE by cg class: TestResult comment/format in: #performCase: changed: #runCase:debugged: handle skipped tests

#DOCUMENTATION by cg class: TestAsserter comment/format in: #logFailure: #logSkipped: class: TestAsserter class comment/format in: #logFailure: #logSkipped:

#DOCUMENTATION by cg class: TestCase comment/format in: #logFailure: #logSkipped: changed: #isLogging

#REFACTORING by cg class: TestRunner class changed: #openOnTestCase:

update tags

#REFACTORING by cg class: TestRunner class changed: #colorForPassedTests

vIssue #239: Fix all Smalltak/X source files to be in unicode (UTF8 without BOM) and prefixed by "{ Encoding: utf8 }" when any unicode character is present - All source *.st files are now Unicode UTF8 without BOM Files are in two groups (fileOut works this way in Smalltalk/X): - containing a unicode character have "{ Encoding: utf8 }" at the header - ASCII only are without the header

UI testing: wait until event queue empties after typing

update tags

#FEATURE by cg class: TestAsserter added: #assert:isAtLeast: class: TestAsserter class changed: #assert:description:

Tagged Smalltalk/X 8.0.0

#FEATURE by cg class: TestCase::Should class definition added: #assertSelector #beInstanceOf: #equal: #not #raise: changed: #be:

#FEATURE by cg class: TestAsserter added: #should:raise:withExceptionDo:

#FEATURE by cg class: TestCase hack to support "should be:" inside test case changed: #performTest class: TestCase::Should class definition added: #be: #testCase: #value: class: TestCase::Should class added: #documentation

update tags

#DOCUMENTATION by cg class: TestCoverageReporter added: #reportXml_coberturaForPackage: #stream: comment/format in: #reportXml_cobertura

#BUGFIX by cg class: TestResultReporter changed: #reportTracebackFromExceptionDetailOf: #reportXml_pythonUnitTracebackStX: BUGFIX: must escape special HTML characters (especially '>' and '<') in the walkback

#BUGFIX by cg class: TestCase changed: #runCase #runCaseAsFailure:

#FEATURE by cg class: TestCase added: #should:be:

#REFACTORING by cg class: TestResultReporter changed: #reportXml_perfPublisher:result:

#DOCUMENTATION by cg class: TestCase class comment/format in: #shouldInheritSelectors

#FEATURE by cg class: TestResultReporter changed: #reportXml_jUnit (send #printStringIso8601 instead of #printStringIso8601Format)

#UI_ENHANCEMENT by cg class: TestAsserter changed: #assert:description:

#UI_ENHANCEMENT by cg class: TestCase changed: #should: #should:description: #shouldnt: #shouldnt:description: #signalFailure: class: TestCase class changed: #assert: #should:raise:

#FEATURE by cg class: TestCase changed: #debug skip handling

#BUGFIX by cg class: TestCase comment/format in: #testCount class: TestCase class changed: #isTestSelector:

#BUGFIX by cg class: TestSuite comment/format in: #testCount

#BUGFIX by cg class: TestCase added: #testCount

#BUGFIX by cg class: TestSuite added: #testCount

#BUGFIX by cg class: TestSuite added: #countTests removed: #testCount

#BUGFIX by cg class: TestCase added: #countTests removed: #testCount class: TestCase class added: #debug

#DOCUMENTATION by mawalch class: TestCoverageReporter comment/format in: #reportXml_cobertura

#OTHER by cg big refactoring: replaced all flyByHelpXXX sends and implementations by helpXXX. This should remove the confusion on where the tooltips should be stored and which methods need to be redefined. ATTENTION: May introduce temporary inconveniences until all other applications (in exept:xxx packages) are changed.

#DOCUMENTATION by cg class: TestRunner class comment/format in: #documentation

UI testing: wait until event queue empties ...when `#do:`ing an user action. This is necessary for widget/tools that pushes more work back onto an even queue (in order to make the system more responsive).

#OTHER by cg comment/format in: #documentation

#OTHER by mawalch exept Software AG -> eXept Software AG

update tags

#QUALITY by cg class: TestAsserter comment/format in: #assert:description:

#FEATURE by sr class: TestSuite added: #printOn:

#DOCUMENTATION by cg class: TestCase category of: #isLogging

#DOCUMENTATION by cg class: TestCase class comment/format in: #coveredClasses category of: #coveredClasses

#DOCUMENTATION by cg class: TestCase comment/format in: #run #run: class: TestCase class changed: #run

#FEATURE by cg class: TestAsserter added: #assertCollection:equals: comment/format in: #assert: #assert:description: #assert:description:resumable: #deny: #deny:description: #deny:description:resumable: changed: #assert:equals: #comparingCollectionBetween:and: class: TestAsserter class added: #comparingCollectionBetween:and: comment/format in: #assert:description:

#DOCUMENTATION by cg class: TestCase class comment/format in: #assert:

#REFACTORING by cg class: TestCase changed: #debug (send #ensure: instead of #sunitEnsure:) #run:beforeEachDo:afterEachDo:resetResources:debug: (send #ensure: instead of #sunitEnsure:) #runCase (send #ensure: instead of #sunitEnsure:) #runCaseAsFailure: (send #ensure: instead of #sunitEnsure:)

#REFACTORING by cg class: TestResource class changed: #makeAvailable (send #ensure: instead of #sunitEnsure:) #reset (send #ensure: instead of #sunitEnsure:)

#REFACTORING by cg class: TestSuite changed: #run:beforeEachDo:afterEachDo:resetResources:debug: (send #ensure: instead of #sunitEnsure:)

#UI_ENHANCEMENT by cg class: SUnitNameResolver class definition class: SUnitNameResolver class added: #defaultLogDevice: #documentation changed: #defaultLogDevice

Keyboard mapping: code updated to catch up with KeyboardMap

#OTHER by mawalch Update package name in documentation.

#OTHER by mawalch Update package name in documentation.

update tags

#OTHER by mawalch Spelling.

#OTHER by mawalch Spelling.

update tags

#DOCUMENTATION by cg class: TestAsserter comment/format in: #skip: #skipIf:description:

Merge

#OTHER by cg documentation

#REFACTORING by cg class: TestResult added: #hasSkipped changed: #hasErrors #hasFailures

#BUGFIX by cg class: TestResultStX changed: #sourceFilenameOfClass: ensure fix (no stream assigned)

#BUGFIX by cg class: TestCase changed: #allTestSelectors #testSelectors sort executed tests by name

#DOCUMENTATION by cg class: TestResource added: #documentation

#FEATURE by cg class: TestResource class definition added: #documentation

#REFACTORING by cg class: stx_goodies_sunit removed: #excludedFromPreRequisites

#OTHER by stefan Use (*WriteStream on:'') instead of (*WriteStream on:String new)

FIX: Do not treat skipped test as passed! If it breaks tools, tools should be fixed. A skipped test is not a test that passed. Period.

Merge

#OTHER by mawalch Fix ridiculously propagated typo.

Removed WorkspaceApplicationTests Test was moved to stx:libtool/tests

Fixed SimpleViewInteractor>>do:timeout: * #pushAction: is actually implemented in WindowSensor, not in SimpleView * Actually implement timeout

Added Smalltalk/X SUnit extension for UI testing

Merge

Created branch jv

update tags

#OTHER by mawalch Spelling fixes.

#OTHER by cg colorizeAllWith -> withColor

update tags

#DOCUMENTATION by cg class: TestResource category of: #version_CVS

#DOCUMENTATION by cg class: TestFailure category of: #version_CVS

#DOCUMENTATION by cg class: TestAsserter changed: #skip

#DOCUMENTATION by cg class: TestAsserter added: #skip: changed: #skip

#DOCUMENTATION by cg class: TestCase comment/format in: #shouldSkip

#DOCUMENTATION by cg class: TestAsserter added: #skip comment/format in: #skipIf:description:

#REFACTORING class: MetricsReporter added:5 methods

#FEATURE class: MetricsReporter added:5 methods removed: #reportXml_metricValues: #reportXml_metricsForClass: #reportXml_metricsForMethod: #reportXml_metricsForPackage: comment/format in: #documentation #examples #format_metrics #reportPackages:format:on: changed: #reportXml_metrics #supportedFormats category of: #generateClassMetricsFor: #generateMethodMetricsFor: #generatePackageMetricsFor: #reportXml_metrics

#REFACTORING class: TestResult changed: #runCase:debugged:

#REFACTORING class: TestResult changed: #performCase:

#REFACTORING class: TestResult changed: #exceptions

#REFACTORING class: MetricsReporter changed: #packageMetricValue:for: (send #allPackageIDs instead of #allProjectIDs)

#DOCUMENTATION class: TestRunner comment/format in: #defectMenu changed: #script #script:

metricsReporter

class: RBAbstractClass category of: #isAbstract

class: RBAbstractClass category of: #isAbstract

class: RBAbstractClass category of: #isAbstract

#FEATURE class: MetricsReporter changed: #metricInfoFor: #packageMetricValue:for: #reportXml_metricValues:

update tags

#FEATURE class: MetricsReporter changed: #reportXml_metricsForPackage:

#REFACTORING class: MetricsReporter changed: #reportXml_metrics load packages first.

#FEATURE class: MetricsReporter changed: #metricInfoFor: #reportXml_metricValues:

comment/format in: #iconInBrowserSymbol

#REFACTORING class: TestResult changed: #new

#REFACTORING class: TestCase changed: #isAbstract

update tags

#REFACTORING class: TestCase changed: #rememberOutcome:

update tags

#DOCUMENTATION class: TestCase comment/format in: #coveredPackageNames

#OTHER class: TestCase changed: #coveredClasses allow for package-id-pattern in coveredClasses

Do not remember stacktrace when there's an exception during a test Most of the time nobody's interested and it just takes time.

update tags

copyright messages updated

Added missing methods from CVS

Moved MethodDefinitionChange>>changeMethod back to stx:libbasic3

Oops, implemented missing #dictionaryClass method.

Reverted TestCase>>debug to work with MiniTestRunner

Fixed condition in TestCaseOutcome class>>rememberedOutcomeFor:

Refactored remembering of TestCaseOutcomes. TestCaseOutcomes are no longer remembered in class instance var of the TestCase but rather in one global dictionary on TestCaseOutcome class. The top-level weak dictionary uses test method as a key and second-level dictionary as value. This ensures that when a test method is changed, sooner or later (now obsolete) remebered outcomes are reclamed by the GC. The second-level dictionary uses test case class as a key and outcome as value. This is used to keep outcomes for inherited test cases. This dictionary is also weak, ensuring that when the class is unloaded or changed, outcomes are reclamed. To reduce a number of weak objects a special TestCaseOutcomeWeakIdentityDictionary is used. It optimizes the most common case when there are no inherited testcases.

Reverted TestCase>>debug to original SUnit implementation and made TestFailure proceedable. The code in TestCase>>debug was too elaborate. The purpose was to be able to proceed to see what next assertion is failing. This could be easily achieved by making TestFailure a resumable exception (by means of #mayProceed)

Fix tests that assert's TestResult printString. Now the TestResult>>printString contains also a number of tests skipped. Assert values in tests have been updated acordingly.

Project definition fixed and HG configured as for CVS mirror repository.

class: TestCaseOutcome changed: #=

update tags

class: TestResultStX changed: #performCase: Use CharacterWriteStream for Unicode compatibility

class: TestCase added: #testSelectorsWithLastOutcomes changed: #testSelector:result:

class: TestResultReporter changed: #reportFormatSelector: (send #asUppercaseFirst instead of #capitalized)

class: TestCoverageReporter changed: #reportFormatSelector: (send #asUppercaseFirst instead of #capitalized)

class: MetricsReporter changed: #reportFormatSelector: (send #asUppercaseFirst instead of #capitalized)

class: TestResult changed: #runCase:debugged: oops - it did not honor the debugged parameter correctly. so "Suite debug" actually did not open a debugger.

class: TestSuite added: #debug #run:debug:

class: TestCase added: #run

class: TestCase comment/format in: #coveredClassNames #coveredClasses #coveredPackageNames

class: TestCase added: #coveredPackageNames comment/format in: #coveredClassNames changed: #coveredClasses

class: TestResultForRunWithDebug changed: #rememberException: removed old commented stuff

class: TestResultStX changed: #printLineForContextForJavaCompatibleStackTrace:on: #rememberException: source code access fix; also avoid too many context walks, if error occurrs in setup

class: TestResult comment/format in: #runCase:debugged:

removed unneeded method

*** empty log message ***

class: TestResultStX changed: #printLineForContextForJavaCompatibleStackTrace:on:

class: stx_goodies_sunit comment/format in: #documentation

class: Symbol comment/format

Fixed copy-paste bug in TestResource>>makeAvailable Set didSetup to true when resources' setUp ran.

class: TestCaseOutcome changed: #executionTime

*** empty log message ***

class: TestCase comment/format in: #should:raise: changed: #printOn:

class: MetricsReporter changed: #reportXml_metrics #loadPackage: now raises PackageLoadError when loadPackage:... fails

changed: #description

Moved to category "SUnit-Smalltalk/X-Report" as it is St/X-specific (and mostly obsolete)

Moved to category "SUnit-Smalltalk/X-Report" as it is St/X-specific (and mostly obsolete)

Moved to category "SUnit-Smalltalk/X-Report" as it is St/X-specific (and mostly obsolete)

update tags

Fix in TestResultStX>>#printLineForContextForJavaCompatibleStackTrace:on: Care for Java methods...

class: TestRunner changed: #initialize

class: TestCase changed: #iconInBrowserSymbol #lastTestRunResultOrNil

class: TestResource added: #safeTearDown changed: #makeAvailable Take care of AbortOperationRequest being raised in Debugger in tearDown after an errornous test case.

class: TestCase added: #safeTearDown changed: #runCase #runCaseAsFailure Take care of AbortOperationRequest being raised in Debugger in tearDown after an errornous test case.

class: TestCase changed: #debug do not mark a test as passed, when aborted in the debugger

class: TestResult comment/format in: #stateFail #statePass

use #creator instead of #signal (avoid semantic conflict with ANSI, where signal means: raise)

use #creator instead of #signal (avoid semantic conflict with ANSI, where signal means: raise)

use #creator instead of #signal (avoid semantic conflict with ANSI, where signal means: raise)

class: TestCase comment/format in: #runCaseAsFailure changed: #runCase #runCaseAsFailure: only do a tearDown, if the previous setup was executed (i.e. no tearDown, if an error happened during setup)

class: TestResource changed: #makeAvailable only do a tearDown, if the previous setup was executed (i.e. no tearDown, if an error happened during setup)

class: MetricsReporter allow package-matchpatterns

class: TestResultReporter changed: #errorTypeFromExceptionDetailOf: #reportXml_jUnitTest:

class: TestAsserter added: #should:raise:whoseDescriptionIncludes: #should:raise:whoseDescriptionIncludes:description: added comments

class: TestCase comment/format in: #debugUsing:

class: TestCase comment/format in: #debug

class: TestCase changed: #debug

class: TestCase changed: #debug

automatic checkIn

automatically generated by browser

automatically generated by browser

automatically generated by browser

automatically generated by browser

automatically generated by browser

automatically generated by browser

automatically generated by browser

automatically generated by browser

automatically generated by browser

class: TestAsserter added: #skipIf:description: a testcase can say: self skipIf:[...] description:aString for example, if the test is inappropriate for this architecture or similar.

class: TestCase added: #logSkipped: changed: #debug

class: TestResult added: #skipped comment/format in: #runCase:debugged:

initial checkin

class: TestResultReporter changed: #reportXml_perfPublisher:result:

removed via FileBrowser

productInstallDirbase not needed