comparison packages/NUnit.3.0.1/CHANGES.txt @ 158:130781364799 v2

refactoring, code cleanup
author cin
date Thu, 18 Feb 2016 14:34:02 +0300
parents
children
comparison
equal deleted inserted replaced
157:948c015a9011 158:130781364799
1 NUnit 3.0.1 - December 1, 2015
2
3 Console Runner
4
5 * The Nunit.Runners NuGet package was updated to become a meta-package that pulls in the NUnit.Console package
6 * Reinstated the --pause command line option that will display a message box allowing you to attach a debugger if the --debug option does not work
7
8 Issues Resolved
9
10 * 994 Add max number of Agents to the NUnit project file
11 * 1014 Ensure NUnit API assembly updates with MSI installs
12 * 1024 Added --pause flag to console runner
13 * 1030 Update Nunit.Runners package to 3.0
14 * 1033 "No arguments were provided" with Theory and Values combination
15 * 1035 Check null arguments
16 * 1037 Async tests not working on Windows 10 Universal
17 * 1041 NUnit2XmlResult Writer is reporting Sucess when test fails
18 * 1042 NUnit2 reports on 3.0 is different than 2.6.4
19 * 1046 FloatingPointNumerics.AreAlmostEqualUlps throws OverflowException
20 * 1049 Cannot select Generic tests from command line
21 * 1050 Do not expose System.Runtime.CompilerServices.ExtensionAttribute to public
22 * 1054 Create nuget feeds for CI builds on Appveyor
23 * 1055 nunit3 console runner --where option does not return error on invalid selection string
24 * 1060 Remove "Version 3" from NUnit Nuget Package
25 * 1061 Nunit30Settings.xml becomes corrupted
26 * 1062 Console.WriteLine statements in "OneTimeSetUp" and "OneTimeTearDown" annotated methods are not directed to the console when using nunit3-console.exe runner
27 * 1063 Error in Random Test
28
29 NUnit 3.0.0 Final Release - November 15, 2015
30
31 Issues Resolved
32
33 * 635 Mono 4.0 Support
34
35 NUnit 3.0.0 Release Candidate 3 - November 13, 2015
36
37 Engine
38
39 * The engine now only sets the config file for project.nunit to project.config if project.config exists. Otherwise, each assembly uses its own config, provided it is run in a separate AppDomain by itself.
40
41 NOTE: It is not possible for multiple assemblies in the same AppDomain to use different configs. This is not an NUnit limitation, it's just how configs work!
42
43 Issues Resolved
44
45 * 856 Extensions support for third party runners in NUnit 3.0
46 * 1003 Delete TeamCityEventHandler as it is not used
47 * 1015 Specifying .nunit project and --framework on command line causes crash
48 * 1017 Remove Assert.Multiple from framework
49
50 NUnit 3.0.0 Release Candidate 2 - November 8, 2015
51
52 Engine
53
54 * The IDriverFactory extensibility interface has been modified.
55
56 Issues Resolved
57
58 * 970 Define PARALLEL in CF build of nunitlite
59 * 978 It should be possible to determine version of NUnit using nunit console tool
60 * 983 Inconsistent return codes depending on ProcessModel
61 * 986 Update docs for parallel execution
62 * 988 Don't run portable tests from NUnit Console
63 * 990 V2 driver is passing invalid filter elements to NUnit
64 * 991 Mono.Options should not be exposed to public directly
65 * 993 Give error message when a regex filter is used with NUnit V2
66 * 997 Add missing XML Documentation
67 * 1008 NUnitLite namespace not updated in the NuGet Packages
68
69 NUnit 3.0.0 Release Candidate - November 1, 2015
70
71 Framework
72
73 * The portable build now supports ASP.NET 5 and the new Core CLR.
74
75 NOTE: The `nunit3-console` runner cannot run tests that reference the portable build.
76 You may run such tests using NUnitLite or a platform-specific runner.
77
78 * `TestCaseAttribute` and `TestCaseData` now allow modifying the test name without replacing it entirely.
79 * The Silverlight packages are now separate downloads.
80
81 NUnitLite
82
83 * The NUnitLite runner now produces the same output display and XML results as the console runner.
84
85 Engine
86
87 * The format of the XML result file has been finalized and documented.
88
89 Console Runner
90
91 * The console runner program is now called `nunit3-console`.
92 * Console runner output has been modified so that the summary comes at the end, to reduce the need for scrolling.
93
94 Issues Resolved
95
96 * 59 Length of generated test names should be limited
97 * 68 Customization of test case name generation
98 * 404 Split tests between nunitlite.runner and nunit.framework
99 * 575 Add support for ASP.NET 5 and the new Core CLR
100 * 783 Package separately for Silverlight
101 * 833 Intermittent failure of WorkItemQueueTests.StopQueue_WithWorkers
102 * 859 NUnit-Console output - move Test Run Summary to end
103 * 867 Remove Warnings from Ignored tests
104 * 868 Review skipped tests
105 * 887 Move environment and settings elements to the assembly suite in the result file
106 * 899 Colors for ColorConsole on grey background are too light
107 * 904 InternalPreserveStackTrace is not supported on all Portable platforms
108 * 914 Unclear error message from console runner when assembly has no tests
109 * 916 Console runner dies when test agent dies
110 * 918 Console runner --where parameter is case sensitive
111 * 920 Remove addins\nunit.engine.api.dll from NuGet package
112 * 929 Rename nunit-console.exe
113 * 931 Remove beta warnings from NuGet packages
114 * 936 Explicit skipped tests not displayed
115 * 939 Installer complains about .NET even if already installed
116 * 940 Confirm or modify list of packages for release
117 * 947 Breaking API change in ValueSourceAttribute
118 * 949 Update copyright in NUnit Console
119 * 954 NUnitLite XML output is not consistent with the engine's
120 * 955 NUnitLite does not display the where clause
121 * 959 Restore filter options for NUnitLite portable build
122 * 960 Intermittent failure of CategoryFilterTests
123 * 967 Run Settings Report is not being displayed.
124
125 NUnit 3.0.0 Beta 5 - October 16, 2015
126
127 Framework
128
129 * Parameterized test cases now support nullable arguments.
130 * The NUnit framework may now be built for the .NET Core framework. Note that this is only available through building the source code. A binary will be available in the next release.
131
132 Engine
133
134 * The engine now runs multiple test assemblies in parallel by default
135 * The output XML now includes more information about the test run, including the text of the command used, any engine settings and the filter used to select tests.
136 * Extensions may now specify data in an identifying attribute, for use by the engine in deciding whether to load that extension.
137
138
139 Console Runner
140
141 * The console now displays all settings used by the engine to run tests as well as the filter used to select tests.
142 * The console runner accepts a new option --maxagents. If multiple assemblies are run in separate processes, this value may be used to limit the number that are executed simultaneously in parallel.
143 * The console runner no longer accepts the --include and --exclude options. Instead, the new --where option provides a more general way to express which tests will be executed, such as --where "cat==Fast && Priority==High". See the docs for details of the syntax.
144 * The new --debug option causes NUnit to break in the debugger immediately before tests are run. This simplifies debugging, especially when the test is run in a separate process.
145
146 Issues Resolved
147
148 * 41 Check for zeroes in Assert messages
149 * 254 Finalize XML format for test results
150 * 275 NUnitEqualityComparer fails to compare IEquatable<T> where second object is derived from T
151 * 304 Run test Assemblies in parallel
152 * 374 New syntax for selecting tests to be run
153 * 515 OSPlatform.IsMacOSX doesn't work
154 * 573 nunit-console hangs on Mac OS X after all tests have run
155 * 669 TeamCity service message should have assembly name as a part of test name.
156 * 689 The TeamCity service message "testFinished" should have an integer value in the "duration" attribute
157 * 713 Include command information in XML
158 * 719 We have no way to configure tests for several assemblies using NUnit project file and the common installation from msi file
159 * 735 Workers number in xml report file cannot be found
160 * 784 Build Portable Framework on Linux
161 * 790 Allow Extensions to provide data through an attribute
162 * 794 Make it easier to debug tests as well as NUnit itself
163 * 801 NUnit calls Dispose multiple times
164 * 814 Support nullable types with TestCase
165 * 818 Possible error in Merge Pull Request #797
166 * 821 Wrapped method results in loss of result information
167 * 822 Test for Debugger in NUnitTestAssemblyRunner probably should not be in CF build
168 * 824 Remove unused System.Reflection using statements
169 * 826 Randomizer uniqueness tests fail randomly!
170 * 828 Merge pull request #827 (issue 826)
171 * 830 Add ability to report test results synchronously to test runners
172 * 837 Enumerators not disposed when comparing IEnumerables
173 * 840 Add missing copyright notices
174 * 844 Pull Request #835 (Issue #814) does not build in CF
175 * 847 Add new --process:inprocess and --inprocess options
176 * 850 Test runner fails if test name contains invalid xml characters
177 * 851 'Exclude' console option is not working in NUnit Lite
178 * 853 Cannot run NUnit Console from another directory
179 * 860 Use CDATA section for message, stack-trace and output elements of XML
180 * 863 Eliminate core engine
181 * 865 Intermittent failures of StopWatchTests
182 * 869 Tests that use directory separator char to determine platform misreport Linux on MaxOSX
183 * 870 NUnit Console Runtime Environment misreports on MacOSX
184 * 874 Add .NET Core Framework
185 * 878 Cannot exclude MacOSX or XBox platforms when running on CF
186 * 892 Fixed test runner returning early when executing more than one test run.
187 * 894 Give nunit.engine and nunit.engine.api assemblies strong names
188 * 896 NUnit 3.0 console runner not placing test result xml in --work directory
189
190 NUnit 3.0.0 Beta 4 - August 25, 2015
191
192 Framework
193
194 * A new RetryAttribute allows retrying of failing tests.
195 * New SupersetConstraint and Is.SupersetOf syntax complement SubsetConstraint.
196 * Tests skipped due to ExplicitAttribute are now reported as skipped.
197
198 Engine
199
200 * We now use Cecil to examine assemblies prior to loading them.
201 * Extensions are no longer based on Mono.Addins but use our own extension framework.
202
203 Issues Resolved
204
205 * 125 3rd-party dependencies should be downloaded on demand
206 * 283 What should we do when a user extension does something bad?
207 * 585 RetryAttribute
208 * 642 Restructure MSBuild script
209 * 649 Change how we zip packages
210 * 654 ReflectionOnlyLoad and ReflectionOnlyLoadFrom
211 * 664 Invalid "id" attribute in the report for case "test started"
212 * 685 In the some cases when tests cannot be started NUnit returns exit code "0"
213 * 728 Missing Assert.That overload
214 * 741 Explicit Tests get run when using --exclude
215 * 746 Framework should send events for all tests
216 * 747 NUnit should apply attributes even if test is non-runnable
217 * 749 Review Use of Mono.Addins for Engine Extensibility
218 * 750 Include Explicit Tests in Test Results
219 * 753 Feature request: Is.SupersetOf() assertion constraint
220 * 755 TimeOut attribute doesn't work with TestCaseSource Attribute
221 * 757 Implement some way to wait for execution to complete in ITestEngineRunner
222 * 760 Packaging targets do not run on Linux
223 * 766 Added overloads for True()/False() accepting booleans
224 * 778 Build and build.cmd scripts invoke nuget.exe improperly
225 * 780 Teamcity fix
226 * 782 No sources for 2.6.4
227
228 NUnit 3.0.0 Beta 3 - July 15, 2015
229
230 Framework
231
232 * The RangeAttribute has been extended to support more data types including
233 uint, long and ulong
234 * Added platform support for Windows 10 and fixed issues with Windows 8 and
235 8.1 support
236 * Added async support to the portable version of NUnit Framework
237 * The named members of the TestCaseSource and ValueSource attributes must now be
238 static.
239 * RandomAttribute has been extended to add support for new data types including
240 uint, long, ulong, short, ushort, float, byte and sbyte
241 * TestContext.Random has also been extended to add support for new data types including
242 uint, long, ulong, short, ushort, float, byte, sbyte and decimal
243 * Removed the dependency on Microsoft.Bcl.Async from the NUnit Framework assembly
244 targeting .NET 4.0. If you want to write async tests in .NET 4.0, you will need
245 to reference the NuGet package yourself.
246 * Added a new TestFixtureSource attribute which is the equivalent to TestCaseSource
247 but provides for instantiation of fixtures.
248 * Significant improvements have been made in how NUnit deduces the type arguments of
249 generic methods based on the arguments provided.
250
251 Engine
252
253 * If the target framework is not specified, test assemblies that are compiled
254 to target .NET 4.5 will no longer run in .NET 4.0 compatibility mode
255
256 Console
257
258 * If the console is run without arguments, it will now display help
259
260 Issues Resolved
261
262 * 47 Extensions to RangeAttribute
263 * 237 System.Uri .ctor works not properly under Nunit
264 * 244 NUnit should properly distinguish between .NET 4.0 and 4.5
265 * 310 Target framework not specified on the AppDomain when running against .Net 4.5
266 * 321 Rationalize how we count tests
267 * 472 Overflow exception and DivideByZero exception from the RangeAttribute
268 * 524 int and char do not compare correctly?
269 * 539 Truncation of string arguments
270 * 544 AsyncTestMethodTests for 4.5 Framework fails frequently on Travis CI
271 * 656 Unused parameter in Console.WriteLine found
272 * 670 Failing Tests in TeamCity Build
273 * 673 Ensure proper disposal of engine objects
274 * 674 Engine does not release test assemblies
275 * 679 Windows 10 Support
276 * 682 Add Async Support to Portable Framework
277 * 683 Make FrameworkController available in portable build
278 * 687 TestAgency does not launch agent process correctly if runtime type is not specified (i.e. v4.0)
279 * 692 PlatformAttribute_OperatingSystemBitNess fails when running in 32-bit process
280 * 693 Generic Test<T> Method cannot determine type arguments for fixture when passed as IEnumerable<T>
281 * 698 Require TestCaseSource and ValueSource named members to be static
282 * 703 TeamCity non-equal flowid for 'testStarted' and 'testFinished' messages
283 * 712 Extensions to RandomAttribute
284 * 715 Provide a data source attribute at TestFixture Level
285 * 718 RangeConstraint gives error with from and two args of differing types
286 * 723 Does nunit.nuspec require dependency on Microsoft.Bcl.Async?
287 * 724 Adds support for Nullable<bool> to Assert.IsTrue and Assert.IsFalse
288 * 734 Console without parameters doesn't show help
289
290 NUnit 3.0.0 Beta 2 - May 12, 2015
291
292 Framework
293
294 * The Compact Framework version of the framework is now packaged separately
295 and will be distributed as a ZIP file and as a NuGet package.
296 * The NUnit 2.x RepeatAttribute was added back into the framework.
297 * Added Throws.ArgumentNullException
298 * Added GetString methods to NUnit.Framework.Internal.RandomGenerator to
299 create repeatable random strings for testing
300 * When checking the equality of DateTimeOffset, you can now use the
301 WithSameOffset modifier
302 * Some classes intended for internal usage that were public for testing
303 have now been made internal. Additional classes will be made internal
304 for the final 3.0 release.
305
306 Engine
307
308 * Added a core engine which is a non-extensible, minimal engine for use by
309 devices and similar situations where reduced functionality is compensated
310 for by reduced size and simplicity of usage. See
311 https://github.com/nunit/dev/wiki/Core-Engine for more information.
312
313 Issues Resolved
314
315 * 22 Add OSArchitecture Attribute to Environment node in result xml
316 * 24 Assert on Dictionary Content
317 * 48 Explicit seems to conflict with Ignore
318 * 168 Create NUnit 3.0 documentation
319 * 196 Compare DateTimeOffsets including the offset in the comparison
320 * 217 New icon for the 3.0 release
321 * 316 NUnitLite TextUI Runner
322 * 320 No Tests found: Using parametrized Fixture and TestCaseSource
323 * 360 Better exception message when using non-BCL class in property
324 * 454 Rare registry configurations may cause NUnit to fail
325 * 478 RepeatAttribute
326 * 481 Testing multiple assemblies in nunitlite
327 * 538 Potential bug using TestContext in constructors
328 * 546 Enable Parallel in NUnitLite/CF (or more) builds
329 * 551 TextRunner not passing the NumWorkers option to the ITestAssemblyRunner
330 * 556 Executed tests should always return a non-zero duration
331 * 559 Fix text of NuGet packages
332 * 560 Fix PackageVersion property on wix install projects
333 * 562 Program.cs in NUnitLite NuGet package is incorrect
334 * 564 NUnitLite Nuget package is Beta 1a, Framework is Beta 1
335 * 565 NUnitLite Nuget package adds Program.cs to a VB Project
336 * 568 Isolate packaging from building
337 * 570 ThrowsConstraint failure message should include stack trace of actual exception
338 * 576 Throws.ArgumentNullException would be nice
339 * 577 Documentation on some members of Throws falsely claims that they return `TargetInvocationException` constraints
340 * 579 No documentation for recommended usage of TestCaseSourceAttribute
341 * 580 TeamCity Service Message Uses Incorrect Test Name with NUnit2Driver
342 * 582 Test Ids Are Not Unique
343 * 583 TeamCity service messages to support parallel test execution
344 * 584 Non-runnable assembly has incorrect ResultState
345 * 609 Add support for integration with TeamCity
346 * 611 Remove unused --teamcity option from CF build of NUnitLite
347 * 612 MaxTime doesn't work when used for TestCase
348 * 621 Core Engine
349 * 622 nunit-console fails when use --output
350 * 628 Modify IService interface and simplify ServiceContext
351 * 631 Separate packaging for the compact framework
352 * 646 ConfigurationManager.AppSettings Params Return Null under Beta 1
353 * 648 Passing 2 or more test assemblies targeting > .NET 2.0 to nunit-console fails
354
355 NUnit 3.0.0 Beta 1 - March 25, 2015
356
357 General
358
359 * There is now a master windows installer for the framework, engine and console runner.
360
361 Framework
362
363 * We no longer create a separate framework build for .NET 3.5. The 2.0 and
364 3.5 builds were essentially the same, so the former should now be used
365 under both runtimes.
366 * A new Constraint, DictionaryContainsKeyConstraint, may be used to test
367 that a specified key is present in a dictionary.
368 * LevelOfParallelizationAttribute has been renamed to LevelOfParallelismAttribute.
369 * The Silverlight runner now displays output in color and includes any
370 text output created by the tests.
371 * The class and method names of each test are included in the output xml
372 where applicable.
373 * String arguments used in test case names are now truncated to 40 rather
374 than 20 characters.
375
376 Engine
377
378 * The engine API has now been finalized. It permits specifying a minimum
379 version of the engine that a runner is able to use. The best installed
380 version of the engine will be loaded. Third-party runners may override
381 the selection process by including a copy of the engine in their
382 installation directory and specifying that it must be used.
383 * The V2 framework driver now uses the event listener and test listener
384 passed to it by the runner. This corrects several outstanding issues
385 caused by events not being received and allows selecting V2 tests to
386 be run from the command-line, in the same way that V3 tests are selected.
387
388 Console
389
390 * The console now defaults to not using shadowcopy. There is a new option
391 --shadowcopy to turn it on if needed.
392
393 Issues Resolved
394
395 * 224 Silverlight Support
396 * 318 TestActionAttribute: Retrieving the TestFixture
397 * 428 Add ExpectedExceptionAttribute to C# samples
398 * 440 Automatic selection of Test Engine to use
399 * 450 Create master install that includes the framework, engine and console installs
400 * 477 Assert does not work with ArraySegment
401 * 482 nunit-console has multiple errors related to -framework option
402 * 483 Adds constraint for asserting that a dictionary contains a particular key
403 * 484 Missing file in NUnit.Console nuget package
404 * 485 Can't run v2 tests with nunit-console 3.0
405 * 487 NUnitLite can't load assemblies by their file name
406 * 488 Async setup and teardown still don't work
407 * 497 Framework installer shold register the portable framework
408 * 504 Option --workers:0 is ignored
409 * 508 Travis builds with failure in engine tests show as successful
410 * 509 Under linux, not all mono profiles are listed as available
411 * 512 Drop the .NET 3.5 build
412 * 517 V2 FrameworkDriver does not make use of passed in TestEventListener
413 * 523 Provide an option to disable shadowcopy in NUnit v3
414 * 528 V2 FrameworkDriver does not make use of passed in TestFilter
415 * 530 Color display for Silverlight runner
416 * 531 Display text output from tests in Silverlight runner
417 * 534 Add classname and methodname to test result xml
418 * 541 Console help doesn't indicate defaults
419
420 NUnit 3.0.0 Alpha 5 - January 30, 2015
421
422 General
423
424 * A Windows installer is now included in the release packages.
425
426 Framework
427
428 * TestCaseAttribute now allows arguments with default values to be omitted. Additionaly, it accepts a Platform property to specify the platforms on which the test case should be run.
429 * TestFixture and TestCase attributes now enforce the requirement that a reason needs to be provided when ignoring a test.
430 * SetUp, TearDown, OneTimeSetUp and OneTimeTearDown methods may now be async.
431 * String arguments over 20 characters in length are truncated when used as part of a test name.
432
433 Engine
434
435 * The engine is now extensible using Mono.Addins. In this release, extension points are provided for FrameworkDrivers, ProjectLoaders and OutputWriters. The following addins are bundled as a part of NUnit:
436 * A FrameworkDriver that allows running NUnit V2 tests under NUnit 3.0.
437 * ProjectLoaders for NUnit and Visual Studio projects.
438 * An OutputWriter that creates XML output in NUnit V2 format.
439 * DomainUsage now defaults to Multiple if not specified by the runner
440
441 Console
442
443 * New options supported:
444 * --testlist provides a list of tests to run in a file
445 * --stoponerror indicates that the run should terminate when any test fails.
446
447 Issues Resolved
448
449 * 20 TestCaseAttribute needs Platform property.
450 * 60 NUnit should support async setup, teardown, fixture setup and fixture teardown.
451 * 257 TestCaseAttribute should not require parameters with default values to be specified.
452 * 266 Pluggable framework drivers.
453 * 368 Create addin model.
454 * 369 Project loader addins
455 * 370 OutputWriter addins
456 * 403 Move ConsoleOptions.cs and Options.cs to Common and share...
457 * 419 Create Windows Installer for NUnit.
458 * 427 [TestFixture(Ignore=true)] should not be allowed.
459 * 437 Errors in tests under Linux due to hard-coded paths.
460 * 441 NUnit-Console should support --testlist option
461 * 442 Add --stoponerror option back to nunit-console.
462 * 456 Fix memory leak in RuntimeFramework.
463 * 459 Remove the Mixed Platforms build configuration.
464 * 468 Change default domain usage to multiple.
465 * 469 Truncate string arguments in test names in order to limit the length.
466
467 NUnit 3.0.0 Alpha 4 - December 30, 2014
468
469 Framework
470
471 * ApartmentAttribute has been added, replacing STAAttribute and MTAAttribute.
472 * Unnecessary overloads of Assert.That and Assume.That have been removed.
473 * Multiple SetUpFixtures may be specified in a single namespace.
474 * Improvements to the Pairwise strategy test case generation algorithm.
475 * The new NUnitLite runner --testlist option, allows a list of tests to be kept in a file.
476
477 Engine
478
479 * A driver is now included, which allows running NUnit 2.x tests under NUnit 3.0.
480 * The engine can now load and run tests specified in a number of project formats:
481 * NUnit (.nunit)
482 * Visual Studio C# projects (.csproj)
483 * Visual Studio F# projects (.vjsproj)
484 * Visual Studio Visual Basic projects (.vbproj)
485 * Visual Studio solutions (.sln)
486 * Legacy C++ and Visual JScript projects (.csproj and .vjsproj) are also supported
487 * Support for the current C++ format (.csxproj) is not yet available
488 * Creation of output files like TestResult.xml in various formats is now a
489 service of the engine, available to any runner.
490
491 Console
492
493 * The command-line may now include any number of assemblies and/or supported projects.
494
495 Issues Resolved
496
497 * 37 Multiple SetUpFixtures should be permitted on same namespace
498 * 210 TestContext.WriteLine in an AppDomain causes an error
499 * 227 Add support for VS projects and solutions
500 * 231 Update C# samples to use NUnit 3.0
501 * 233 Update F# samples to use NUnit 3.0
502 * 234 Update C++ samples to use NUnit 3.0
503 * 265 Reorganize console reports for nunit-console and nunitlite
504 * 299 No full path to assembly in XML file under Compact Framework
505 * 301 Command-line length
506 * 363 Make Xml result output an engine service
507 * 377 CombiningStrategyAttributes don't work correctly on generic methods
508 * 388 Improvements to NUnitLite runner output
509 * 390 Specify exactly what happens when a test times out
510 * 396 ApartmentAttribute
511 * 397 CF nunitlite runner assembly has the wrong name
512 * 407 Assert.Pass() with ]]> in message crashes console runner
513 * 414 Simplify Assert overloads
514 * 416 NUnit 2.x Framework Driver
515 * 417 Complete work on NUnit projects
516 * 420 Create Settings file in proper location
517
518 NUnit 3.0.0 Alpha 3 - November 29, 2014
519
520 Breaking Changes
521
522 * NUnitLite tests must reference both the nunit.framework and nunitlite assemblies.
523
524 Framework
525
526 * The NUnit and NUnitLite frameworks have now been merged. There is no longer any distinction
527 between them in terms of features, although some features are not available on all platforms.
528 * The release includes two new framework builds: compact framework 3.5 and portable. The portable
529 library is compatible with .NET 4.5, Silverlight 5.0, Windows 8, Windows Phone 8.1,
530 Windows Phone Silverlight 8, Mono for Android and MonoTouch.
531 * A number of previously unsupported features are available for the Compact Framework:
532 - Generic methods as tests
533 - RegexConstraint
534 - TimeoutAttribute
535 - FileAssert, DirectoryAssert and file-related constraints
536
537 Engine
538
539 * The logic of runtime selection has now changed so that each assembly runs by default
540 in a separate process using the runtime for which it was built.
541 * On 64-bit systems, each test process is automatically created as 32-bit or 64-bit,
542 depending on the platform specified for the test assembly.
543
544 Console
545
546 * The console runner now runs tests in a separate process per assembly by default. They may
547 still be run in process or in a single separate process by use of command-line options.
548 * The console runner now starts in the highest version of the .NET runtime available, making
549 it simpler to debug tests by specifying that they should run in-process on the command-line.
550 * The -x86 command-line option is provided to force execution in a 32-bit process on a 64-bit system.
551 * A writeability check is performed for each output result file before trying to run the tests.
552 * The -teamcity option is now supported.
553
554 Issues Resolved
555
556 * 12 Compact framework should support generic methods
557 * 145 NUnit-console fails if test result message contains invalid xml characters
558 * 155 Create utility classes for platform-specific code
559 * 223 Common code for NUnitLite console runner and NUnit-Console
560 * 225 Compact Framework Support
561 * 238 Improvements to running 32 bit tests on a 64 bit system
562 * 261 Add portable nunitlite build
563 * 284 NUnitLite Unification
564 * 293 CF does not have a CurrentDirectory
565 * 306 Assure NUnit can write resultfile
566 * 308 Early disposal of runners
567 * 309 NUnit-Console should support incremental output under TeamCity
568 * 325 Add RegexConstraint to compact framework build
569 * 326 Add TimeoutAttribute to compact framework build
570 * 327 Allow generic test methods in the compact framework
571 * 328 Use .NET Stopwatch class for compact framework builds
572 * 331 Alpha 2 CF does not build
573 * 333 Add parallel execution to desktop builds of NUnitLite
574 * 334 Include File-related constraints and syntax in NUnitLite builds
575 * 335 Re-introduce 'Classic' NUnit syntax in NUnitLite
576 * 336 Document use of separate obj directories per build in our projects
577 * 337 Update Standard Defines page for .NET 3.0
578 * 341 Move the NUnitLite runners to separate assemblies
579 * 367 Refactor XML Escaping Tests
580 * 372 CF Build TestAssemblyRunnerTests
581 * 373 Minor CF Test Fixes
582 * 378 Correct documentation for PairwiseAttribute
583 * 386 Console Output Improvements
584
585 NUnit 3.0.0 Alpha 2 - November 2, 2014
586
587 Breaking Changes
588
589 * The console runner no longer displays test results in the debugger.
590 * The NUnitLite compact framework 2.0 build has been removed.
591 * All addin support has been removed from the framework. Documentation of NUnit 3.0 extensibility features will be published in time for the beta release. In the interim, please ask for support on the nunit-discuss list.
592
593 General
594
595 * A separate solution has been created for Linux
596 * We now have continuous integration builds under both Travis and Appveyor
597 * The compact framework 3.5 build is now working and will be supported in future releases.
598
599 New Features
600
601 * The console runner now automatically detects 32- versus 64-bit test assemblies.
602 * The NUnitLite report output has been standardized to match that of nunit-console.
603 * The NUnitLite command-line has been standardized to match that of nunit-console where they share the same options.
604 * Both nunit-console and NUnitLite now display output in color.
605 * ActionAttributes now allow specification of multiple targets on the attribute as designed. This didn't work in the first alpha.
606 * OneTimeSetUp and OneTimeTearDown failures are now shown on the test report. Individual test failures after OneTimeSetUp failure are no longer shown.
607 * The console runner refuses to run tests build with older versions of NUnit. A plugin will be available to run older tests in the future.
608
609 Issues Resolved
610
611 * 222 Color console for NUnitLite
612 * 229 Timing failures in tests
613 * 241 Remove reference to Microslft BCL packages
614 * 243 Create solution for Linux
615 * 245 Multiple targets on action attributes not implemented
616 * 246 C++ tests do not compile in VS2013
617 * 247 Eliminate trace display when running tests in debug
618 * 255 Add new result states for more precision in where failures occur
619 * 256 ContainsConstraint break when used with AndConstraint
620 * 264 Stacktrace displays too many entries
621 * 269 Add manifest to nunit-console and nunit-agent
622 * 270 OneTimeSetUp failure results in too much output
623 * 271 Invalid tests should be treated as errors
624 * 274 Command line options should be case insensitive
625 * 276 NUnit-console should not reference nunit.framework
626 * 278 New result states (ChildFailure and SetupFailure) break NUnit2XmlOutputWriter
627 * 282 Get tests for NUnit2XmlOutputWriter working
628 * 288 Set up Appveyor CI build
629 * 290 Stack trace still displays too many items
630 * 315 NUnit 3.0 alpha: Cannot run in console on my assembly
631 * 319 CI builds are not treating test failures as failures of the build
632 * 322 Remove Stopwatch tests where they test the real .NET Stopwatch
633
634 NUnit 3.0.0 Alpha 1 - September 22, 2014
635
636 Breaking Changes
637
638 * Legacy suites are no longer supported
639 * Assert.NullOrEmpty is no longer supported (Use Is.Null.Or.Empty)
640
641 General
642
643 * MsBuild is now used for the build rather than NAnt
644 * The framework test harness has been removed now that nunit-console is at a point where it can run the tests.
645
646 New Features
647
648 * Action Attributes have been added with the same features as in NUnit 2.6.3.
649 * TestContext now has a method that allows writing to the XML output.
650 * TestContext.CurrentContext.Result now provides the error message and stack trace during teardown.
651 * Does prefix operator supplies several added constraints.
652
653 Issues Resolved
654
655 * 6 Log4net not working with NUnit
656 * 13 Standardize commandline options for nunitlite runner
657 * 17 No allowance is currently made for nullable arguents in TestCase parameter conversions
658 * 33 TestCaseSource cannot refer to a parameterized test fixture
659 * 54 Store message and stack trace in TestContext for use in TearDown
660 * 111 Implement Changes to File, Directory and Path Assertions
661 * 112 Implement Action Attributes
662 * 156 Accessing multiple AppDomains within unit tests result in SerializationException
663 * 163 Add --trace option to NUnitLite
664 * 167 Create interim documentation for the alpha release
665 * 169 Design and implement distribution of NUnit packages
666 * 171 Assert.That should work with any lambda returning bool
667 * 175 Test Harness should return an error if any tests fail
668 * 180 Errors in Linux CI build
669 * 181 Replace NAnt with MsBuild / XBuild
670 * 183 Standardize commandline options for test harness
671 * 188 No output from NUnitLite when selected test is not found
672 * 189 Add string operators to Does prefix
673 * 193 TestWorkerTests.BusyExecutedIdleEventsCalledInSequence fails occasionally
674 * 197 Deprecate or remove Assert.NullOrEmpty
675 * 202 Eliminate legacy suites
676 * 203 Combine framework, engine and console runner in a single solution and repository
677 * 209 Make Ignore attribute's reason mandatory
678 * 215 Running 32-bit tests on a 64-bit OS
679 * 219 Teardown failures are not reported
680
681 Console Issues Resolved (Old nunit-console project, now combined with nunit)
682
683 * 2 Failure in TestFixtureSetUp is not reported correctly
684 * 5 CI Server for nunit-console
685 * 6 System.NullReferenceException on start nunit-console-x86
686 * 21 NUnitFrameworkDriverTests fail if not run from same directory
687 * 24 'Debug' value for /trace option is deprecated in 2.6.3
688 * 38 Confusing Excluded categories output
689
690 NUnit 2.9.7 - August 8, 2014
691
692 Breaking Changes
693
694 * NUnit no longer supports void async test methods. You should use a Task return Type instead.
695 * The ExpectedExceptionAttribute is no longer supported. Use Assert.Throws() or Assert.That(..., Throws) instead for a more precise specification of where the exception is expected to be thrown.
696
697 New Features
698
699 * Parallel test execution is supported down to the Fixture level. Use ParallelizableAttribute to indicate types that may be run in parallel.
700 * Async tests are supported for .NET 4.0 if the user has installed support for them.
701 * A new FileExistsConstraint has been added along with FileAssert.Exists and FileAssert.DoesNotExist
702 * ExpectedResult is now supported on simple (non-TestCase) tests.
703 * The Ignore attribute now takes a named parameter Until, which allows specifying a date after which the test is no longer ignored.
704 * The following new values are now recognized by PlatformAttribute: Win7, Win8, Win8.1, Win2012Server, Win2012ServerR2, NT6.1, NT6.2, 32-bit, 64-bit
705 * TimeoutAttribute is now supported under Silverlight
706 * ValuesAttribute may be used without any values on an enum or boolean argument. All possible values are used.
707 * You may now specify a tolerance using Within when testing equality of DateTimeOffset values.
708 * The XML output now includes a start and end time for each test.
709
710 Issues Resolved
711
712 * 8 [SetUpFixture] is not working as expected
713 * 14 CI Server for NUnit Framework
714 * 21 Is.InRange Constraint Ambiguity
715 * 27 Values attribute support for enum types
716 * 29 Specifying a tolerance with "Within" doesn't work for DateTimeOffset data types
717 * 31 Report start and end time of test execution
718 * 36 Make RequiresThread, RequiresSTA, RequiresMTA inheritable
719 * 45 Need of Enddate together with Ignore
720 * 55 Incorrect XML comments for CollectionAssert.IsSubsetOf
721 * 62 Matches(Constraint) does not work as expected
722 * 63 Async support should handle Task return type without state machine
723 * 64 AsyncStateMachineAttribute should only be checked by name
724 * 65 Update NUnit Wiki to show the new location of samples
725 * 66 Parallel Test Execution within test assemblies
726 * 67 Allow Expected Result on simple tests
727 * 70 EquivalentTo isn't compatible with IgnoreCase for dictioneries
728 * 75 Async tests should be supported for projects that target .NET 4.0
729 * 82 nunit-framework tests are timing out on Linux
730 * 83 Path-related tests fail on Linux
731 * 85 Culture-dependent NUnit tests fail on non-English machine
732 * 88 TestCaseSourceAttribute documentation
733 * 90 EquivalentTo isn't compatible with IgnoreCase for char
734 * 100 Changes to Tolerance definitions
735 * 110 Add new platforms to PlatformAttribute
736 * 113 Remove ExpectedException
737 * 118 Workarounds for missing InternalPreserveStackTrace in mono
738 * 121 Test harness does not honor the --worker option when set to zero
739 * 129 Standardize Timeout in the Silverlight build
740 * 130 Add FileAssert.Exists and FileAssert.DoesNotExist
741 * 132 Drop support for void async methods
742 * 153 Surprising behavior of DelayedConstraint pollingInterval
743 * 161 Update API to support stopping an ongoing test run
744
745 NOTE: Bug Fixes below this point refer to the number of the bug in Launchpad.
746
747 NUnit 2.9.6 - October 4, 2013
748
749 Main Features
750
751 * Separate projects for nunit-console and nunit.engine
752 * New builds for .NET 4.5 and Silverlight
753 * TestContext is now supported
754 * External API is now stable; internal interfaces are separate from API
755 * Tests may be run in parallel on separate threads
756 * Solutions and projects now use VS2012 (except for Compact framework)
757
758 Bug Fixes
759
760 * 463470 We should encapsulate references to pre-2.0 collections
761 * 498690 Assert.That() doesn't like properties with scoped setters
762 * 501784 Theory tests do not work correctly when using null parameters
763 * 531873 Feature: Extraction of unit tests from NUnit test assembly and calling appropriate one
764 * 611325 Allow Teardown to detect if last test failed
765 * 611938 Generic Test Instances disappear
766 * 655882 Make CategoryAttribute inherited
767 * 664081 Add Server2008 R2 and Windows 7 to PlatformAttribute
768 * 671432 Upgrade NAnt to Latest Release
769 * 676560 Assert.AreEqual does not support IEquatable<T>
770 * 691129 Add Category parameter to TestFixture
771 * 697069 Feature request: dynamic location for TestResult.xml
772 * 708173 NUnit's logic for comparing arrays - use Comparer<T[]> if it is provided
773 * 709062 "System.ArgumentException : Cannot compare" when the element is a list
774 * 712156 Tests cannot use AppDomain.SetPrincipalPolicy
775 * 719184 Platformdependency in src/ClientUtilities/util/Services/DomainManager.cs:40
776 * 719187 Using Path.GetTempPath() causes conflicts in shared temporary folders
777 * 735851 Add detection of 3.0, 3.5 and 4.0 frameworks to PlatformAttribute
778 * 736062 Deadlock when EventListener performs a Trace call + EventPump synchronisation
779 * 756843 Failing assertion does not show non-linear tolerance mode
780 * 766749 net-2.0\nunit-console-x86.exe.config should have a <startup /> element and also enable loadFromRemoteSources
781 * 770471 Assert.IsEmpty does not support IEnumerable
782 * 785460 Add Category parameter to TestCaseSourceAttribute
783 * 787106 EqualConstraint provides inadequate failure information for IEnumerables
784 * 792466 TestContext MethodName
785 * 794115 HashSet incorrectly reported
786 * 800089 Assert.Throws() hides details of inner AssertionException
787 * 848713 Feature request: Add switch for console to break on any test case error
788 * 878376 Add 'Exactly(n)' to the NUnit constraint syntax
789 * 882137 When no tests are run, higher level suites display as Inconclusive
790 * 882517 NUnit 2.5.10 doesn't recognize TestFixture if there are only TestCaseSource inside
791 * 885173 Tests are still executed after cancellation by user
792 * 885277 Exception when project calls for a runtime using only 2 digits
793 * 885604 Feature request: Explicit named parameter to TestCaseAttribute
794 * 890129 DelayedConstraint doesn't appear to poll properties of objects
795 * 892844 Not using Mono 4.0 profile under Windows
796 * 893919 DelayedConstraint fails polling properties on references which are initially null
797 * 896973 Console output lines are run together under Linux
798 * 897289 Is.Empty constraint has unclear failure message
799 * 898192 Feature Request: Is.Negative, Is.Positive
800 * 898256 IEnumerable<T> for Datapoints doesn't work
801 * 899178 Wrong failure message for parameterized tests that expect exceptions
802 * 904841 After exiting for timeout the teardown method is not executed
803 * 908829 TestCase attribute does not play well with variadic test functions
804 * 910218 NUnit should add a trailing separator to the ApplicationBase
805 * 920472 CollectionAssert.IsNotEmpty must dispose Enumerator
806 * 922455 Add Support for Windows 8 and Windows 2012 Server to PlatformAttribute
807 * 928246 Use assembly.Location instead of assembly.CodeBase
808 * 958766 For development work under TeamCity, we need to support nunit2 formatted output under direct-runner
809 * 1000181 Parameterized TestFixture with System.Type as constructor arguments fails
810 * 1000213 Inconclusive message Not in report output
811 * 1023084 Add Enum support to RandomAttribute
812 * 1028188 Add Support for Silverlight
813 * 1029785 Test loaded from remote folder failed to run with exception System.IODirectory
814 * 1037144 Add MonoTouch support to PlatformAttribute
815 * 1041365 Add MaxOsX and Xbox support to platform attribute
816 * 1057981 C#5 async tests are not supported
817 * 1060631 Add .NET 4.5 build
818 * 1064014 Simple async tests should not return Task<T>
819 * 1071164 Support async methods in usage scenarios of Throws constraints
820 * 1071343 Runner.Load fails on CF if the test assembly contains a generic method
821 * 1071861 Error in Path Constraints
822 * 1072379 Report test execution time at a higher resolution
823 * 1074568 Assert/Assume should support an async method for the ActualValueDelegate
824 * 1082330 Better Exception if SetCulture attribute is applied multiple times
825 * 1111834 Expose Random Object as part of the test context
826 * 1111838 Include Random Seed in Test Report
827 * 1172979 Add Category Support to nunitlite Runner
828 * 1203361 Randomizer uniqueness tests sometimes fail
829 * 1221712 When non-existing test method is specified in -test, result is still "Tests run: 1, Passed: 1"
830 * 1223294 System.NullReferenceException thrown when ExpectedExceptionAttribute is used in a static class
831 * 1225542 Standardize commandline options for test harness
832
833 Bug Fixes in 2.9.6 But Not Listed Here in the Release
834
835 * 541699 Silverlight Support
836 * 1222148 /framework switch does not recognize net-4.5
837 * 1228979 Theories with all test cases inconclusive are not reported as failures
838
839
840 NUnit 2.9.5 - July 30, 2010
841
842 Bug Fixes
843
844 * 483836 Allow non-public test fixtures consistently
845 * 487878 Tests in generic class without proper TestFixture attribute should be invalid
846 * 498656 TestCase should show array values in GUI
847 * 513989 Is.Empty should work for directories
848 * 519912 Thread.CurrentPrincipal Set In TestFixtureSetUp Not Maintained Between Tests
849 * 532488 constraints from ConstraintExpression/ConstraintBuilder are not reusable
850 * 590717 categorie contains dash or trail spaces is not selectable
851 * 590970 static TestFixtureSetUp/TestFixtureTearDown methods in base classes are not run
852 * 595683 NUnit console runner fails to load assemblies
853 * 600627 Assertion message formatted poorly by PropertyConstraint
854 * 601108 Duplicate test using abstract test fixtures
855 * 601645 Parametered test should try to convert data type from source to parameter
856 * 605432 ToString not working properly for some properties
857 * 606548 Deprecate Directory Assert in 2.5 and remove it in 3.0
858 * 608875 NUnit Equality Comparer incorrectly defines equality for Dictionary objects
859
860 NUnit 2.9.4 - May 4, 2010
861
862 Bug Fixes
863
864 * 419411 Fixture With No Tests Shows as Non-Runnable
865 * 459219 Changes to thread princpal cause failures under .NET 4.0
866 * 459224 Culture test failure under .NET 4.0
867 * 462019 Line endings needs to be better controlled in source
868 * 462418 Assume.That() fails if I specify a message
869 * 483845 TestCase expected return value cannot be null
870 * 488002 Should not report tests in abstract class as invalid
871 * 490679 Category in TestCaseData clashes with Category on ParameterizedMethodSuite
872 * 501352 VS2010 projects have not been updated for new directory structure
873 * 504018 Automatic Values For Theory Test Parameters Not Provided For bool And enum
874 * 505899 'Description' parameter in both TestAttribute and TestCaseAttribute is not allowed
875 * 523335 TestFixtureTearDown in static class not executed
876 * 556971 Datapoint(s)Attribute should work on IEnumerable<T> as well as on Arrays
877 * 561436 SetCulture broken with 2.5.4
878 * 563532 DatapointsAttribute should be allowed on properties and methods
879
880 NUnit 2.9.3 - October 26, 2009
881
882 Main Features
883
884 * Created new API for controlling framework
885 * New builds for .Net 3.5 and 4.0, compact framework 3.5
886 * Support for old style tests has been removed
887 * New adhoc runner for testing the framework
888
889 Bug Fixes
890
891 * 432805 Some Framework Tests don't run on Linux
892 * 440109 Full Framework does not support "Contains"
893
894 NUnit 2.9.2 - September 19, 2009
895
896 Main Features
897
898 * NUnitLite code is now merged with NUnit
899 * Added NUnitLite runner to the framework code
900 * Added Compact framework builds
901
902 Bug Fixes
903
904 * 430100 Assert.Catch<T> should return T
905 * 432566 NUnitLite shows empty string as argument
906 * 432573 Mono test should be at runtime
907
908 NUnit 2.9.1 - August 27, 2009
909
910 General
911
912 * Created a separate project for the framework and framework tests
913 * Changed license to MIT / X11
914 * Created Windows installer for the framework
915
916 Bug Fixes
917
918 * 400502 NUnitEqualityComparer.StreamsE­qual fails for same stream
919 * 400508 TestCaseSource attirbute is not working when Type is given
920 * 400510 TestCaseData variable length ctor drops values
921 * 417557 Add SetUICultureAttribute from NUnit 2.5.2
922 * 417559 Add Ignore to TestFixture, TestCase and TestCaseData
923 * 417560 Merge Assert.Throws and Assert.Catch changes from NUnit 2.5.2
924 * 417564 TimeoutAttribute on Assembly