Skip to content

Run tests / Added AggressiveOptimization to methods involved in measuring allocations. Warm up allocation measurement before taking actual measurement. Isolated allocation measurement. Changed some RuntimeInformation properties to static readonly fields. Removed enable monitoring in Engine (GcStats handles it). Removed GC.Collect() from allocation measurement. Sleep thread to account for tiered jit in Core runtimes 3.0 to 6.0. Updated MemoryDiagnoserTests. Block finalizer thread during memory te... #963

Run tests / Added AggressiveOptimization to methods involved in measuring allocations. Warm up allocation measurement before taking actual measurement. Isolated allocation measurement. Changed some RuntimeInformation properties to static readonly fields. Removed enable monitoring in Engine (GcStats handles it). Removed GC.Collect() from allocation measurement. Sleep thread to account for tiered jit in Core runtimes 3.0 to 6.0. Updated MemoryDiagnoserTests. Block finalizer thread during memory te...

Run tests / Added AggressiveOptimization to methods involved in measuring allocations. Warm up allocation measurement before taking actual measurement. Isolated allocation measurement. Changed some RuntimeInformation properties to static readonly fields. Removed enable monitoring in Engine (GcStats handles it). Removed GC.Collect() from allocation measurement. Sleep thread to account for tiered jit in Core runtimes 3.0 to 6.0. Updated MemoryDiagnoserTests. Block finalizer thread during memory te... #963

GitHub Actions / report succeeded Sep 22, 2024 in 1s

report ✅

Tests passed successfully

Report Passed Failed Skipped Time
test-linux-trx/TestResults/linux-exporters-net8.0.trx 51✅ 6s 838ms
test-linux-trx/TestResults/linux-integration-net8.0.trx 219✅ 14⚪ 26m 27s 928ms
test-linux-trx/TestResults/linux-unit-net8.0.trx 836✅ 8⚪ 3s 985ms
test-macos-trx/TestResults/macos-exporters-net8.0.trx 51✅ 6s 792ms
test-macos-trx/TestResults/macos-integration-net8.0.trx 221✅ 14⚪ 27m 58s 212ms
test-macos-trx/TestResults/macos-unit-net8.0.trx 836✅ 8⚪ 4s 560ms
test-windows-core-trx/TestResults/windows-integration-net8.0.trx 228✅ 6⚪ 25m 24s 986ms
test-windows-full-trx/TestResults/windows-integration-net462.trx 256✅ 11⚪ 21m 22s 111ms

✅ test-linux-trx/TestResults/linux-exporters-net8.0.trx

51 tests were completed in 6s 838ms with 51 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
BenchmarkDotNet.Exporters.Plotting.Tests.ScottPlotExporterTests 51✅ 6s 235ms

✅ test-linux-trx/TestResults/linux-integration-net8.0.trx

233 tests were completed in 26m 27s 928ms with 219 passed, 0 failed and 14 skipped.

Test suite Passed Failed Skipped Time
BenchmarkDotNet.IntegrationTests.MemoryDiagnoserTests 10✅ 1⚪ 3m 44s 665ms
BenchmarkDotNet.IntegrationTests.ArgumentsTests 55✅ 3m 17s 257ms
BenchmarkDotNet.IntegrationTests.ThreadingDiagnoserTests 4✅ 2m 21s 335ms
BenchmarkDotNet.IntegrationTests.BenchmarkSwitcherTest 21✅ 1m 48s 286ms
BenchmarkDotNet.IntegrationTests.WasmTests 1✅ 1m 21s 450ms
BenchmarkDotNet.IntegrationTests.ExceptionHandlingTests 17✅ 1m 15s 477ms
BenchmarkDotNet.IntegrationTests.ParamsTests 11✅ 1m 14s 764ms
BenchmarkDotNet.IntegrationTests.NativeAotTests 1✅ 51s 595ms
BenchmarkDotNet.IntegrationTests.NuGetReferenceTests 1✅ 1⚪ 48s 741ms
BenchmarkDotNet.IntegrationTests.AllSetupAndCleanupTest 7✅ 48s 268ms
BenchmarkDotNet.IntegrationTests.MonoTests 1✅ 43s 316ms
BenchmarkDotNet.IntegrationTests.ParamSourceTests 11✅ 42s 964ms
BenchmarkDotNet.IntegrationTests.CustomBuildConfigurationTests 1✅ 41s 131ms
BenchmarkDotNet.IntegrationTests.GcModeTests 6✅ 40s 073ms
BenchmarkDotNet.IntegrationTests.DotMemoryTests 1✅ 39s 123ms
BenchmarkDotNet.IntegrationTests.RunStrategyTests 1✅ 38s 739ms
BenchmarkDotNet.IntegrationTests.DisassemblyDiagnoserTests 4✅ 28s 497ms
BenchmarkDotNet.IntegrationTests.EventProcessorTests 6✅ 20s 952ms
BenchmarkDotNet.IntegrationTests.EnvironmentVariablesTests 3✅ 20s 458ms
BenchmarkDotNet.IntegrationTests.DotTraceTests 1✅ 18s 058ms
BenchmarkDotNet.IntegrationTests.AsyncBenchmarksTests 2✅ 16s 314ms
BenchmarkDotNet.IntegrationTests.ExceptionDiagnoserTests 1✅ 15s 184ms
BenchmarkDotNet.IntegrationTests.DryRunTests 2✅ 13s 872ms
BenchmarkDotNet.IntegrationTests.StandardErrorTests 2✅ 13s 286ms
BenchmarkDotNet.IntegrationTests.ProcessorArchitectureTest 2✅ 13s 195ms
BenchmarkDotNet.IntegrationTests.ValuesReturnedByBenchmarkTest 2✅ 10s 937ms
BenchmarkDotNet.IntegrationTests.ReferencesTests 2✅ 10s 046ms
BenchmarkDotNet.IntegrationTests.PriorityTests 1✅ 7s 900ms
BenchmarkDotNet.IntegrationTests.BaselineRatioColumnWithLongParamsTest 1✅ 7s 348ms
BenchmarkDotNet.IntegrationTests.StatResultExtenderTests 1✅ 7s 287ms
BenchmarkDotNet.IntegrationTests.EngineTests 3✅ 7s 156ms
BenchmarkDotNet.IntegrationTests.BaselineRatioColumnTest 1✅ 7s 114ms
BenchmarkDotNet.IntegrationTests.BaselineRatioResultExtenderNoBaselineTest 1✅ 7s 010ms
BenchmarkDotNet.IntegrationTests.AppConfigTests 1✅ 6s 888ms
BenchmarkDotNet.IntegrationTests.LanguageVersionTests 1✅ 6s 824ms
BenchmarkDotNet.IntegrationTests.ToolchainTest 1✅ 6s 806ms
BenchmarkDotNet.IntegrationTests.JitRuntimeValidationTest 3✅ 1⚪ 6s 805ms
BenchmarkDotNet.IntegrationTests.AttributesTests 1✅ 6s 801ms
BenchmarkDotNet.IntegrationTests.SetupAndCleanupTests 1✅ 6s 782ms
BenchmarkDotNet.IntegrationTests.FailingProcessSpawnTests 1✅ 6s 781ms
BenchmarkDotNet.IntegrationTests.CustomEngineTests 1✅ 6s 711ms
BenchmarkDotNet.IntegrationTests.AssemblyConfigTests 1✅ 4s 708ms
BenchmarkDotNet.IntegrationTests.FSharpTests 1✅ 4s 705ms
BenchmarkDotNet.IntegrationTests.BuildTimeoutTests 1✅ 1s 102ms
BenchmarkDotNet.IntegrationTests.InProcessEmitTest 2✅ 1⚪ 205ms
BenchmarkDotNet.IntegrationTests.InProcessTest 10✅ 157ms
BenchmarkDotNet.IntegrationTests.ValidatorsTest 2✅ 19ms
BenchmarkDotNet.IntegrationTests.ExporterIOTests 3✅ 1⚪ 4ms
BenchmarkDotNet.IntegrationTests.BaselineRatioResultExtenderErrorTest 1✅ 3ms
BenchmarkDotNet.IntegrationTests.JitOptimizationsTests 2✅ 3ms
BenchmarkDotNet.IntegrationTests.PowerManagementApplierTests 2⚪ 2ms
BenchmarkDotNet.IntegrationTests.ProcessPropertiesTests 2⚪ 2ms
BenchmarkDotNet.IntegrationTests.ExtraAttributesForEntryMethodTests 1⚪ 1ms
BenchmarkDotNet.IntegrationTests.LargeAddressAwareTest 1⚪ 1ms
BenchmarkDotNet.IntegrationTests.MultipleRuntimesTest 1⚪ 1ms
BenchmarkDotNet.IntegrationTests.PathTooLongTests 1⚪ 1ms
BenchmarkDotNet.IntegrationTests.RoslynToolchainTest 1⚪ 1ms
BenchmarkDotNet.IntegrationTests.GlobalSetupAttributeInvalidMethodTest 1✅ 1ms
BenchmarkDotNet.IntegrationTests.IntegrationTestSetupTests 1✅ 1ms

✅ test-linux-trx/TestResults/linux-unit-net8.0.trx

844 tests were completed in 3s 985ms with 836 passed, 0 failed and 8 skipped.

Test suite Passed Failed Skipped Time
BenchmarkDotNet.Tests.Engine.EngineFactoryTests 11✅ 3s 052ms
BenchmarkDotNet.Tests.Exporters.MarkdownExporterVerifyTests 17✅ 1s 063ms
BenchmarkDotNet.Tests.Validators.ExecutionValidatorTests 26✅ 918ms
BenchmarkDotNet.Tests.Exporters.CommonExporterVerifyTests 3✅ 763ms
BenchmarkDotNet.Tests.Phd.PhdTests 14✅ 630ms
BenchmarkDotNet.Tests.ConfigParserTests 81✅ 3⚪ 337ms
BenchmarkDotNet.Tests.Columns.RatioColumnTest 1✅ 292ms
BenchmarkDotNet.Tests.Reports.DefaultColumnProvidersTests 3✅ 96ms
BenchmarkDotNet.Tests.Configs.CategoriesTests 3✅ 90ms
BenchmarkDotNet.Tests.Analysers.OutliersAnalyserTests 25✅ 89ms
BenchmarkDotNet.Tests.ParamsSourceTests 1✅ 87ms
BenchmarkDotNet.Tests.Order.DefaultOrdererTests 2✅ 82ms
BenchmarkDotNet.Tests.TypeFilterTests 16✅ 36ms
BenchmarkDotNet.Tests.Engine.EngineResultStageTests 1✅ 36ms
BenchmarkDotNet.Tests.Columns.StatisticalTestColumnTests 5✅ 30ms
BenchmarkDotNet.Tests.Configs.JobTests 13✅ 29ms
BenchmarkDotNet.Tests.AppConfigGeneratorTests 8✅ 1⚪ 27ms
BenchmarkDotNet.Tests.GenericBuilderTests 6✅ 27ms
BenchmarkDotNet.Tests.CsProjGeneratorTests 10✅ 25ms
BenchmarkDotNet.Tests.Reports.SummaryTableTests 10✅ 25ms
BenchmarkDotNet.Tests.CorrectionsSuggesterTests 10✅ 25ms
BenchmarkDotNet.Tests.Attributes.MutatorAttributesTests 1✅ 25ms
BenchmarkDotNet.Tests.Validators.ReturnValueValidatorTests 15✅ 24ms
BenchmarkDotNet.Tests.ReflectionTests 8✅ 24ms
BenchmarkDotNet.Tests.Configs.ImmutableConfigTests 27✅ 2⚪ 23ms
BenchmarkDotNet.Tests.StringExtensionsTests 19✅ 23ms
BenchmarkDotNet.Tests.Validators.ParamsValidatorTests 32✅ 22ms
BenchmarkDotNet.Tests.FullNameProviderTests 20✅ 19ms
BenchmarkDotNet.Tests.Attributes.ParamsAllValuesVerifyTests 7✅ 19ms
BenchmarkDotNet.Tests.MonoDisassemblyOutputParserTests 4✅ 18ms
BenchmarkDotNet.Tests.Running.JobRuntimePropertiesComparerTests 4✅ 1⚪ 18ms
BenchmarkDotNet.Tests.BuildResultTests 4✅ 18ms
BenchmarkDotNet.Tests.Reports.SummaryTests 1✅ 18ms
BenchmarkDotNet.Tests.Exporters.XmlSerializerTests 23✅ 16ms
BenchmarkDotNet.Tests.Engine.StoppingCriteria.FixedStoppingCriteriaTests 10✅ 13ms
BenchmarkDotNet.Tests.Detectors.Cpu.WmicCpuInfoParserTests 5✅ 13ms
BenchmarkDotNet.Tests.Reports.RatioPrecisionTests 3✅ 13ms
BenchmarkDotNet.Tests.Validators.CompilationValidatorTests 14✅ 12ms
BenchmarkDotNet.Tests.GlobFilterTests 20✅ 12ms
BenchmarkDotNet.Tests.Engine.EngineActualStageTests 3✅ 11ms
BenchmarkDotNet.Tests.Running.BenchmarkConverterTests 11✅ 10ms
BenchmarkDotNet.Tests.Configs.EnvironmentVariableTests 6✅ 9ms
BenchmarkDotNet.Tests.Mathematics.StatisticsTests 9✅ 8ms
BenchmarkDotNet.Tests.CodeGeneratorTests 2✅ 8ms
BenchmarkDotNet.Tests.Configs.ConfigPerMethodTests 4✅ 8ms
BenchmarkDotNet.Tests.EventPipeProfilerTests 5✅ 8ms
BenchmarkDotNet.Tests.Analysers.ZeroMeasurementHelperTests 21✅ 7ms
BenchmarkDotNet.Tests.Reports.RatioStyleTests 2✅ 7ms
BenchmarkDotNet.Tests.Portability.HyperVTests 8✅ 7ms
BenchmarkDotNet.Tests.Validators.DeferredExecutionValidatorTests 7✅ 6ms
BenchmarkDotNet.Tests.Columns.MetricColumnTests 4✅ 6ms
BenchmarkDotNet.Tests.Engine.StoppingCriteria.AutoWarmupStoppingCriteriaTests 12✅ 6ms
BenchmarkDotNet.Tests.Detectors.Cpu.LinuxCpuInfoParserTests 11✅ 6ms
BenchmarkDotNet.Tests.Engine.EngineWarmupStageTests 6✅ 6ms
BenchmarkDotNet.Tests.Reports.DisplayPrecisionManagerTests 29✅ 5ms
BenchmarkDotNet.Tests.Validators.SetupCleanupValidatorTests 2✅ 5ms
BenchmarkDotNet.Tests.RuntimeVersionDetectionTests 25✅ 5ms
BenchmarkDotNet.Tests.ParameterInstanceTests 25✅ 4ms
BenchmarkDotNet.Tests.Helpers.LinuxOsReleaseHelperTests 14✅ 4ms
BenchmarkDotNet.Tests.Mathematics.NumeralSystemTests 3✅ 4ms
BenchmarkDotNet.Tests.ParameterComparerTests 6✅ 4ms
BenchmarkDotNet.Tests.TargetFrameworkVersionParsingTestscs 4✅ 4ms
BenchmarkDotNet.Tests.Configs.ConfigOptionsTests 10✅ 4ms
BenchmarkDotNet.Tests.Engine.EnginePilotStageTests 3✅ 4ms
BenchmarkDotNet.Tests.Mathematics.RankTests 1✅ 3ms
BenchmarkDotNet.Tests.Reports.ColumnTests 1✅ 3ms
BenchmarkDotNet.Tests.SimpleJsonTests 2✅ 3ms
BenchmarkDotNet.Tests.dotMemory.DotMemoryTests 1✅ 3ms
BenchmarkDotNet.Tests.SourceCodeHelperTests 25✅ 2ms
BenchmarkDotNet.Tests.Environments.HostEnvironmentInfoTests 4✅ 2ms
BenchmarkDotNet.Tests.Portability.VirtualBoxTests 5✅ 2ms
BenchmarkDotNet.Tests.FolderNameTests 12✅ 2ms
BenchmarkDotNet.Tests.Loggers.LoggerWithPrefixTests 11✅ 2ms
BenchmarkDotNet.Tests.Detectors.Cpu.SysctlCpuInfoParserTests 3✅ 2ms
BenchmarkDotNet.Tests.dotTrace.DotTraceTests 1✅ 1ms
BenchmarkDotNet.Tests.LevenshteinDistanceCalculatorTests 6✅ 1ms
BenchmarkDotNet.Tests.Detectors.Cpu.CpuInfoFormatterTests 1✅ 1ms
BenchmarkDotNet.Tests.LightJsonSerializerTests 2✅ 1ms
BenchmarkDotNet.Tests.ArtifactFileNameHelperTests 1⚪ 1ms
BenchmarkDotNet.Tests.BenchmarkDotNetInfoTests 4✅ 1ms
BenchmarkDotNet.Tests.SummaryStyleTests 1✅ 1ms
BenchmarkDotNet.Tests.CsvHelperTests 8✅ 1ms
BenchmarkDotNet.Tests.XUnit.EnvRequirementCheckerTests 1✅ 1ms
BenchmarkDotNet.Tests.Portability.VMwareTests 7✅ 1ms
BenchmarkDotNet.Tests.Columns.TagColumnTests 1✅ 1ms
BenchmarkDotNet.Tests.FrameworkVersionHelperTests 16✅ 1ms
BenchmarkDotNet.Tests.CharacteristicPresenterTests 3✅ 1ms
BenchmarkDotNet.Tests.Properties.BenchmarkDotNetInfoTests 5✅ 1ms

✅ test-macos-trx/TestResults/macos-exporters-net8.0.trx

51 tests were completed in 6s 792ms with 51 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
BenchmarkDotNet.Exporters.Plotting.Tests.ScottPlotExporterTests 51✅ 6s 120ms

✅ test-macos-trx/TestResults/macos-integration-net8.0.trx

235 tests were completed in 27m 58s 212ms with 221 passed, 0 failed and 14 skipped.

Test suite Passed Failed Skipped Time
BenchmarkDotNet.IntegrationTests.ArgumentsTests 55✅ 4m 16s 017ms
BenchmarkDotNet.IntegrationTests.MemoryDiagnoserTests 10✅ 1⚪ 3m 13s 897ms
BenchmarkDotNet.IntegrationTests.BenchmarkSwitcherTest 21✅ 2m 08s 240ms
BenchmarkDotNet.IntegrationTests.ParamsTests 11✅ 1m 43s 462ms
BenchmarkDotNet.IntegrationTests.WasmTests 1✅ 1m 43s 271ms
BenchmarkDotNet.IntegrationTests.ExceptionHandlingTests 17✅ 1m 37s 680ms
BenchmarkDotNet.IntegrationTests.ParamSourceTests 11✅ 1m 05s 382ms
BenchmarkDotNet.IntegrationTests.AllSetupAndCleanupTest 7✅ 1m 04s 832ms
BenchmarkDotNet.IntegrationTests.GcModeTests 6✅ 53s 264ms
BenchmarkDotNet.IntegrationTests.RunStrategyTests 1✅ 48s 822ms
BenchmarkDotNet.IntegrationTests.NuGetReferenceTests 1✅ 1⚪ 47s 377ms
BenchmarkDotNet.IntegrationTests.MonoTests 1✅ 44s 490ms
BenchmarkDotNet.IntegrationTests.CustomBuildConfigurationTests 1✅ 42s 821ms
BenchmarkDotNet.IntegrationTests.DotMemoryTests 1✅ 42s 331ms
BenchmarkDotNet.IntegrationTests.ThreadingDiagnoserTests 2✅ 34s 156ms
BenchmarkDotNet.IntegrationTests.EventProcessorTests 6✅ 29s 483ms
BenchmarkDotNet.IntegrationTests.EnvironmentVariablesTests 3✅ 26s 263ms
BenchmarkDotNet.IntegrationTests.DotTraceTests 1✅ 23s 927ms
BenchmarkDotNet.IntegrationTests.AsyncBenchmarksTests 2✅ 21s 405ms
BenchmarkDotNet.IntegrationTests.ValuesReturnedByBenchmarkTest 2✅ 19s 948ms
BenchmarkDotNet.IntegrationTests.ExceptionDiagnoserTests 1✅ 18s 468ms
BenchmarkDotNet.IntegrationTests.StandardErrorTests 2✅ 18s 227ms
BenchmarkDotNet.IntegrationTests.ProcessorArchitectureTest 2✅ 18s 112ms
BenchmarkDotNet.IntegrationTests.DryRunTests 2✅ 17s 860ms
BenchmarkDotNet.IntegrationTests.ReferencesTests 2✅ 13s 418ms
BenchmarkDotNet.IntegrationTests.PriorityTests 1✅ 11s 503ms
BenchmarkDotNet.IntegrationTests.StatResultExtenderTests 1✅ 10s 225ms
BenchmarkDotNet.IntegrationTests.EngineTests 3✅ 9s 723ms
BenchmarkDotNet.IntegrationTests.ToolchainTest 1✅ 9s 606ms
BenchmarkDotNet.IntegrationTests.BaselineRatioColumnTest 1✅ 9s 546ms
BenchmarkDotNet.IntegrationTests.AttributesTests 1✅ 9s 512ms
BenchmarkDotNet.IntegrationTests.BaselineRatioColumnWithLongParamsTest 1✅ 9s 445ms
BenchmarkDotNet.IntegrationTests.BaselineRatioResultExtenderNoBaselineTest 1✅ 9s 441ms
BenchmarkDotNet.IntegrationTests.SetupAndCleanupTests 1✅ 9s 213ms
BenchmarkDotNet.IntegrationTests.AppConfigTests 1✅ 9s 026ms
BenchmarkDotNet.IntegrationTests.LanguageVersionTests 1✅ 8s 908ms
BenchmarkDotNet.IntegrationTests.FailingProcessSpawnTests 1✅ 8s 868ms
BenchmarkDotNet.IntegrationTests.JitRuntimeValidationTest 3✅ 1⚪ 8s 744ms
BenchmarkDotNet.IntegrationTests.CustomEngineTests 1✅ 8s 612ms
BenchmarkDotNet.IntegrationTests.AssemblyConfigTests 1✅ 5s 645ms
BenchmarkDotNet.IntegrationTests.FSharpTests 1✅ 5s 643ms
BenchmarkDotNet.IntegrationTests.InProcessEmitTest 2✅ 1⚪ 241ms
BenchmarkDotNet.IntegrationTests.InProcessTest 10✅ 185ms
BenchmarkDotNet.IntegrationTests.ValidatorsTest 2✅ 30ms
BenchmarkDotNet.IntegrationTests.ExporterIOTests 3✅ 1⚪ 5ms
BenchmarkDotNet.IntegrationTests.BaselineRatioResultExtenderErrorTest 1✅ 3ms
BenchmarkDotNet.IntegrationTests.JitOptimizationsTests 2✅ 3ms
BenchmarkDotNet.IntegrationTests.PowerManagementApplierTests 2⚪ 2ms
BenchmarkDotNet.IntegrationTests.ProcessPropertiesTests 2⚪ 2ms
BenchmarkDotNet.IntegrationTests.DisassemblyDiagnoserTests 8✅ 2ms
BenchmarkDotNet.IntegrationTests.ExtraAttributesForEntryMethodTests 1⚪ 1ms
BenchmarkDotNet.IntegrationTests.LargeAddressAwareTest 1⚪ 1ms
BenchmarkDotNet.IntegrationTests.MultipleRuntimesTest 1⚪ 1ms
BenchmarkDotNet.IntegrationTests.PathTooLongTests 1⚪ 1ms
BenchmarkDotNet.IntegrationTests.RoslynToolchainTest 1⚪ 1ms
BenchmarkDotNet.IntegrationTests.NativeAotTests 1✅ 1ms
BenchmarkDotNet.IntegrationTests.GlobalSetupAttributeInvalidMethodTest 1✅ 1ms
BenchmarkDotNet.IntegrationTests.BuildTimeoutTests 1✅ 1ms
BenchmarkDotNet.IntegrationTests.IntegrationTestSetupTests 1✅ 1ms

✅ test-macos-trx/TestResults/macos-unit-net8.0.trx

844 tests were completed in 4s 560ms with 836 passed, 0 failed and 8 skipped.

Test suite Passed Failed Skipped Time
BenchmarkDotNet.Tests.Engine.EngineFactoryTests 11✅ 3s 628ms
BenchmarkDotNet.Tests.Exporters.MarkdownExporterVerifyTests 17✅ 1s 690ms
BenchmarkDotNet.Tests.Exporters.CommonExporterVerifyTests 3✅ 1s 166ms
BenchmarkDotNet.Tests.Phd.PhdTests 14✅ 1s 027ms
BenchmarkDotNet.Tests.Columns.RatioColumnTest 1✅ 994ms
BenchmarkDotNet.Tests.Validators.ExecutionValidatorTests 26✅ 867ms
BenchmarkDotNet.Tests.ConfigParserTests 81✅ 3⚪ 296ms
BenchmarkDotNet.Tests.Reports.SummaryTableTests 10✅ 232ms
BenchmarkDotNet.Tests.Reports.RatioStyleTests 2✅ 216ms
BenchmarkDotNet.Tests.Validators.ReturnValueValidatorTests 15✅ 153ms
BenchmarkDotNet.Tests.TypeFilterTests 16✅ 84ms
BenchmarkDotNet.Tests.Detectors.Cpu.LinuxCpuInfoParserTests 11✅ 61ms
BenchmarkDotNet.Tests.CsProjGeneratorTests 10✅ 54ms
BenchmarkDotNet.Tests.Configs.ConfigPerMethodTests 4✅ 49ms
BenchmarkDotNet.Tests.Configs.JobTests 13✅ 49ms
BenchmarkDotNet.Tests.CodeGeneratorTests 2✅ 48ms
BenchmarkDotNet.Tests.Analysers.OutliersAnalyserTests 25✅ 40ms
BenchmarkDotNet.Tests.Mathematics.RankTests 1✅ 31ms
BenchmarkDotNet.Tests.BuildResultTests 4✅ 28ms
BenchmarkDotNet.Tests.AppConfigGeneratorTests 8✅ 1⚪ 27ms
BenchmarkDotNet.Tests.CorrectionsSuggesterTests 10✅ 26ms
BenchmarkDotNet.Tests.Engine.EnginePilotStageTests 3✅ 24ms
BenchmarkDotNet.Tests.Configs.ImmutableConfigTests 27✅ 2⚪ 24ms
BenchmarkDotNet.Tests.Reports.SummaryTests 1✅ 23ms
BenchmarkDotNet.Tests.Validators.ParamsValidatorTests 32✅ 23ms
BenchmarkDotNet.Tests.Columns.StatisticalTestColumnTests 5✅ 20ms
BenchmarkDotNet.Tests.MonoDisassemblyOutputParserTests 4✅ 20ms
BenchmarkDotNet.Tests.Attributes.ParamsAllValuesVerifyTests 7✅ 20ms
BenchmarkDotNet.Tests.Engine.EngineActualStageTests 3✅ 20ms
BenchmarkDotNet.Tests.EventPipeProfilerTests 5✅ 18ms
BenchmarkDotNet.Tests.GlobFilterTests 20✅ 16ms
BenchmarkDotNet.Tests.FullNameProviderTests 20✅ 14ms
BenchmarkDotNet.Tests.Validators.CompilationValidatorTests 14✅ 14ms
BenchmarkDotNet.Tests.Running.JobRuntimePropertiesComparerTests 4✅ 1⚪ 13ms
BenchmarkDotNet.Tests.Validators.DeferredExecutionValidatorTests 7✅ 12ms
BenchmarkDotNet.Tests.Engine.StoppingCriteria.FixedStoppingCriteriaTests 10✅ 12ms
BenchmarkDotNet.Tests.Running.BenchmarkConverterTests 11✅ 11ms
BenchmarkDotNet.Tests.Reports.RatioPrecisionTests 3✅ 11ms
BenchmarkDotNet.Tests.Reports.DisplayPrecisionManagerTests 29✅ 11ms
BenchmarkDotNet.Tests.Reports.DefaultColumnProvidersTests 3✅ 10ms
BenchmarkDotNet.Tests.Engine.StoppingCriteria.AutoWarmupStoppingCriteriaTests 12✅ 10ms
BenchmarkDotNet.Tests.Configs.EnvironmentVariableTests 6✅ 10ms
BenchmarkDotNet.Tests.Analysers.ZeroMeasurementHelperTests 21✅ 9ms
BenchmarkDotNet.Tests.ParamsSourceTests 1✅ 8ms
BenchmarkDotNet.Tests.Mathematics.StatisticsTests 9✅ 8ms
BenchmarkDotNet.Tests.Exporters.XmlSerializerTests 23✅ 7ms
BenchmarkDotNet.Tests.ParameterInstanceTests 25✅ 7ms
BenchmarkDotNet.Tests.Attributes.MutatorAttributesTests 1✅ 6ms
BenchmarkDotNet.Tests.RuntimeVersionDetectionTests 25✅ 6ms
BenchmarkDotNet.Tests.StringExtensionsTests 19✅ 6ms
BenchmarkDotNet.Tests.ParameterComparerTests 6✅ 5ms
BenchmarkDotNet.Tests.Configs.CategoriesTests 3✅ 5ms
BenchmarkDotNet.Tests.Environments.HostEnvironmentInfoTests 4✅ 5ms
BenchmarkDotNet.Tests.CsvHelperTests 8✅ 5ms
BenchmarkDotNet.Tests.Order.DefaultOrdererTests 2✅ 4ms
BenchmarkDotNet.Tests.Configs.ConfigOptionsTests 10✅ 4ms
BenchmarkDotNet.Tests.SourceCodeHelperTests 25✅ 4ms
BenchmarkDotNet.Tests.XUnit.EnvRequirementCheckerTests 1✅ 4ms
BenchmarkDotNet.Tests.GenericBuilderTests 6✅ 4ms
BenchmarkDotNet.Tests.Columns.MetricColumnTests 4✅ 4ms
BenchmarkDotNet.Tests.LightJsonSerializerTests 2✅ 3ms
BenchmarkDotNet.Tests.ReflectionTests 8✅ 3ms
BenchmarkDotNet.Tests.Engine.EngineWarmupStageTests 6✅ 3ms
BenchmarkDotNet.Tests.BenchmarkDotNetInfoTests 4✅ 3ms
BenchmarkDotNet.Tests.Engine.EngineResultStageTests 1✅ 3ms
BenchmarkDotNet.Tests.FolderNameTests 12✅ 3ms
BenchmarkDotNet.Tests.Reports.ColumnTests 1✅ 2ms
BenchmarkDotNet.Tests.TargetFrameworkVersionParsingTestscs 4✅ 2ms
BenchmarkDotNet.Tests.Detectors.Cpu.CpuInfoFormatterTests 1✅ 2ms
BenchmarkDotNet.Tests.Detectors.Cpu.WmicCpuInfoParserTests 5✅ 2ms
BenchmarkDotNet.Tests.Portability.HyperVTests 8✅ 2ms
BenchmarkDotNet.Tests.dotMemory.DotMemoryTests 1✅ 2ms
BenchmarkDotNet.Tests.dotTrace.DotTraceTests 1✅ 2ms
BenchmarkDotNet.Tests.Helpers.LinuxOsReleaseHelperTests 14✅ 2ms
BenchmarkDotNet.Tests.Validators.SetupCleanupValidatorTests 2✅ 2ms
BenchmarkDotNet.Tests.Loggers.LoggerWithPrefixTests 11✅ 1ms
BenchmarkDotNet.Tests.Columns.TagColumnTests 1✅ 1ms
BenchmarkDotNet.Tests.ArtifactFileNameHelperTests 1⚪ 1ms
BenchmarkDotNet.Tests.CharacteristicPresenterTests 3✅ 1ms
BenchmarkDotNet.Tests.Mathematics.NumeralSystemTests 3✅ 1ms
BenchmarkDotNet.Tests.SimpleJsonTests 2✅ 1ms
BenchmarkDotNet.Tests.FrameworkVersionHelperTests 16✅ 1ms
BenchmarkDotNet.Tests.Detectors.Cpu.SysctlCpuInfoParserTests 3✅ 1ms
BenchmarkDotNet.Tests.Portability.VirtualBoxTests 5✅ 1ms
BenchmarkDotNet.Tests.LevenshteinDistanceCalculatorTests 6✅ 1ms
BenchmarkDotNet.Tests.SummaryStyleTests 1✅ 1ms
BenchmarkDotNet.Tests.Portability.VMwareTests 7✅ 1ms
BenchmarkDotNet.Tests.Properties.BenchmarkDotNetInfoTests 5✅ 1ms

✅ test-windows-core-trx/TestResults/windows-integration-net8.0.trx

234 tests were completed in 25m 24s 986ms with 228 passed, 0 failed and 6 skipped.

Test suite Passed Failed Skipped Time
BenchmarkDotNet.IntegrationTests.MemoryDiagnoserTests 10✅ 1⚪ 4m 24s 194ms
BenchmarkDotNet.IntegrationTests.ArgumentsTests 55✅ 3m 31s 332ms
BenchmarkDotNet.IntegrationTests.BenchmarkSwitcherTest 21✅ 1m 57s 512ms
BenchmarkDotNet.IntegrationTests.ExceptionHandlingTests 17✅ 1m 20s 350ms
BenchmarkDotNet.IntegrationTests.ParamsTests 11✅ 1m 19s 264ms
BenchmarkDotNet.IntegrationTests.AllSetupAndCleanupTest 7✅ 51s 384ms
BenchmarkDotNet.IntegrationTests.DotMemoryTests 1✅ 50s 742ms
BenchmarkDotNet.IntegrationTests.NuGetReferenceTests 1✅ 1⚪ 49s 254ms
BenchmarkDotNet.IntegrationTests.ParamSourceTests 11✅ 46s 582ms
BenchmarkDotNet.IntegrationTests.CustomBuildConfigurationTests 1✅ 43s 444ms
BenchmarkDotNet.IntegrationTests.GcModeTests 6✅ 42s 817ms
BenchmarkDotNet.IntegrationTests.MonoTests 1✅ 41s 656ms
BenchmarkDotNet.IntegrationTests.JitRuntimeValidationTest 7✅ 35s 696ms
BenchmarkDotNet.IntegrationTests.RunStrategyTests 1✅ 33s 923ms
BenchmarkDotNet.IntegrationTests.DisassemblyDiagnoserTests 4✅ 30s 290ms
BenchmarkDotNet.IntegrationTests.ThreadingDiagnoserTests 2✅ 29s 292ms
BenchmarkDotNet.IntegrationTests.DotTraceTests 1✅ 23s 370ms
BenchmarkDotNet.IntegrationTests.EventProcessorTests 6✅ 22s 881ms
BenchmarkDotNet.IntegrationTests.EnvironmentVariablesTests 3✅ 21s 472ms
BenchmarkDotNet.IntegrationTests.AsyncBenchmarksTests 2✅ 17s 538ms
BenchmarkDotNet.IntegrationTests.ExceptionDiagnoserTests 1✅ 16s 361ms
BenchmarkDotNet.IntegrationTests.DryRunTests 2✅ 14s 454ms
BenchmarkDotNet.IntegrationTests.ProcessPropertiesTests 2✅ 14s 415ms
BenchmarkDotNet.IntegrationTests.StandardErrorTests 2✅ 14s 266ms
BenchmarkDotNet.IntegrationTests.ProcessorArchitectureTest 2✅ 14s 265ms
BenchmarkDotNet.IntegrationTests.ValuesReturnedByBenchmarkTest 2✅ 12s 215ms
BenchmarkDotNet.IntegrationTests.ReferencesTests 2✅ 10s 027ms
BenchmarkDotNet.IntegrationTests.MultipleRuntimesTest 1✅ 8s 677ms
BenchmarkDotNet.IntegrationTests.PriorityTests 1✅ 8s 507ms
BenchmarkDotNet.IntegrationTests.LargeAddressAwareTest 1✅ 8s 465ms
BenchmarkDotNet.IntegrationTests.FailingProcessSpawnTests 1✅ 8s 070ms
BenchmarkDotNet.IntegrationTests.BaselineRatioColumnWithLongParamsTest 1✅ 7s 860ms
BenchmarkDotNet.IntegrationTests.EngineTests 3✅ 7s 825ms
BenchmarkDotNet.IntegrationTests.StatResultExtenderTests 1✅ 7s 815ms
BenchmarkDotNet.IntegrationTests.BaselineRatioColumnTest 1✅ 7s 732ms
BenchmarkDotNet.IntegrationTests.SetupAndCleanupTests 1✅ 7s 571ms
BenchmarkDotNet.IntegrationTests.CustomEngineTests 1✅ 7s 490ms
BenchmarkDotNet.IntegrationTests.BaselineRatioResultExtenderNoBaselineTest 1✅ 7s 446ms
BenchmarkDotNet.IntegrationTests.AppConfigTests 1✅ 7s 266ms
BenchmarkDotNet.IntegrationTests.AttributesTests 1✅ 7s 218ms
BenchmarkDotNet.IntegrationTests.ToolchainTest 1✅ 7s 117ms
BenchmarkDotNet.IntegrationTests.LanguageVersionTests 1✅ 7s 055ms
BenchmarkDotNet.IntegrationTests.PathTooLongTests 1✅ 7s 021ms
BenchmarkDotNet.IntegrationTests.AssemblyConfigTests 1✅ 5s 399ms
BenchmarkDotNet.IntegrationTests.FSharpTests 1✅ 4s 664ms
BenchmarkDotNet.IntegrationTests.BuildTimeoutTests 1✅ 1s 239ms
BenchmarkDotNet.IntegrationTests.InProcessEmitTest 2✅ 1⚪ 419ms
BenchmarkDotNet.IntegrationTests.InProcessTest 10✅ 241ms
BenchmarkDotNet.IntegrationTests.PowerManagementApplierTests 2✅ 34ms
BenchmarkDotNet.IntegrationTests.ValidatorsTest 2✅ 19ms
BenchmarkDotNet.IntegrationTests.ExporterIOTests 4✅ 10ms
BenchmarkDotNet.IntegrationTests.BaselineRatioResultExtenderErrorTest 1✅ 3ms
BenchmarkDotNet.IntegrationTests.JitOptimizationsTests 2✅ 2ms
BenchmarkDotNet.IntegrationTests.ExtraAttributesForEntryMethodTests 1⚪ 1ms
BenchmarkDotNet.IntegrationTests.RoslynToolchainTest 1⚪ 1ms
BenchmarkDotNet.IntegrationTests.WasmTests 1⚪ 1ms
BenchmarkDotNet.IntegrationTests.GlobalSetupAttributeInvalidMethodTest 1✅ 1ms
BenchmarkDotNet.IntegrationTests.NativeAotTests 1✅ 1ms
BenchmarkDotNet.IntegrationTests.IntegrationTestSetupTests 1✅ 1ms

✅ test-windows-full-trx/TestResults/windows-integration-net462.trx

267 tests were completed in 21m 22s 111ms with 256 passed, 0 failed and 11 skipped.

Test suite Passed Failed Skipped Time
BenchmarkDotNet.IntegrationTests.DisassemblyDiagnoserTests 12✅ 6m 43s 341ms
BenchmarkDotNet.IntegrationTests.JitRuntimeValidationTest 7✅ 2m 41s 563ms
BenchmarkDotNet.IntegrationTests.TailCallDiagnoserTests 4✅ 2m 13s 025ms
BenchmarkDotNet.IntegrationTests.MemoryDiagnoserTests 14✅ 4⚪ 1m 49s 584ms
BenchmarkDotNet.IntegrationTests.RunStrategyTests 1✅ 55s 982ms
BenchmarkDotNet.IntegrationTests.DotMemoryTests 1✅ 53s 988ms
BenchmarkDotNet.IntegrationTests.LargeAddressAwareTest 1✅ 53s 165ms
BenchmarkDotNet.IntegrationTests.MultipleRuntimesTest 1✅ 52s 949ms
BenchmarkDotNet.IntegrationTests.BenchmarkSwitcherTest 19✅ 2⚪ 41s 862ms
BenchmarkDotNet.IntegrationTests.InProcessEmitTest 9✅ 38s 015ms
BenchmarkDotNet.IntegrationTests.NuGetReferenceTests 2✅ 37s 193ms
BenchmarkDotNet.IntegrationTests.DotTraceTests 1✅ 21s 535ms
BenchmarkDotNet.IntegrationTests.ArgumentsTests 53✅ 1⚪ 21s 527ms
BenchmarkDotNet.IntegrationTests.ExceptionDiagnoserTests 1✅ 10s 638ms
BenchmarkDotNet.IntegrationTests.AllSetupAndCleanupTest 7✅ 10s 006ms
BenchmarkDotNet.IntegrationTests.ValuesReturnedByBenchmarkTest 2✅ 9s 984ms
BenchmarkDotNet.IntegrationTests.ParamSourceTests 11✅ 7s 389ms
BenchmarkDotNet.IntegrationTests.ExceptionHandlingTests 17✅ 5s 345ms
BenchmarkDotNet.IntegrationTests.AsyncBenchmarksTests 2✅ 4s 459ms
BenchmarkDotNet.IntegrationTests.ParamsTests 11✅ 3s 649ms
BenchmarkDotNet.IntegrationTests.StatResultExtenderTests 1✅ 2s 522ms
BenchmarkDotNet.IntegrationTests.EventProcessorTests 6✅ 2s 267ms
BenchmarkDotNet.IntegrationTests.ReferencesTests 4✅ 2s 234ms
BenchmarkDotNet.IntegrationTests.EngineTests 3✅ 2s 195ms
BenchmarkDotNet.IntegrationTests.GcModeTests 7✅ 1s 970ms
BenchmarkDotNet.IntegrationTests.PriorityTests 1✅ 1s 800ms
BenchmarkDotNet.IntegrationTests.BuildTimeoutTests 1✅ 1s 467ms
BenchmarkDotNet.IntegrationTests.RoslynToolchainTest 4✅ 1s 165ms
BenchmarkDotNet.IntegrationTests.BaselineRatioColumnTest 1✅ 1s 007ms
BenchmarkDotNet.IntegrationTests.BaselineRatioColumnWithLongParamsTest 1✅ 1s 003ms
BenchmarkDotNet.IntegrationTests.ProcessorArchitectureTest 3✅ 843ms
BenchmarkDotNet.IntegrationTests.EnvironmentVariablesTests 3✅ 838ms
BenchmarkDotNet.IntegrationTests.DryRunTests 2✅ 827ms
BenchmarkDotNet.IntegrationTests.InProcessTest 10✅ 686ms
BenchmarkDotNet.IntegrationTests.ProcessPropertiesTests 2✅ 591ms
BenchmarkDotNet.IntegrationTests.StandardErrorTests 2✅ 561ms
BenchmarkDotNet.IntegrationTests.BaselineRatioResultExtenderNoBaselineTest 1✅ 551ms
BenchmarkDotNet.IntegrationTests.SetupAndCleanupTests 1✅ 549ms
BenchmarkDotNet.IntegrationTests.LanguageVersionTests 1✅ 302ms
BenchmarkDotNet.IntegrationTests.ToolchainTest 1✅ 301ms
BenchmarkDotNet.IntegrationTests.AssemblyConfigTests 1✅ 290ms
BenchmarkDotNet.IntegrationTests.AppConfigTests 1✅ 282ms
BenchmarkDotNet.IntegrationTests.ExtraAttributesForEntryMethodTests 1✅ 278ms
BenchmarkDotNet.IntegrationTests.FSharpTests 1✅ 277ms
BenchmarkDotNet.IntegrationTests.AttributesTests 1✅ 276ms
BenchmarkDotNet.IntegrationTests.CopyToOutputTests 1✅ 272ms
BenchmarkDotNet.IntegrationTests.PathTooLongTests 1✅ 267ms
BenchmarkDotNet.IntegrationTests.CustomEngineTests 1✅ 261ms
BenchmarkDotNet.IntegrationTests.FailingProcessSpawnTests 1✅ 140ms
BenchmarkDotNet.IntegrationTests.ValidatorsTest 2✅ 51ms
BenchmarkDotNet.IntegrationTests.PowerManagementApplierTests 2✅ 33ms
BenchmarkDotNet.IntegrationTests.Diagnosers.ProcessMetricsTests 3✅ 17ms
BenchmarkDotNet.IntegrationTests.ExporterIOTests 4✅ 9ms
BenchmarkDotNet.IntegrationTests.BaselineRatioResultExtenderErrorTest 1✅ 7ms
BenchmarkDotNet.IntegrationTests.JitOptimizationsTests 2✅ 5ms
BenchmarkDotNet.IntegrationTests.GlobalSetupAttributeInvalidMethodTest 1✅ 2ms
BenchmarkDotNet.IntegrationTests.CustomBuildConfigurationTests 1⚪ 1ms
BenchmarkDotNet.IntegrationTests.IntegrationTestSetupTests 1✅ 1ms
BenchmarkDotNet.IntegrationTests.MonoTests 1⚪ 1ms
BenchmarkDotNet.IntegrationTests.NativeAotTests 1⚪ 1ms
BenchmarkDotNet.IntegrationTests.WasmTests 1⚪ 1ms