Question

我已经使用SpecFlow BDD和Selenium创建了一个测试套件，我正在尝试使用管道在Azure DevOps上运行该测试套件：

trigger:
  - master
pool:
  name: Hosted Windows 2019 with VS2019
  vmImage: windows-latest
schedules:
  - cron: '00 16 * * MON,TUE,WED,THU,FRI'
    displayName: Weekdays 4PM build
    branches:
      include:
        - master
        - releases/*
      exclude:
        - development
        - feature/*
jobs:
  - job: Build
    displayName: Build
    pool:
      vmImage: windows-latest
    steps:
      - task: PowerShell@2
        displayName: Clone the pipelines repository
        inputs:
          targetType: inline
          script: >
            git clone -b master
            https://azuredevops:$($env:token)@dev.azure.com/abc-comapny/MyAzure/_git/MyProject.Builder
            pipeline-repo/
        env:
          token: $(System.AccessToken)
      - task: Bash@3
        displayName: Prepare the nuget.config file
        inputs:
          targetType: inline
          script: |
            echo copying the nuget.config to the root folder
            cp ./pipeline-repo/templates/nuget.config .
      - task: NuGetCommand@2
        displayName: Authenticate with Azure DevOps NuGet
        inputs:
          command: custom
          arguments: >-
            sources update -Name "Azure DevOps" -Username "vsts" -Password
            "$(System.AccessToken)" -StorePasswordInClearText -ConfigFile
            ./nuget.config
      - task: UseDotNet@2
        displayName: Using SDK Version (3.1.x)
        inputs:
          version: 3.1.x
      - task: DotNetCoreCLI@2
        displayName: Restore
        inputs:
          command: restore
          projects: '**/*.sln'
      - task: DotNetCoreCLI@2
        displayName: Build the solution
        inputs:
          command: build
          projects: '**/*.sln'
      - task: SpecFlowPlus@0
        inputs:
          projectFilePath: .
          projectName: MyProject.Qa
          projectLanguage: en
          workItemPrefix: AUTO
      - task: DotNetCoreCLI@2
        displayName: Publish
        inputs:
          command: publish
          publishWebProjects: false
          projects: '**/*.sln'
          arguments: >-
            --configuration Release -o
            $(build.artifactstagingdirectory)/SeleniumTests
          zipAfterPublish: false
          modifyOutputPath: false
      - task: PublishBuildArtifacts@1
        displayName: Publish Artifact
        inputs:
          PathtoPublish: $(build.artifactstagingdirectory)
        condition: succeededOrFailed()
      - script: >-
          dotnet test MyProject.Qa.sln -r "$(Agent.TempDirectory)/" --logger
          "trx;LogFilename=testresults.trx" 
        displayName: Run Unit Tests and Code Coverage
        continueOnError: false

我尝试查找以下给出的说明：

https://swimburger.net/blog/dotnet/how-to-run-net-core-selenium-ui-tests-on-azure-devops-pipelines

https://www.stuartwhiteford.com/running-selenium-ui-tests-in-an-azure-devops-pipeline/

https://azuredevopslabs.com/labs/vstsextend/selenium/#:~:text=Navigate%20to%20Pipelines%20under%20Pipelines,successful%2C%20release%20will%20be%20triggered。

所有步骤都通过了，但是我没有得到任何结果，也没有看到测试结果的任何输出。我有2个项目，两个都是MS Test，一个用于BDD规范，另一个用于Selenium框架文件：

MyProject.Qa.Specification.csproj

<PropertyGroup>
  <TargetFramework>netcoreapp3.1</TargetFramework>

  <IsPackable>false</IsPackable>
</PropertyGroup>

<ItemGroup>
  <PackageReference Include="Microsoft.NET.Test.Sdk" Version="16.7.1" />
  <PackageReference Include="MSTest.TestAdapter" Version="2.1.2" />
  <PackageReference Include="MSTest.TestFramework" Version="2.1.2" />
  <PackageReference Include="coverlet.collector" Version="1.3.0">
    <PrivateAssets>all</PrivateAssets>
    <IncludeAssets>runtime; build; native; contentfiles; analyzers; buildtransitive</IncludeAssets>
  </PackageReference>
  <PackageReference Include="Newtonsoft.Json" Version="12.0.3" />
  <PackageReference Include="Selenium.Support" Version="3.141.0" />
  <PackageReference Include="Selenium.WebDriver" Version="3.141.0" />
  <PackageReference Include="Selenium.WebDriver.ChromeDriver" Version="85.0.4183.8700" />
  <PackageReference Include="Selenium.WebDriver.GeckoDriver" Version="0.27.0" />
  <PackageReference Include="SpecFlow" Version="3.4.3" />
  <PackageReference Include="SpecFlow.Assist.Dynamic" Version="1.4.2" />
  <PackageReference Include="SpecFlow.Tools.MsBuild.Generation" Version="3.4.3" />
  <PackageReference Include="SpecRun.Runner" Version="3.4.12" />
  <PackageReference Include="SpecRun.SpecFlow" Version="3.4.12" />
</ItemGroup>

<ItemGroup>
  <ProjectReference Include="..\MyProject.Qa.Framework\MyProject.Qa.Framework.csproj" />
</ItemGroup>

<ItemGroup>
<Folder Include="FeatureFiles\" />
<Folder Include="Hooks\" />
<Folder Include="SpecFlowPlusRunner" />
<Folder Include="StepDefinitions\" />
</ItemGroup>

MyProject.Qa.Framework.csproj：

<PropertyGroup>
  <TargetFramework>netcoreapp3.1</TargetFramework>

  <IsPackable>false</IsPackable>
</PropertyGroup>

<ItemGroup>
  <PackageReference Include="DotNetSeleniumExtras.PageObjects" Version="3.11.0" />
  <PackageReference Include="DotNetSeleniumExtras.WaitHelpers" Version="3.11.0" />
  <PackageReference Include="Newtonsoft.Json" Version="12.0.3" />
  <PackageReference Include="NUnit" Version="3.12.0" />
  <PackageReference Include="NUnit3TestAdapter" Version="3.17.0">
    <PrivateAssets>all</PrivateAssets>
    <IncludeAssets>runtime; build; native; contentfiles; analyzers; buildtransitive</IncludeAssets>
  </PackageReference>
  <PackageReference Include="Microsoft.NET.Test.Sdk" Version="16.7.1" />
  <PackageReference Include="Selenium.Support" Version="3.141.0" />
  <PackageReference Include="Selenium.WebDriver" Version="3.141.0" />
  <PackageReference Include="Selenium.WebDriver.ChromeDriver" Version="85.0.4183.8700" />
  <PackageReference Include="Selenium.WebDriver.GeckoDriver" Version="0.27.0" />
  <PackageReference Include="Selenium.WebDriver.GeckoDriver.Win64" Version="0.27.0" />
  <PackageReference Include="SpecFlow" Version="3.4.3" />
  <PackageReference Include="System.Configuration.ConfigurationManager" Version="4.7.0" />
</ItemGroup>

<ItemGroup>
  <Folder Include="CommonStructures\" />
  <Folder Include="Controllers\" />
  <Folder Include="Data\" />
  <Folder Include="Dialogs\" />
  <Folder Include="Extensions\" />
  <Folder Include="Pages\" />
</ItemGroup>

是否有人将SpecFlow BDD UI测试与Azure DevOps Pipeline一起使用，以在非无头浏览器类型运行中运行UI测试？如果是这样，您能否告知您您做了什么？如果我对上述“ azure-pipeline.yaml”文件做错了什么，并且需要更改任何内容以运行这些测试？

此外，我如何使用以上内容将邮件发送给所有涉众？一旦获得报告，是否可以使用YAML进行操作，还是需要从Azure DevOps的其他部分进行操作？

Answer 1

我认为您缺少将测试结果发布到Azure DevOps的任务。您正在执行dotnet test并获得一个trx-文件（结果文件），但是您没有对其进行任何操作。

之后，您需要使用Publish Test Result任务（https://docs.microsoft.com/en-us/azure/devops/pipelines/tasks/test/publish-test-results?view=azure-devops&tabs=yaml）将trx-文件上传到Azure DevOps。

或者您将dotnet test命令更改为使用Visual Studio Test任务（https://docs.microsoft.com/en-us/azure/devops/pipelines/tasks/test/vstest?view=azure-devops）。此任务将自动上传trx-文件。

在Azure DevOps管道上运行的SpecFlow BDD UI测试

1 个答案: