Unable to test non-Core code on Linux

[jskeet]

(Apologies if this is the wrong repo for this; it's not clear to me whether this is xUnit-specific or the expected behaviour when testing on Linux.)

Background

I have projects which don't target core yet, but I still want to test on Travis. They work fine on RC1 (with dnx test and the old xUnit setup) and work fine with an updated project.json on Windows, but fail to run tests on Linux.

It's not clear whether the non-core runtimes/frameworks are expected to work on non-Windows platforms. Using dotnet run works fine for a console app with a TFM of net451, so it's clearly got some knowledge... but dotnet test fails.

Similar issues: #4833, #5172.

Steps to reproduce

Create xUnit test project with a framework of net451, and run dotnet restore, dotnet build, dotnet test.

Sample project.json:

{
  "dependencies": {
    "xunit": "2.1.0",
    "dotnet-test-xunit": "1.0.0-rc2-build10015",
  },

  "testRunner": "xunit",

  "frameworks": {
    "net451": { }
  }
}

Sample C#:

using Xunit;

public class Test
{
    [Fact] public void Foo() {}
}

Expected behavior

Tests run (using Mono).

Actual behavior

Restore and build both work, but test fails:

dotnet-test Error: 0 : Microsoft.DotNet.Cli.Utils.CommandUnknownException: No executable found matching command "dotnet-test-xunit"  
  at Microsoft.DotNet.Cli.Utils.ProjectDependenciesCommandFactory.FindProjectDependencyCommands(String commandName, IEnumerable`1 commandArgs, String configuration, NuGetFramework framework, String outputPath, String buildBasePath, String projectDirectory)  
  at Microsoft.DotNet.Cli.Utils.ProjectDependenciesCommandFactory.Create(String commandName, IEnumerable`1 args, NuGetFramework framework, String configuration)  
  at Microsoft.DotNet.Tools.Test.ConsoleTestRunner.DoRunTests(ProjectContext projectContext, DotnetTestParams dotnetTestParams)  
  at Microsoft.DotNet.Tools.Test.TestCommand.DoRun(String[] args)

Environment data

dotnet --info output:

.NET Command Line Tools (1.0.0-preview1-002702)

Product Information:
 Version:     1.0.0-preview1-002702
 Commit Sha:  6cde21225e

Runtime Environment:
 OS Name:     ubuntu
 OS Version:  15.10
 OS Platform: Linux
 RID:         ubuntu.15.10-x6

[clairernovotny]

As far as I can tell, one issue is that there's no specific Mono RID, so there's no runtime exe that we can create in the dotnet-test-xunit package for this.

[clairernovotny]

/cc @bradwilson @piotrpMSFT

[bradwilson]

Smells like a tooling problem, not an xUnit.net problem.

[jskeet]

So I reported it in the right repo by chance? Result :)

Do let me know if there's anything I can do to help diagnose it. I realize there are a lot of variables in play here.

[julielerman]

I'm getting this error ( No executable found matching command "dotnet-test-") as well but with dotnet core on osx. I'm not finding much via googlebing so adding onto this relatively similar thread ...because it puts me in such good company. :)

[clairernovotny]

@julielerman can you share your project.json?

[julielerman]

I've been mucking with it but results are still the same:

{
    "version": "2.0.0-*",
    "description": "",
    "authors": [
        ""
    ],
    "dependencies": {
        "Microsoft.EntityFrameworkCore.InMemory": "1.0.0-rc2-final",
        "src": "2.0.0",
        "xunit": "2.1.0",
        "dotnet-test-xunit": "1.0.0-rc2-build10015"
    },
    "frameworks": {
        "netcoreapp1.0": {
            "dependencies": {
                "Microsoft.NETCore.App": {
                    "type": "platform",
                    "version": "1.0.0-rc2-3002702"
                }
            },
            "imports": [
                "dnxcore50",
                "portable-net45+win8"
            ]
        }
    }
}

[clairernovotny]

So to be clear, the above works on Windows but not OSX?

[julielerman]

have not done any of this on windows. using vscode on a mac. Also, I have a full project that is running. I will create a 1+1=2 test and try to run that to be sure it's not a problem related to the dependency on that other project. Also, the only other ref I found to this error message was followed by "oh ..typo in project.json...sorry" but I can't see one and vscode is not reporting any issues. Thanks!

[ardalis]

dotnet-test should be dotnet test, if you're still seeing that error. If you're not typing that yourself, then it seems like you need to update your tools/SDK.

[bradwilson]

You're missing the testRunner entry. This may help: http://xunit.github.io/docs/getting-started-dotnet-core.html

[julielerman]

@bradwilson gah! I saw that but was so focused on the dependencies section. Running up to my macbook to try it out and will let you know.

[julielerman]

got it. sorry for my little RTFM snafu, @bradwilson . Sorry @jskeet for piggy backing. You do have that specification in your project.json.

[alberto-riggi]

I have the exact same problem as @jskeet in windows with TFM net452. Maybe it's not related to linux?

project json:

{
  "version": "1.0.0-*",
  "description": "UnitTests Class Library",
  "authors": [ "albertori" ],

  "dependencies": {
    "xunit": "2.1.0",
    "dotnet-test-xunit": "1.0.0-rc2-build10015"
  },

  "frameworks": {
    "net452": {
      "dependencies": {
        "NSubstitute": "1.10.0"
      }
    }
  },
  "testRunner": "xunit"
}

dotnet --info output:

.NET Command Line Tools (1.0.0-preview1-002702)

Product Information:
 Version:     1.0.0-preview1-002702
 Commit Sha:  6cde21225e

Runtime Environment:
 OS Name:     Windows
 OS Version:  10.0.10586
 OS Platform: Windows
 RID:         win10-x64

[jskeet]

@alberto-riggi: Just to check - you're having this problem on Windows? It only bit me on Linux. (My tiny sample works on Windows with both net451 and net452.)