test-262 integration

Search Terms

test-262, test262

Suggestion

Run test-262 on TS downlevel

Use Cases

What do you want to use this for?

• Verify that downleveling is spec-compliant to avoid issues when changing the test target.

• Possible benefits for TS team:

  • Reduce triage overhead by catching semantic errors quickly
  • Reduce duplicate effort by putting creative testing work into the test-262 project

Examples

gulp runtests  # runs relevant test-262 tests

Checklist

• This wouldn’t be a breaking change in existing TypeScript/JavaScript code
• This wouldn’t change the runtime behavior of existing JavaScript code
• This could be implemented without emitting different JS based on the types of the expressions
• This isn’t a runtime feature (e.g. library functionality, non-ECMAScript syntax with JavaScript output, etc.)
• This feature would agree with the rest of TypeScript’s Design Goals.

[mkubilayk]

Hey @weswigham - we have a test262 runner for TypeScript that @jbhoosreddy published at https://github.com/jbhoosreddy/TypeScript/tree/typescript-test262-runner.

$ npm i
$ node lib/download-node
$ node lib/run-tests arrow-function

should run a subset of tests transpiled by TypeScript 3 on node 0.1.0 (which doesn’t have newer language features). We would like to get this integrated with your workflow and CI.

I see defunct test runner you have for test262 doesn’t actually run the code but we can have something similar that calls out the this runner and collects the results. We will need some hand-holding to figure out the CI pipelines, though.

[jbhoosreddy]

Hey so, we had a catch that involved @DanielRosenwasser, @RyanCavanaugh, @mheiber, @robpalme, @joeywatts and others (sorry I couldn’t find github usernames).

We discussed taking on this particular issue for external contributions as discussed with @DanielRosenwasser and @RyanCavanaugh. In particular, @mkubilayk and I would like to work on it based on a solution I worked on for babel/babel using babel-test262-runner along with babel maintainers @nicolo-ribaudo and @JLHwung.

We now already have a similar test262 runner for this which transpiles TypeScript code and outputs results. The interesting part here would be to integrate with existing CI infrastructure.

They recommended @sandersn and @weswigham to be point of contact for help guiding this work. Thanks!