Pip-compile: Could not find a version that matches dill<0.3.6,>=0.3.6

Describe the bug

When using pip-compile (part of pip-tools) to generate a pinned requirements file that includes datasets, a version conflict of dill appears.

It is caused by a transitive dependency conflict between datasets and multiprocess.

Steps to reproduce the bug

$ echo "datasets" > requirements.in
$ pip install pip-tools
$ pip-compile requirements.in 
Could not find a version that matches dill<0.3.6,>=0.3.6 (from datasets==2.6.1->-r requirements.in (line 1))
Tried: 0.2, 0.2, 0.2.1, 0.2.1, 0.2.2, 0.2.2, 0.2.3, 0.2.3, 0.2.4, 0.2.4, 0.2.5, 0.2.5, 0.2.6, 0.2.7, 0.2.7.1, 0.2.8, 0.2.8.1, 0.2.8.2, 0.2.9, 0.3.0, 0.3.1, 0.3.1.1, 0.3.2, 0.3.3, 0.3.3, 0.3.4, 0.3.4, 0.3.5, 0.3.5, 0.3.5.1, 0.3.5.1, 0.3.6, 0.3.6
Skipped pre-versions: 0.1a1, 0.2a1, 0.2a1, 0.2b1, 0.2b1
There are incompatible versions in the resolved dependencies:
  dill<0.3.6 (from datasets==2.6.1->-r requirements.in (line 1))
  dill>=0.3.6 (from multiprocess==0.70.14->datasets==2.6.1->-r requirements.in (line 1))

Expected behavior

A correctly generated file requirements.txt with pinned dependencies

Environment info

Tested with versions 2.6.1, 2.6.0, 2.5.2 on Python 3.8 and 3.10 on Ubuntu 20.04LTS and Python 3.10 on MacOS 12.6 (M1).

[albertvillanova]

@StefanSamba we are disussing about making a release early this week.

[albertvillanova]

@Rijgersberg this issue is fixed. It will be available in our next datasets release.