Does this module support windows？

System information

• OS Platform and Distribution:Win11

• Modin version :0.13.2

• Python version:3.8.8

• Code we can use to reproduce: import modin.pandas as pd from modin.config import Engine

  Engine.put(“dask”) Engine.put(“ray”)
  data = pd.read_csv(file_path, dtype=np.float, header=None).to_numpy(“float32”).astype(‘float32’)

Describe the problem

Not work on Win11

Source code / logs

using dask:

UserWarning: Dask execution environment not yet initialized. Initializing...
To remove this warning, run the following python code before doing dataframe operations:

    from distributed import Client

    client = Client()

Traceback (most recent call last):
  File ".\test_read.py", line 45, in <module>
    print((test_modin_pd() == test_pd()).all())
  File ".\test_read.py", line 30, in test_modin_pd
    data = pd.read_csv(file_path, dtype=np.float, header=None).to_numpy("float32").astype('float32')
  File "C:\Users\wqh\anaconda3\lib\site-packages\modin\pandas\io.py", line 135, in read_csv
    return _read(**kwargs)
  File "C:\Users\wqh\anaconda3\lib\site-packages\modin\pandas\io.py", line 60, in _read
    pd_obj = FactoryDispatcher.read_csv(**kwargs)
  File "C:\Users\wqh\anaconda3\lib\site-packages\modin\core\execution\dispatching\factories\dispatcher.py", line 180, in read_csv
    return cls.__factory._read_csv(**kwargs)
  File "C:\Users\wqh\anaconda3\lib\site-packages\modin\core\execution\dispatching\factories\factories.py", line 207, in _read_csv
    return cls.io_cls.read_csv(**kwargs)
  File "C:\Users\wqh\anaconda3\lib\site-packages\modin\core\io\file_dispatcher.py", line 151, in read
    query_compiler = cls._read(*args, **kwargs)
  File "C:\Users\wqh\anaconda3\lib\site-packages\modin\core\io\text\text_file_dispatcher.py", line 1007, in _read
    splits = cls.partitioned_file(
  File "C:\Users\wqh\anaconda3\lib\site-packages\modin\core\io\text\text_file_dispatcher.py", line 314, in partitioned_file
    outside_quotes = cls.offset(
  File "C:\Users\wqh\anaconda3\lib\site-packages\modin\core\io\text\text_file_dispatcher.py", line 192, in offset
    outside_quotes, _ = cls._read_rows(
  File "C:\Users\wqh\anaconda3\lib\site-packages\modin\core\io\text\text_file_dispatcher.py", line 386, in _read_rows
    for line in iterator:
TypeError: 'LocalFileOpener' object is not iterable

using ray:

UserWarning: Ray execution environment not yet initialized. Initializing...
To remove this warning, run the following python code before doing dataframe operations:

    import ray
    ray.init()

Traceback (most recent call last):
  File ".\test_read.py", line 45, in <module>
    test_modin_pd()
  File ".\test_read.py", line 30, in test_modin_pd
    data = pd.read_csv(file_path, dtype=np.float, header=None).to_numpy("float32").astype('float32')
  File "C:\Users\wqh\anaconda3\lib\site-packages\modin\pandas\io.py", line 135, in read_csv
    return _read(**kwargs)
  File "C:\Users\wqh\anaconda3\lib\site-packages\modin\pandas\io.py", line 56, in _read
    Engine.subscribe(_update_engine)
  File "C:\Users\wqh\anaconda3\lib\site-packages\modin\config\pubsub.py", line 213, in subscribe
    callback(cls)
  File "C:\Users\wqh\anaconda3\lib\site-packages\modin\pandas\__init__.py", line 128, in _update_engine
    initialize_ray()
  File "C:\Users\wqh\anaconda3\lib\site-packages\modin\core\execution\ray\common\utils.py", line 183, in initialize_ray
    ray.init(**ray_init_kwargs)
  File "C:\Users\wqh\anaconda3\lib\site-packages\ray\_private\client_mode_hook.py", line 105, in wrapper
    return func(*args, **kwargs)
  File "C:\Users\wqh\anaconda3\lib\site-packages\ray\worker.py", line 918, in init
    _global_node = ray.node.Node(
  File "C:\Users\wqh\anaconda3\lib\site-packages\ray\node.py", line 215, in __init__
    self.start_head_processes()
  File "C:\Users\wqh\anaconda3\lib\site-packages\ray\node.py", line 911, in start_head_processes
    self.start_redis()
  File "C:\Users\wqh\anaconda3\lib\site-packages\ray\node.py", line 715, in start_redis
    self.get_resource_spec(),
  File "C:\Users\wqh\anaconda3\lib\site-packages\ray\node.py", line 344, in get_resource_spec
    self._resource_spec = ResourceSpec(
  File "C:\Users\wqh\anaconda3\lib\site-packages\ray\_private\resource_spec.py", line 149, in resolve
    num_gpus = _autodetect_num_gpus()
  File "C:\Users\wqh\anaconda3\lib\site-packages\ray\_private\resource_spec.py", line 241, in _autodetect_num_gpus
    lines = subprocess.check_output(cmdargs).splitlines()[1:]
  File "C:\Users\wqh\anaconda3\lib\subprocess.py", line 411, in check_output
    return run(*popenargs, stdout=PIPE, timeout=timeout, check=True,
  File "C:\Users\wqh\anaconda3\lib\subprocess.py", line 489, in run
    with Popen(*popenargs, **kwargs) as process:
  File "C:\Users\wqh\anaconda3\lib\subprocess.py", line 854, in __init__
    self._execute_child(args, executable, preexec_fn, close_fds,
  File "C:\Users\wqh\anaconda3\lib\subprocess.py", line 1307, in _execute_child
    hp, ht, pid, tid = _winapi.CreateProcess(executable, args,
FileNotFoundError: [WinError 2] can not find that file.

[jbrockmendel]

This doesn’t look familiar, but I can confirm that pandas 1.5.0 (coming soon) bumps the fsspec minimum supported version to 2021.5.0

[vnlitvinov]

One piece is a bug in Ray, and another one is handled by https://github.com/modin-project/modin/issues/4855

I’m going to close this tracker in favour of other two which are more specific.