Lightrun
question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

[Errno 25] Inappropriate ioctl for device

See original GitHub issue

Dear Team,

we have been running dvc from a CircleCi job successfully for a while now. Recently, we have suddenly not been able to pull data anymore.

We are running a Linux machine (X large) on CircleCi. The error happens after our job runs dvc pull -r s3-remote. Any hints as to what is going on are highly appreciated.

How we install in the cloud:

pip3 install --upgrade pip pip3 install “dvc[s3]”

Output of dvc doctor:

---------------------------------
Platform: Python 3.8.3 on Linux-4.4.0-1109-aws-x86_64-with-glibc2.17
Supports:
	webhdfs (fsspec = 2021.11.0),
	http (aiohttp = 3.8.0, aiohttp-retry = 2.4.6),
	https (aiohttp = 3.8.0, aiohttp-retry = 2.4.6),
	s3 (s3fs = 2021.11.0, boto3 = 1.17.106)
Cache types: <https://error.dvc.org/no-dvc-cache>
Caches: local
Remotes: s3
Workspace directory: ext4 on /dev/nvme0n1p1
Repo: dvc, git
If DVC froze, see `hardlink_lock` in <https://man.dvc.org/config#core

The error thrown:

------------------------------------------------------------
Traceback (most recent call last):
  File "/opt/circleci/.pyenv/versions/3.8.3/lib/python3.8/site-packages/dvc/main.py", line 55, in main
    ret = cmd.do_run()
  File "/opt/circleci/.pyenv/versions/3.8.3/lib/python3.8/site-packages/dvc/command/base.py", line 45, in do_run
    return self.run()
  File "/opt/circleci/.pyenv/versions/3.8.3/lib/python3.8/site-packages/dvc/command/data_sync.py", line 30, in run
    stats = self.repo.pull(
  File "/opt/circleci/.pyenv/versions/3.8.3/lib/python3.8/site-packages/dvc/repo/__init__.py", line 50, in wrapper
    return f(repo, *args, **kwargs)
  File "/opt/circleci/.pyenv/versions/3.8.3/lib/python3.8/site-packages/dvc/repo/pull.py", line 40, in pull
    stats = self.checkout(
  File "/opt/circleci/.pyenv/versions/3.8.3/lib/python3.8/site-packages/dvc/repo/__init__.py", line 50, in wrapper
    return f(repo, *args, **kwargs)
  File "/opt/circleci/.pyenv/versions/3.8.3/lib/python3.8/site-packages/dvc/repo/checkout.py", line 98, in checkout
    result = stage.checkout(
  File "/opt/circleci/.pyenv/versions/3.8.3/lib/python3.8/site-packages/funcy/decorators.py", line 45, in wrapper
    return deco(call, *dargs, **dkwargs)
  File "/opt/circleci/.pyenv/versions/3.8.3/lib/python3.8/site-packages/dvc/stage/decorators.py", line 36, in rwlocked
    return call()
  File "/opt/circleci/.pyenv/versions/3.8.3/lib/python3.8/site-packages/funcy/decorators.py", line 66, in __call__
    return self._func(*self._args, **self._kwargs)
  File "/opt/circleci/.pyenv/versions/3.8.3/lib/python3.8/site-packages/dvc/stage/__init__.py", line 572, in checkout
    key, outs = self._checkout(
  File "/opt/circleci/.pyenv/versions/3.8.3/lib/python3.8/site-packages/dvc/stage/__init__.py", line 584, in _checkout
    result = out.checkout(**kwargs)
  File "/opt/circleci/.pyenv/versions/3.8.3/lib/python3.8/site-packages/dvc/output.py", line 751, in checkout
    modified = checkout(
  File "/opt/circleci/.pyenv/versions/3.8.3/lib/python3.8/site-packages/dvc/objects/checkout.py", line 301, in checkout
    _checkout(
  File "/opt/circleci/.pyenv/versions/3.8.3/lib/python3.8/site-packages/dvc/objects/checkout.py", line 247, in _checkout
    _checkout_file(
  File "/opt/circleci/.pyenv/versions/3.8.3/lib/python3.8/site-packages/dvc/objects/checkout.py", line 146, in _checkout_file
    _confirm_cache_type(cache, path_info)
  File "/opt/circleci/.pyenv/versions/3.8.3/lib/python3.8/site-packages/dvc/objects/checkout.py", line 115, in _confirm_cache_type
    _link(cache, test_cache_file, workspace_file)
  File "/opt/circleci/.pyenv/versions/3.8.3/lib/python3.8/site-packages/dvc/objects/checkout.py", line 95, in _link
    _try_links(cache, from_info, to_info, cache.cache_types)
  File "/opt/circleci/.pyenv/versions/3.8.3/lib/python3.8/site-packages/dvc/objects/db/slow_link_detection.py", line 33, in wrapper
    return f(odb, *args, **kwargs)
  File "/opt/circleci/.pyenv/versions/3.8.3/lib/python3.8/site-packages/dvc/objects/checkout.py", line 77, in _try_links
    _do_link(cache, from_info, to_info, link_method)
  File "/opt/circleci/.pyenv/versions/3.8.3/lib/python3.8/site-packages/dvc/objects/checkout.py", line 65, in _do_link
    link_method(from_info, to_info)
  File "/opt/circleci/.pyenv/versions/3.8.3/lib/python3.8/site-packages/dvc/fs/local.py", line 161, in reflink
    System.reflink(from_info, to_info)
  File "/opt/circleci/.pyenv/versions/3.8.3/lib/python3.8/site-packages/dvc/system.py", line 113, in reflink
    System._reflink_linux(source, link_name)
  File "/opt/circleci/.pyenv/versions/3.8.3/lib/python3.8/site-packages/dvc/system.py", line 97, in _reflink_linux
    fcntl.ioctl(d.fileno(), FICLONE, s.fileno())
OSError: [Errno 25] Inappropriate ioctl for device
------------------------------------------------------------
Traceback (most recent call last):
  File "/opt/circleci/.pyenv/versions/3.8.3/lib/python3.8/site-packages/dvc/main.py", line 55, in main
    ret = cmd.do_run()
  File "/opt/circleci/.pyenv/versions/3.8.3/lib/python3.8/site-packages/dvc/command/base.py", line 45, in do_run
    return self.run()
  File "/opt/circleci/.pyenv/versions/3.8.3/lib/python3.8/site-packages/dvc/command/data_sync.py", line 30, in run
    stats = self.repo.pull(
  File "/opt/circleci/.pyenv/versions/3.8.3/lib/python3.8/site-packages/dvc/repo/__init__.py", line 50, in wrapper
    return f(repo, *args, **kwargs)
  File "/opt/circleci/.pyenv/versions/3.8.3/lib/python3.8/site-packages/dvc/repo/pull.py", line 40, in pull
    stats = self.checkout(
  File "/opt/circleci/.pyenv/versions/3.8.3/lib/python3.8/site-packages/dvc/repo/__init__.py", line 50, in wrapper
    return f(repo, *args, **kwargs)
  File "/opt/circleci/.pyenv/versions/3.8.3/lib/python3.8/site-packages/dvc/repo/checkout.py", line 98, in checkout
    result = stage.checkout(
  File "/opt/circleci/.pyenv/versions/3.8.3/lib/python3.8/site-packages/funcy/decorators.py", line 45, in wrapper
    return deco(call, *dargs, **dkwargs)
  File "/opt/circleci/.pyenv/versions/3.8.3/lib/python3.8/site-packages/dvc/stage/decorators.py", line 36, in rwlocked
    return call()
  File "/opt/circleci/.pyenv/versions/3.8.3/lib/python3.8/site-packages/funcy/decorators.py", line 66, in __call__
    return self._func(*self._args, **self._kwargs)
  File "/opt/circleci/.pyenv/versions/3.8.3/lib/python3.8/site-packages/dvc/stage/__init__.py", line 572, in checkout
    key, outs = self._checkout(
  File "/opt/circleci/.pyenv/versions/3.8.3/lib/python3.8/site-packages/dvc/stage/__init__.py", line 584, in _checkout
    result = out.checkout(**kwargs)
  File "/opt/circleci/.pyenv/versions/3.8.3/lib/python3.8/site-packages/dvc/output.py", line 751, in checkout
    modified = checkout(
  File "/opt/circleci/.pyenv/versions/3.8.3/lib/python3.8/site-packages/dvc/objects/checkout.py", line 301, in checkout
    _checkout(
  File "/opt/circleci/.pyenv/versions/3.8.3/lib/python3.8/site-packages/dvc/objects/checkout.py", line 247, in _checkout
    _checkout_file(
  File "/opt/circleci/.pyenv/versions/3.8.3/lib/python3.8/site-packages/dvc/objects/checkout.py", line 146, in _checkout_file
    _confirm_cache_type(cache, path_info)
  File "/opt/circleci/.pyenv/versions/3.8.3/lib/python3.8/site-packages/dvc/objects/checkout.py", line 115, in _confirm_cache_type
    _link(cache, test_cache_file, workspace_file)
  File "/opt/circleci/.pyenv/versions/3.8.3/lib/python3.8/site-packages/dvc/objects/checkout.py", line 95, in _link
    _try_links(cache, from_info, to_info, cache.cache_types)
  File "/opt/circleci/.pyenv/versions/3.8.3/lib/python3.8/site-packages/dvc/objects/db/slow_link_detection.py", line 33, in wrapper
    return f(odb, *args, **kwargs)
  File "/opt/circleci/.pyenv/versions/3.8.3/lib/python3.8/site-packages/dvc/objects/checkout.py", line 77, in _try_links
    _do_link(cache, from_info, to_info, link_method)
  File "/opt/circleci/.pyenv/versions/3.8.3/lib/python3.8/site-packages/dvc/objects/checkout.py", line 65, in _do_link
    link_method(from_info, to_info)
  File "/opt/circleci/.pyenv/versions/3.8.3/lib/python3.8/site-packages/dvc/fs/local.py", line 161, in reflink
    System.reflink(from_info, to_info)
  File "/opt/circleci/.pyenv/versions/3.8.3/lib/python3.8/site-packages/dvc/system.py", line 113, in reflink
    System._reflink_linux(source, link_name)
  File "/opt/circleci/.pyenv/versions/3.8.3/lib/python3.8/site-packages/dvc/system.py", line 97, in _reflink_linux
    fcntl.ioctl(d.fileno(), FICLONE, s.fileno())
OSError: [Errno 25] Inappropriate ioctl for device

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/opt/circleci/.pyenv/versions/3.8.3/bin/dvc", line 8, in <module>
    sys.exit(main())
  File "/opt/circleci/.pyenv/versions/3.8.3/lib/python3.8/site-packages/dvc/main.py", line 88, in main
    dvc_info = get_dvc_info()
  File "/opt/circleci/.pyenv/versions/3.8.3/lib/python3.8/site-packages/dvc/info.py", line 44, in get_dvc_info
    info.append(f"Cache types: {_get_linktype_support_info(repo)}")
  File "/opt/circleci/.pyenv/versions/3.8.3/lib/python3.8/site-packages/dvc/info.py", line 102, in _get_linktype_support_info
    link(src, dst)
  File "/opt/circleci/.pyenv/versions/3.8.3/lib/python3.8/site-packages/dvc/system.py", line 113, in reflink
    System._reflink_linux(source, link_name)
  File "/opt/circleci/.pyenv/versions/3.8.3/lib/python3.8/site-packages/dvc/system.py", line 97, in _reflink_linux
    fcntl.ioctl(d.fileno(), FICLONE, s.fileno())
OSError: [Errno 25] Inappropriate ioctl for device


Exited with code exit status 1
CircleCI received exit code 1 ```

Issue Analytics

  • State:closed
  • Created 2 years ago
  • Comments:11 (2 by maintainers)

github_iconTop GitHub Comments

1reaction
marcosfeltcommented, Aug 16, 2022

One other note, I had to install the head of the dvc repository because 2.18.0 still had FS_MAP installed: https://github.com/iterative/dvc/blob/2e8b463795212b4252ab187d4bf8fc5017b78a2e/dvc/fs/__init__.py#L6

1reaction
pmrowlacommented, Aug 16, 2022

@marcosfelt I think you may need to rebuild your venv? Something seems out of date, nothing in current dvc/dvc-data/dvc-objects should be importing FS_MAP

Read more comments on GitHub >

github_iconTop Results From Across the Web

IOError: [Errno 25] Inappropriate ioctl for device - Stack Overflow
Most IDE's like PyCharm or Wing has simulated Terminals so running a code contain get_terminal_size() will trigger [ Errno 25] Inappropriate ...
Read more >
OSError: [Errno 25] Inappropriate ioctl for device - Get Help
Changed from Pi zero W to pi4b external. What did you already try to solve it? Checked my wiring for tx and rx,...
Read more >
Fixing [Errno 25] Inappropriate ioctl for device - Ahmet Ertem
Recently I wrote an application on Python for Raspberry. At my development rPI everything was working smoothly until I copy files to production ......
Read more >
serial errno 25 inappropriate ioctl for device
I have raspberry pi 3 B+ running latest raspbian-strech lite. i have a max485 ic connected to uart on the gpio. import serial,fcntl,...
Read more >
Error: (25, 'Inappropriate ioctl for device') - PlatformIO Core
It seems the combination “platformio device monitor” in background + stdout redirection is not supported on Linux (tested on Ubuntu 20.04).
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found
Previous page

Support no-command meta stages

Next page

add: incredibly slow