question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

CWL: missing documentation on conda dependency resolver

See original GitHub issue

Toil is used to run a pipeline written in cwl on HPC (using the --no-container flag).The pipeline specifies software requirements for some tools and their versions. However, Toil doen’t take into acount this requirements and crashes when running the pipeline. Here is a minimal exemple of the problem:

class: CommandLineTool
cwlVersion: v1.0
doc: ""
hints:
  - class: DockerRequirement
    dockerPull: quay.io/biocontainers/drep:3.2.2--pyhdfd78af_0
  - class: SoftwareRequirement
    packages:
      drep:
        specs: 
          - https://anaconda.org/bioconda
        version:
          - "3.2.2=pyhdfd78af_0"

requirements:
  - class: InlineJavascriptRequirement

inputs:
  work_directory:
    type: string
    doc: |
      name of output/work directory
    inputBinding:
      position: 1
    default: "drep_out"

  genomes:
    type: File[]
    doc: |
      genomes to filter in .fasta format
    inputBinding:
      position: 2
      prefix: --genomes

outputs:
  output_directory:
    type: Directory
    outputBinding:
      glob: $(runtime.outdir)/$(inputs.work_directory)

baseCommand:
  - dRep
  - dereplicate 

And I have this error :

[cwltool] 'dRep' not found: [Errno 2] No such file or directory: 'dRep'
[...]
[toil.worker] Exiting the worker because of a failed job on host zonda20.plafrim.cluster

┆Issue is synchronized with this Jira Task ┆Issue Number: TOIL-1032

Issue Analytics

  • State:closed
  • Created 2 years ago
  • Comments:5 (3 by maintainers)

github_iconTop GitHub Comments

1reaction
mr-ccommented, Sep 27, 2021

Glad to hear it @AriBad !

0reactions
AriBadcommented, Sep 27, 2021

Thanks very much. Now it’s work and it take into account the requirements. Thank you !

Read more comments on GitHub >

github_iconTop Results From Across the Web

Create conda package · Issue #138 - GitHub
The cwltool package has a dependency on cwl-utils that's not published, so I think conda is handling the missing conda packages via pip...
Read more >
Dependency Resolution - galaxy-lib's documentation!
The conda directive can be used to configure a conda dependency resolver. ... Galaxy will look for and install missing tool dependencies before...
Read more >
Conda for Tool Dependencies - Galaxy Documentation
With release 16.04, Galaxy has enabled Conda dependency resolution by default when Conda was already installed on the system.
Read more >
Tips & tricks — conda-forge 2022.12.16 documentation
That happens because either the correct version of icu , or any other package in the error, is not present or the package...
Read more >
Conda and BioConda · BioExcel Best Practice Guide
In CWL, Conda dependencies are identified by their URL in a https://anaconda.org/ channel - which typically should be one of: https://anaconda.org/conda- ...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found