CWL: missing documentation on conda dependency resolver
See original GitHub issueToil is used to run a pipeline written in cwl on HPC (using the --no-container flag).The pipeline specifies software requirements for some tools and their versions. However, Toil doen’t take into acount this requirements and crashes when running the pipeline. Here is a minimal exemple of the problem:
class: CommandLineTool
cwlVersion: v1.0
doc: ""
hints:
- class: DockerRequirement
dockerPull: quay.io/biocontainers/drep:3.2.2--pyhdfd78af_0
- class: SoftwareRequirement
packages:
drep:
specs:
- https://anaconda.org/bioconda
version:
- "3.2.2=pyhdfd78af_0"
requirements:
- class: InlineJavascriptRequirement
inputs:
work_directory:
type: string
doc: |
name of output/work directory
inputBinding:
position: 1
default: "drep_out"
genomes:
type: File[]
doc: |
genomes to filter in .fasta format
inputBinding:
position: 2
prefix: --genomes
outputs:
output_directory:
type: Directory
outputBinding:
glob: $(runtime.outdir)/$(inputs.work_directory)
baseCommand:
- dRep
- dereplicate
And I have this error :
[cwltool] 'dRep' not found: [Errno 2] No such file or directory: 'dRep'
[...]
[toil.worker] Exiting the worker because of a failed job on host zonda20.plafrim.cluster
┆Issue is synchronized with this Jira Task ┆Issue Number: TOIL-1032
Issue Analytics
- State:
- Created 2 years ago
- Comments:5 (3 by maintainers)
Top Results From Across the Web
Create conda package · Issue #138 - GitHub
The cwltool package has a dependency on cwl-utils that's not published, so I think conda is handling the missing conda packages via pip...
Read more >Dependency Resolution - galaxy-lib's documentation!
The conda directive can be used to configure a conda dependency resolver. ... Galaxy will look for and install missing tool dependencies before...
Read more >Conda for Tool Dependencies - Galaxy Documentation
With release 16.04, Galaxy has enabled Conda dependency resolution by default when Conda was already installed on the system.
Read more >Tips & tricks — conda-forge 2022.12.16 documentation
That happens because either the correct version of icu , or any other package in the error, is not present or the package...
Read more >Conda and BioConda · BioExcel Best Practice Guide
In CWL, Conda dependencies are identified by their URL in a https://anaconda.org/ channel - which typically should be one of: https://anaconda.org/conda- ...
Read more >Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start FreeTop Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
Top GitHub Comments
Glad to hear it @AriBad !
Thanks very much. Now it’s work and it take into account the requirements. Thank you !