Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Consider Supporting Size() engine function for Complex Types

See original GitHub issue

Dynamically sizing HDD & SDD sizes is a great feature about WDL + Cromwell that gives you cost savings in certain cloud environments. A current limitation is that you cannot call size on an Array[File] type or Array[Array[....[File]..]] Types, which forces you to either guess the required disk size, or build logic into your workflow upstream for determining file sizes.

Some practical considerations:

Arrays can have an arbitrary size causing a large number of calls to an engine function / API
Would an Iterator function be a more generalizable solution?
Would we restrict this to Arrays or should it be callable on all File Types, ie Map[String,File],Pair[File,File] etc

Issue Analytics

State:
Created 6 years ago
Reactions:1
Comments:8 (6 by maintainers)

Top GitHub Comments

1reaction

patmageecommented, Oct 24, 2017

@dheiman ceil was recently added as a standard engine function. see documentation here: https://github.com/openwdl/wdl/blob/master/versions/draft-2/SPEC.md#int-floorfloat-int-ceilfloat-and-int-roundfloat

0reactions

cjllanwarnecommented, Jul 5, 2018

I believe this was addressed in https://github.com/openwdl/wdl/pull/169 - can we close this issue?

Top Results From Across the Web

Data types | BigQuery - Google Cloud

Use the following table to see the size in logical bytes for each supported data type. Data type, Size. ARRAY, The sum of...

11.7 Data Type Storage Requirements

The LENGTH() function returns the space in bytes required for value storage. For descriptions of WKB and internal storage formats for spatial values,...

Data types in Power BI Desktop - Microsoft Learn

In this article. Determine and specify a column's data type; Implicit and explicit data type conversion in DAX formulas; Next steps.

JavaScript data types and data structures - MDN Web Docs

This technique should only be considered when it is the last measure that can be taken to optimize size. BigInt type. The BigInt...

Data Types - Alteryx Help

Alteryx processes values based on the data type. Alteryx supports string, numeric, date-time, and boolean data types, as well as, ...