TopK operator spec ambiguity

Hello all,

The current TopK operator is unclear as to whether the value of k can be larger than the total number of elements in a particular axis and if so can a backend still proceed with the operation by performing k = min(k, number_of_elements) or if it has to strictly expect that the number of elements be greater than or equal to k.

We propose going with k = min(k, number_of_elements) approach (and clarifying this in the spec) as sometimes the caller doesn’t know the exact number of elements in an axis (number of objects detected for example) and k itself is usually configured to be a specific value.

Any input will be appreciated. Thanks!

CC: @jiafatom

[jiafatom]

I don’t prefer padding inside TopK, because padding does change TopK behavior. Generally the model owner will add padding after TopK.

[hariharans29]

@wschin - I see your concern. Thanks for elaborating.