Allocate temp buffer for tensorize
See original GitHub issueAs the example below:
produce B {
for (i, 0, 12) {
B[i] = 0.000000f
for (k.outer, 0, 16) {
for (k.inner, 0, 4) {
B[i] = (B[i] + A[((((i*16) + k.outer)*4) + k.inner)])
}
}
}
}
The number of elements in vector instruction is fixed, like 4. If we want to tensorize the k.inner, we need to allocate a extra buffer to store the intermediate result, or else it would be overwritten. Here may be what we expect:
produce B {
for (i, 0, 12) {
B[i] = 0.000000f
for (k.outer, 0, 16) {
tmp = intrinsic("summation", A)
B[i] = B[i] + tmp
}
}
}
So is there any way to allocate buffer for intermediate result?
Issue Analytics
- State:
- Created 6 years ago
- Comments:6 (5 by maintainers)
Top Results From Across the Web
Allocate temp buffer for tensorize #851 - apache/tvm - GitHub
I tried to tensorize the k.inner and the k.outer.v, it failed. The reason is that rfactor move the rfactor_axis to first dimension, and...
Read more >Use Tensorize to Leverage Hardware Intrinsics - Apache TVM
This is an introduction material on how to perform tensorization in TVM. ... "tir.noalias": True} buffers = {A: Buffer(A_2: Pointer(float32), float32, ...
Read more >Allocate the memory buffer - IBM
Allocate the memory buffer. When your program selects simple-large-object data into memory, IBM® Informix® ESQL/C uses a memory buffer.
Read more >Composable and Modular Code Generation in MLIR - arXiv
Temporary buffers may be allocated to ensure contiguous access patterns. “Computational payload” dialects such as.
Read more >BoTorch · Bayesian Optimization in PyTorch
eta (float) – The temperature parameter of the softmax function. ... Both parameters and persistent buffers (e.g. running averages) are included.
Read more >Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start FreeTop Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
Top GitHub Comments
I think we need an factor axis argument which indicate which axis we want to insert the factor dimension
move to https://github.com/dmlc/tvm/issues/867