Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Modify tacticSources

See original GitHub issue

With trtexec I need to add --tacticSources=-cublasLt,+cublas to compile my model, or else I get:

[TensorRT] INTERNAL ERROR: Assertion failed: cublasStatus == CUBLAS_STATUS_SUCCESS

How can I do this in torch2trt?

Issue Analytics

State:
Created 3 years ago
Reactions:1
Comments:5 (1 by maintainers)

Top GitHub Comments

1reaction

jaybdubcommented, Feb 28, 2021

Hi @austinmw ,

Thanks for reaching out!

Currently this isn’t exposed, but it seems like a relatively straightforward feature for us to add. Particularly, after the following PR for DLA support is merged, torch2trt will use a builder config, so I can just pass an extra argument.

https://github.com/NVIDIA-AI-IOT/torch2trt/pull/507

I will try to notify you here of any updates, or if I discover anything along way.

Best, John

0reactions

azurylcommented, Jan 19, 2022

With trtexec I need to add --tacticSources=-cublasLt,+cublas to compile my model, or else I get:

[TensorRT] INTERNAL ERROR: Assertion failed: cublasStatus == CUBLAS_STATUS_SUCCESS

How can I do this in torch2trt? @austinmw config = builder.create_builder_config() config.set_tactic_sources(1 << int(trt.TacticSource.CUBLAS))

Top Results From Across the Web

IBuilderConfig — NVIDIA TensorRT Standard Python API ...

Tactic sources that can provide tactics for TensorRT. ... library tactics without having to modify their application's plugins to support nullptr handles.

TacticSource Pricing, Alternatives & More 2022 - Capterra

With the help of Capterra, learn about TacticSource, its features, pricing information, popular comparisons to other Procurement products and more.

Top 10 TacticSource Alternatives 2022 - G2

Find the top-ranking alternatives to TacticSource based on 1750 verified user reviews. Read reviews and product information about SAP Ariba, RFP360, ...

TensorRT: nvinfer1::IBuilderConfig Class Reference

Returns true if the quantization flag is set. More... virtual bool, setTacticSources (TacticSources tacticSources)=0. Set tactic sources. More...

TacticSource e-Tender System Supplier User Guide v2.3

The setting will not affect your bidding currency in each RFX which is preset by the buyer. Administration. You can change your company...