Quick start out of date

Hi folks.

I’m trying to run the quick start instructions https://github.com/triton-inference-server/model_analyzer/blob/main/docs/quick_start.md

I have successfully installed triton server and the model_analyzer from the docker file

But I’m getting an error at this step

$ model-analyzer -m /quick_start_repository -n add_sub --triton-launch-mode=local --export-path=analysis_results

Where the error looks like

2021-04-30 22:06:37.785 INFO[client.py:82] Model add_sub_i34 load failed: [StatusCode.UNAVAILABLE] explicit model load / unload is not allowed if polling is enabled 2021-04-30 22:06:37.785 INFO[analyzer_state_manager.py:140] Saved checkpoint to analysis_results/checkpoints/0.ckpt.

And then finally fails at this step

File "/usr/local/bin/model-analyzer", line 8, in <module> sys.exit(main()) File "/usr/local/lib/python3.8/dist-packages/model_analyzer/entrypoint.py", line 233, in main analyzer.run() File "/usr/local/lib/python3.8/dist-packages/model_analyzer/analyzer.py", line 116, in run self._result_manager.collect_and_sort_results( File "/usr/local/lib/python3.8/dist-packages/model_analyzer/result/result_manager.py", line 309, in collect_and_sort_results result_dict = results[model_name] KeyError: 'add_sub'

analysis_results/ and output_model_repository seem to be correctly filled out with directories for the results and variationss of add_sub respectively

Here is the full log error https://gist.github.com/msaroufim/912ab9a5ae17b5ed444bf790ead0612e

[msaroufim]

It’s working! So I was working with Triton 21.04 on K80 but when I switched over to a V100 everything started working.

I found p3.2xlarge available on AWS today - that p3.8x shortage 😢

[aramesh7]

Yes, we have updated the interface for the upcoming 21.05 release. We will be updating the docs today and next week. Sorry for the confusion. You can try

$ model-analyzer profile -m /quick_start_repository --profile-models add_sub
.
.
.
$ model-analyzer analyze --analysis-models add_sub -e analysis_results