Is SeeKeR in interactive chat mode supposed to use gpu?

Hi I just installed SeekeR in a new environment for parlai v1.6.0 and have been testing its response to interactive chat queries. It seems pretty slow and I noticed that it does not appear to be changing the use of gpu memory when I run it. I am using this command…

parlai i -mf zoo:seeker/seeker_dialogue_3B/model -o gen/seeker_dialogue --search-server 127.0.0.1:8080

where the search-server I am running is the same one that I use for blenderbot2. Is there a command option that needs to be set to use the gpu? I am running under Windows 10. Thanks!

[sjscotti]

That fixed it!
But I need to note that with Windows you can’t just do a pip install parlai for a standard install

I needed to make a local copy of the requirements.txt file (I called it requirements-local.txt) where I had to comment out the sh==1.12.14 package to avoid an error (since sh is linux-only) and to change pyzmq==18.1.0 to pyzmq==18.1.1 to avoid an invalid wheel error . Then it is installed as

pip install --no-deps -r requirements-local.txt parlai

But there were still missing packages that I needed to install…

pip install iopath
pip install charset-normalizer
pip install idna
pip install certifi
pip install packaging

before the parlai command would work. There was an installation of torch from the parlai install, but no cudatoolkit, so I also reinstalled pytorch with the toolkits using the command on the pytorch website to be safe.

conda install pytorch torchvision torchaudio cudatoolkit=11.6 -c pytorch -c conda-forge

For good measure, I also installed cudnn, but I don’t know if it is needed.

[klshuster]

Glad that worked, and thank you for the windows install instructions! I’ll go ahead and close this for now but please reopen if there are lingering concerns