question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

The mpi4py problem

See original GitHub issue

Hi, nice work. I am really interested in your work, and new to semantic segmentation. When I run the code torchpack dist-run -np 1 python train.py configs/semantic_kitti/spvcnn/cr0p5.yaml the system return this: `Synopsis: mpirun [options] <app> mpirun [options] <where> <program> [<prog args>]

Description: Start an MPI application in LAM/MPI.

Notes: [options] Zero or more of the options listed below <app> LAM/MPI appschema <where> List of LAM nodes and/or CPUs (examples below) <program> Must be a LAM/MPI program that either invokes MPI_INIT or has exactly one of its children invoke MPI_INIT <prog args> Optional list of command line arguments to <program>

Options: -c <num> Run <num> copies of <program> (same as -np) -client <rank> <host>:<port> Run IMPI job; connect to the IMPI server <host> at port <port> as IMPI client number <rank> -D Change current working directory of new processes to the directory where the executable resides -f Do not open stdio descriptors -ger Turn on GER mode -h Print this help message -l Force line-buffered output -lamd Use LAM daemon (LAMD) mode (opposite of -c2c) -nger Turn off GER mode -np <num> Run <num> copies of <program> (same as -c) -nx Don’t export LAM_MPI_* environment variables -O Universe is homogeneous -pty / -npty Use/don’t use pseudo terminals when stdout is a tty -s <nodeid> Load <program> from node <nodeid> -sigs / -nsigs Catch/don’t catch signals in MPI application -ssi <n> <arg> Set environment variable LAM_MPI_SSI_<n>=<arg> -toff Enable tracing with generation initially off -ton, -t Enable tracing with generation initially on -tv Launch processes under TotalView Debugger -v Be verbose -w / -nw Wait/don’t wait for application to complete -wd <dir> Change current working directory of new processes to <dir> -x <envlist> Export environment vars in <envlist>

Nodes: n<list>, e.g., n0-3,5 CPUS: c<list>, e.g., c0-3,5 Extras: h (local node), o (origin node), N (all nodes), C (all CPUs)

Examples: mpirun n0-7 prog1 Executes “prog1” on nodes 0 through 7.

            mpirun -lamd -x FOO=bar,DISPLAY N prog2
            Executes "prog2" on all nodes using the LAMD RPI.  
            In the environment of each process, set FOO to the value
            "bar", and set DISPLAY to the current value.

            mpirun n0 N prog3
            Run "prog3" on node 0, *and* all nodes.  This executes *2*
            copies on n0.

            mpirun C prog4 arg1 arg2
            Run "prog4" on each available CPU with command line
            arguments of "arg1" and "arg2".  If each node has a
            CPU count of 1, the "C" is equivalent to "N".  If at
            least one node has a CPU count greater than 1, LAM
            will run neighboring ranks of MPI_COMM_WORLD on that
            node.  For example, if node 0 has a CPU count of 4 and
            node 1 has a CPU count of 2, "prog4" will have
            MPI_COMM_WORLD ranks 0 through 3 on n0, and ranks 4
            and 5 on n1.

            mpirun c0 C prog5
            Similar to the "prog3" example above, this runs "prog5"
            on CPU 0 *and* on each available CPU.  This executes
            *2* copies on the node where CPU 0 is (i.e., n0).
            This is probably not a useful use of the "C" notation;
            it is only shown here for an example.

Defaults: -c2c -w -pty -nger -nsigs

And when I install mpi4py, and then run the code above, the system return:[mpiexec@eyre-MS-7C35] match_arg (utils/args/args.c:163): unrecognized argument allow-run-as-root [mpiexec@eyre-MS-7C35] HYDU_parse_array (utils/args/args.c:178): argument matching returned error [mpiexec@eyre-MS-7C35] parse_args (ui/mpich/utils.c:1642): error parsing input array [mpiexec@eyre-MS-7C35] HYD_uii_mpx_get_parameters (ui/mpich/utils.c:1694): unable to parse user arguments [mpiexec@eyre-MS-7C35] main (ui/mpich/mpiexec.c:148): error parsing parameters ` Also, I am wandering where is the ‘dataset’ folder located?

Issue Analytics

  • State:closed
  • Created 3 years ago
  • Comments:10 (5 by maintainers)

github_iconTop GitHub Comments

4reactions
CoolLoveBoycommented, Nov 9, 2020

I have the same question, what can I do to solve the problem? [mpiexec@AcerNitro] match_arg (utils/args/args.c:163): unrecognized argument allow-run-as-root [mpiexec@AcerNitro] HYDU_parse_array (utils/args/args.c:178): argument matching returned error [mpiexec@AcerNitro] parse_args (ui/mpich/utils.c:1642): error parsing input array [mpiexec@AcerNitro] HYD_uii_mpx_get_parameters (ui/mpich/utils.c:1694): unable to parse user arguments [mpiexec@AcerNitro] main (ui/mpich/mpiexec.c:148): error parsing parameters

1reaction
zhijian-liucommented, Dec 10, 2021

You may follow the instructions at https://www.open-mpi.org/faq/?category=building to install OpenMPI from source.

Read more comments on GitHub >

github_iconTop Results From Across the Web

Error when installing mpi4py - python - Stack Overflow
As the error says, there are libraries missing. I solved it by installing libopenmpi-dev package sudo apt-get install libopenmpi-dev.
Read more >
Cannot `pip install mpi4py` with conda - Bitbucket
I have a problem installing mpi4py with pip inside of a conda environment. I have created a conda environment and tried installing mpi4py...
Read more >
Installation — MPI for Python 3.1.4 documentation
A working MPI implementation, preferably supporting MPI-3 and built with shared/dynamic libraries. ... env MPICC=/path/to/mpicc python -m pip install mpi4py.
Read more >
How to install the mpi4py package ? | Data Science ... - Kaggle
Hello everyone,. I am using kaggle for the first time and I need to install the mpi4py package. I used : !pip install...
Read more >
Re: [AMBER] mpi4py Problem from Ilyas Yildirim on 2022-02 ...
Re: [AMBER] mpi4py Problem. This message : [ Message body ] [ More options (top, bottom) ]; Related messages : [ Next ...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found