Re: a problem of "unable to open any HCA ports" when upcrun a program

From: Paul H. Hargrove (PHHargrove_at_lbl_dot_gov)
Date: Wed Oct 29 2008 - 12:25:50 PST

  • Next message: ¬�˾�: "RE: a problem of "unable to open any HCA ports" when upcrun a program"
    This error indicates that one or more
    
    It is possible that the InfiniBand hardware and/or software has not been
    setup on one or more nodes. You should see the message you quote once
    for each failing attempt. If you see less than 32 instances, then it is
    possible that at least one node does have a working InfiniBand
    configuration.
    
    On each of the machines in you UPC_NODES, try running the "vstat"
    utility to see if it reports at least one "PORT_ACTIVE" line on each.
    
    It is also possible, that the InfiniBand libraries are present but there
    is no hardware at all.
    
    -Paul
    
    ¬�˾� wrote:
    >
    > Hi,
    >
    > When I upcrun �Cn 4 hello, I encountered a problem as below:
    >
    > autopar@gnode5:~/lxj/test> upcrun -N 4 -n 32 hello
    >
    > GASNet gasnetc_init returning an error code: GASNET_ERR_RESOURCE
    > (Problem with requested resource)
    >
    > at
    > /bwdata/autopar/berkeley_upc-2.6.0/gasnet/vapi-conduit/gasnet_core.c:986
    >
    > reason: unable to open any HCA ports
    >
    > -----------------------------------------------------------------------
    >
    > And when I install upc-infiniband version, all the other network such
    > as mpi smp udp wsa disabled. The diagram below shows more information
    >
    > About my upc.
    >
    > And in my upc_infiniban.sh I set as follow:
    >
    > export UPC_NODES="12.11.11.5 node5 node6 node7 node8"
    >
    > export GASNET_SSH_SERVERS="12.11.11.5 node8 node5 node7 node6"
    >
    > export
    > LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/home/autopar/mpich2/lib:/home/autopar/upc_infiniband/dbg/lib:/home/autopar/upc_infiniband/opt/lib
    >
    > export SSH_CMD=rsh
    >
    > export GASNET_VAPI_SPAWNER=ssh
    >
    > export
    > PATH=/home/autopar/upc_infiniband/bin:/home/autopar/mpich2/bin:$PATH
    >
    > --------------------
    >
    > Wish your reply.
    >
    > This is upcc (the Berkeley Unified Parallel C compiler), v. 2.6.0
    >
    > ----------------------+---------------------------------------------------------
    >
    > UPC Runtime | v. 2.6.0, built on Oct 29 2008 at 15:06:48
    >
    > ----------------------+---------------------------------------------------------
    >
    > UPC-to-C translator | v. 2.6.0, built on Oct 20 2008 at 16:11:36
    >
    > ----------------------+---------------------------------------------------------
    >
    > Translator location | /home/autopar/upc_translator/targ
    >
    > ----------------------+---------------------------------------------------------
    >
    > networks supported | vapi
    >
    > ----------------------+---------------------------------------------------------
    >
    > default network | vapi
    >
    > ----------------------+---------------------------------------------------------
    >
    > pthreads support | available (if used, default is 2 pthreads per process)
    >
    > ----------------------+---------------------------------------------------------
    >
    > Configured with | '--with-translator=http://upc-translator.lbl.gov/upcc-2
    >
    > | .6.0.cgi' 'CC=gcc' 'CXX=g++' '--without-mpi-cc'
    >
    > | '--disable-mpi' '--disable-udp' '--disable-smp'
    >
    > | '--prefix=/home/autopar/upc_infiniband/opt'
    >
    > | '--with-multiconf-magic=opt'
    >
    > ----------------------+---------------------------------------------------------
    >
    > Configure features | berkeleyupc,upcr,gasnet,upc_collective,upc_io,
    >
    > | upc_memcpy_async,upc_ptradd,upc_thread_distance,
    >
    > | upc_tick,upc_sem,upc_dump_shared,upc_trace_printf,
    >
    > | upc_trace_mask,upc_local_to_shared,upc_atomics,pupc,
    >
    > | upc_memcpy_vis,nodebug,notrace,nostats,nogasp,
    >
    > | segment_fast,os_linux,cpu_x86_64,cpu_64,cc_gnu,
    >
    > | packedsptr
    >
    > ----------------------+---------------------------------------------------------
    >
    > Configure id | gnode20 Wed Oct 29 14:36:24 CST 2008 autopar
    >
    > ----------------------+---------------------------------------------------------
    >
    > Binary interface | 64-bit x86_64-unknown-linux-gnu
    >
    > ----------------------+---------------------------------------------------------
    >
    > Runtime interface # | Runtime supports 3.0 -> 3.9: Translator uses 3.6
    >
    > ----------------------+---------------------------------------------------------
    >
    > | --- BACKEND SETTINGS (for vapi network) ---
    >
    > ----------------------+---------------------------------------------------------
    >
    > C compiler | /usr/bin/gcc
    >
    > | GNU/3.3.3/3.3.3 (SuSE Linux)
    >
    > | gcc version 3.3.3 (SuSE Linux)
    >
    > | Reading specs from
    >
    > | /usr/lib64/gcc-lib/x86_64-suse-linux/3.3.3/specs
    >
    > | Configured with: ../configure --enable-threads=posix
    >
    > | --prefix=/usr --with-local-prefix=/usr/local
    >
    > | --infodir=/usr/share/info --mandir=/usr/share/man
    >
    > | --enable-languages=c,c++,f77,objc,java,ada
    >
    > | --disable-checking --libdir=/usr/lib64
    >
    > | --enable-libgcj
    >
    > | --with-gxx-include-dir=/usr/include/g++
    >
    > | --with-slibdir=/lib64 --with-system-zlib
    >
    > | --enable-shared --enable-__cxa_atexit
    >
    > | x86_64-suse-linux
    >
    > ----------------------+---------------------------------------------------------
    >
    > C compiler flags | -O3 --param max-inline-insns-single=35000 --param
    >
    > | max-inline-insns=100000 --param
    >
    > | inline-unit-growth=10000 --param
    >
    > | large-function-growth=200000 -Winline
    >
    > ----------------------+---------------------------------------------------------
    >
    > linker | /usr/bin/gcc
    >
    > | GNU/3.3.3/3.3.3 (SuSE Linux)
    >
    > | gcc version 3.3.3 (SuSE Linux)
    >
    > | Reading specs from
    >
    > | /usr/lib64/gcc-lib/x86_64-suse-linux/3.3.3/specs
    >
    > | Configured with: ../configure --enable-threads=posix
    >
    > | --prefix=/usr --with-local-prefix=/usr/local
    >
    > | --infodir=/usr/share/info --mandir=/usr/share/man
    >
    > | --enable-languages=c,c++,f77,objc,java,ada
    >
    > | --disable-checking --libdir=/usr/lib64
    >
    > | --enable-libgcj
    >
    > | --with-gxx-include-dir=/usr/include/g++
    >
    > | --with-slibdir=/lib64 --with-system-zlib
    >
    > | --enable-shared --enable-__cxa_atexit
    >
    > | x86_64-suse-linux
    >
    > ----------------------+---------------------------------------------------------
    >
    > linker flags | -O3 --param max-inline-insns-single=35000 --param
    >
    > | max-inline-insns=100000 --param
    >
    > | inline-unit-growth=10000 --param
    >
    > | large-function-growth=200000 -Winline
    >
    > | -L/home/autopar/upc_infiniband/opt/lib -lupcr-vapi-seq
    >
    > | -lumalloc -L/home/autopar/upc_infiniband/opt/lib
    >
    > | -L/usr/local/ibgd/driver/infinihost/lib64
    >
    > | -lgasnet-vapi-seq -lvapi -lmtl_common -lmosal -lmpga
    >
    > | -lpthread -L/usr/lib64/gcc-lib/x86_64-suse-linux/3.3.3
    >
    > | -lgcc -lm
    >
    > ----------------------+---------------------------------------------------------
    >
    
    
    -- 
    Paul H. Hargrove                          PHHargrove_at_lbl_dot_gov
    Future Technologies Group
    HPC Research Department                   Tel: +1-510-495-2352
    Lawrence Berkeley National Laboratory     Fax: +1-510-486-6900
    

  • Next message: ¬�˾�: "RE: a problem of "unable to open any HCA ports" when upcrun a program"