a problem of "unable to open any HCA ports" when upcrun a program

From: 卢兴敬 (luxingjing_at_ict.ac.cn)
Date: Wed Oct 29 2008 - 01:12:44 PST

  • Next message: Paul H. Hargrove: "Re: a problem of "unable to open any HCA ports" when upcrun a program"
    Hi,
    
      When I upcrun –n 4 hello, I encountered a problem as below:
    
    autopar@gnode5:~/lxj/test> upcrun -N 4 -n 32 hello
    
    GASNet gasnetc_init returning an error code: GASNET_ERR_RESOURCE (Problem
    with requested resource)
    
      at
    /bwdata/autopar/berkeley_upc-2.6.0/gasnet/vapi-conduit/gasnet_core.c:986
    
      reason: unable to open any HCA ports
    
    -----------------------------------------------------------------------
    
    And when I install upc-infiniband version, all the other network such as mpi
    smp udp wsa disabled. The diagram below shows more information
    
    About my upc.
    
     
    
    And in my upc_infiniban.sh I set as follow:
    
     
    
    export UPC_NODES="12.11.11.5 node5 node6 node7 node8"
    
    export GASNET_SSH_SERVERS="12.11.11.5 node8 node5 node7 node6"
    
    export
    LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/home/autopar/mpich2/lib:/home/autopar/upc_
    infiniband/dbg/lib:/home/autopar/upc_infiniband/opt/lib
    
    export SSH_CMD=rsh
    
    export GASNET_VAPI_SPAWNER=ssh
    
    export PATH=/home/autopar/upc_infiniband/bin:/home/autopar/mpich2/bin:$PATH
    
    --------------------
    
    Wish your reply.
    
     
    
     
    
    This is upcc (the Berkeley Unified Parallel C compiler), v. 2.6.0
    
    ----------------------+-----------------------------------------------------
    ----
    
     UPC Runtime          | v. 2.6.0, built on Oct 29 2008 at 15:06:48
    
    ----------------------+-----------------------------------------------------
    ----
    
     UPC-to-C translator  | v. 2.6.0, built on Oct 20 2008 at 16:11:36
    
    ----------------------+-----------------------------------------------------
    ----
    
     Translator location  | /home/autopar/upc_translator/targ
    
    ----------------------+-----------------------------------------------------
    ----
    
     networks supported   | vapi
    
    ----------------------+-----------------------------------------------------
    ----
    
     default network      | vapi
    
    ----------------------+-----------------------------------------------------
    ----
    
     pthreads support     | available (if used, default is 2 pthreads per
    process)
    
    ----------------------+-----------------------------------------------------
    ----
    
     Configured with      |
    '--with-translator=http://upc-translator.lbl.gov/upcc-2
    
                          | .6.0.cgi' 'CC=gcc' 'CXX=g++' '--without-mpi-cc'
    
                          | '--disable-mpi' '--disable-udp' '--disable-smp'
    
                          | '--prefix=/home/autopar/upc_infiniband/opt'
    
                          | '--with-multiconf-magic=opt'
    
    ----------------------+-----------------------------------------------------
    ----
    
     Configure features   | berkeleyupc,upcr,gasnet,upc_collective,upc_io,
    
                          | upc_memcpy_async,upc_ptradd,upc_thread_distance,
    
                          | upc_tick,upc_sem,upc_dump_shared,upc_trace_printf,
    
                          | upc_trace_mask,upc_local_to_shared,upc_atomics,pupc,
    
                          | upc_memcpy_vis,nodebug,notrace,nostats,nogasp,
    
                          | segment_fast,os_linux,cpu_x86_64,cpu_64,cc_gnu,
    
                          | packedsptr
    
    ----------------------+-----------------------------------------------------
    ----
    
     Configure id         | gnode20 Wed Oct 29 14:36:24 CST 2008 autopar
    
    ----------------------+-----------------------------------------------------
    ----
    
     Binary interface     | 64-bit x86_64-unknown-linux-gnu
    
    ----------------------+-----------------------------------------------------
    ----
    
     Runtime interface #  | Runtime supports 3.0 -> 3.9: Translator uses 3.6
    
    ----------------------+-----------------------------------------------------
    ----
    
                          |  --- BACKEND SETTINGS (for vapi network) ---
    
    ----------------------+-----------------------------------------------------
    ----
    
     C compiler           | /usr/bin/gcc
    
                          |   GNU/3.3.3/3.3.3 (SuSE Linux)
    
                          |   gcc version 3.3.3 (SuSE Linux)
    
                          |   Reading specs from
    
                          |   /usr/lib64/gcc-lib/x86_64-suse-linux/3.3.3/specs
    
                          |   Configured with: ../configure
    --enable-threads=posix
    
                          |   --prefix=/usr --with-local-prefix=/usr/local
    
                          |   --infodir=/usr/share/info --mandir=/usr/share/man
    
                          |   --enable-languages=c,c++,f77,objc,java,ada
    
                          |   --disable-checking --libdir=/usr/lib64
    
                          |   --enable-libgcj
    
                          |   --with-gxx-include-dir=/usr/include/g++
    
                          |   --with-slibdir=/lib64 --with-system-zlib
    
                          |   --enable-shared --enable-__cxa_atexit
    
                          |   x86_64-suse-linux
    
    ----------------------+-----------------------------------------------------
    ----
    
     C compiler flags     | -O3 --param max-inline-insns-single=35000 --param
    
                          | max-inline-insns=100000 --param
    
                          | inline-unit-growth=10000 --param
    
                          | large-function-growth=200000 -Winline
    
    ----------------------+-----------------------------------------------------
    ----
    
     linker               | /usr/bin/gcc
    
                          |   GNU/3.3.3/3.3.3 (SuSE Linux)
    
                          |   gcc version 3.3.3 (SuSE Linux)
    
                          |   Reading specs from
    
                          |   /usr/lib64/gcc-lib/x86_64-suse-linux/3.3.3/specs
    
                          |   Configured with: ../configure
    --enable-threads=posix
    
                          |   --prefix=/usr --with-local-prefix=/usr/local
    
                          |   --infodir=/usr/share/info --mandir=/usr/share/man
    
                          |   --enable-languages=c,c++,f77,objc,java,ada
    
                          |   --disable-checking --libdir=/usr/lib64
    
                          |   --enable-libgcj
    
                          |   --with-gxx-include-dir=/usr/include/g++
    
                          |   --with-slibdir=/lib64 --with-system-zlib
    
                          |   --enable-shared --enable-__cxa_atexit
    
                          |   x86_64-suse-linux
    
    ----------------------+-----------------------------------------------------
    ----
    
     linker flags         | -O3 --param max-inline-insns-single=35000 --param
    
                          | max-inline-insns=100000 --param
    
                          | inline-unit-growth=10000 --param
    
                          | large-function-growth=200000 -Winline
    
                          | -L/home/autopar/upc_infiniband/opt/lib
    -lupcr-vapi-seq
    
                          | -lumalloc -L/home/autopar/upc_infiniband/opt/lib
    
                          | -L/usr/local/ibgd/driver/infinihost/lib64
    
                          | -lgasnet-vapi-seq -lvapi -lmtl_common -lmosal -lmpga
    
                          | -lpthread
    -L/usr/lib64/gcc-lib/x86_64-suse-linux/3.3.3
    
                          | -lgcc -lm
    
    ----------------------+-----------------------------------------------------
    ----
    

  • Next message: Paul H. Hargrove: "Re: a problem of "unable to open any HCA ports" when upcrun a program"