From: Paul H. Hargrove (PHHargrove_at_lbl_dot_gov)
Date: Wed Oct 29 2008 - 12:25:50 PST
This error indicates that one or more It is possible that the InfiniBand hardware and/or software has not been setup on one or more nodes. You should see the message you quote once for each failing attempt. If you see less than 32 instances, then it is possible that at least one node does have a working InfiniBand configuration. On each of the machines in you UPC_NODES, try running the "vstat" utility to see if it reports at least one "PORT_ACTIVE" line on each. It is also possible, that the InfiniBand libraries are present but there is no hardware at all. -Paul ¬�˾� wrote: > > Hi, > > When I upcrun �Cn 4 hello, I encountered a problem as below: > > autopar@gnode5:~/lxj/test> upcrun -N 4 -n 32 hello > > GASNet gasnetc_init returning an error code: GASNET_ERR_RESOURCE > (Problem with requested resource) > > at > /bwdata/autopar/berkeley_upc-2.6.0/gasnet/vapi-conduit/gasnet_core.c:986 > > reason: unable to open any HCA ports > > ----------------------------------------------------------------------- > > And when I install upc-infiniband version, all the other network such > as mpi smp udp wsa disabled. The diagram below shows more information > > About my upc. > > And in my upc_infiniban.sh I set as follow: > > export UPC_NODES="12.11.11.5 node5 node6 node7 node8" > > export GASNET_SSH_SERVERS="12.11.11.5 node8 node5 node7 node6" > > export > LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/home/autopar/mpich2/lib:/home/autopar/upc_infiniband/dbg/lib:/home/autopar/upc_infiniband/opt/lib > > export SSH_CMD=rsh > > export GASNET_VAPI_SPAWNER=ssh > > export > PATH=/home/autopar/upc_infiniband/bin:/home/autopar/mpich2/bin:$PATH > > -------------------- > > Wish your reply. > > This is upcc (the Berkeley Unified Parallel C compiler), v. 2.6.0 > > ----------------------+--------------------------------------------------------- > > UPC Runtime | v. 2.6.0, built on Oct 29 2008 at 15:06:48 > > ----------------------+--------------------------------------------------------- > > UPC-to-C translator | v. 2.6.0, built on Oct 20 2008 at 16:11:36 > > ----------------------+--------------------------------------------------------- > > Translator location | /home/autopar/upc_translator/targ > > ----------------------+--------------------------------------------------------- > > networks supported | vapi > > ----------------------+--------------------------------------------------------- > > default network | vapi > > ----------------------+--------------------------------------------------------- > > pthreads support | available (if used, default is 2 pthreads per process) > > ----------------------+--------------------------------------------------------- > > Configured with | '--with-translator=http://upc-translator.lbl.gov/upcc-2 > > | .6.0.cgi' 'CC=gcc' 'CXX=g++' '--without-mpi-cc' > > | '--disable-mpi' '--disable-udp' '--disable-smp' > > | '--prefix=/home/autopar/upc_infiniband/opt' > > | '--with-multiconf-magic=opt' > > ----------------------+--------------------------------------------------------- > > Configure features | berkeleyupc,upcr,gasnet,upc_collective,upc_io, > > | upc_memcpy_async,upc_ptradd,upc_thread_distance, > > | upc_tick,upc_sem,upc_dump_shared,upc_trace_printf, > > | upc_trace_mask,upc_local_to_shared,upc_atomics,pupc, > > | upc_memcpy_vis,nodebug,notrace,nostats,nogasp, > > | segment_fast,os_linux,cpu_x86_64,cpu_64,cc_gnu, > > | packedsptr > > ----------------------+--------------------------------------------------------- > > Configure id | gnode20 Wed Oct 29 14:36:24 CST 2008 autopar > > ----------------------+--------------------------------------------------------- > > Binary interface | 64-bit x86_64-unknown-linux-gnu > > ----------------------+--------------------------------------------------------- > > Runtime interface # | Runtime supports 3.0 -> 3.9: Translator uses 3.6 > > ----------------------+--------------------------------------------------------- > > | --- BACKEND SETTINGS (for vapi network) --- > > ----------------------+--------------------------------------------------------- > > C compiler | /usr/bin/gcc > > | GNU/3.3.3/3.3.3 (SuSE Linux) > > | gcc version 3.3.3 (SuSE Linux) > > | Reading specs from > > | /usr/lib64/gcc-lib/x86_64-suse-linux/3.3.3/specs > > | Configured with: ../configure --enable-threads=posix > > | --prefix=/usr --with-local-prefix=/usr/local > > | --infodir=/usr/share/info --mandir=/usr/share/man > > | --enable-languages=c,c++,f77,objc,java,ada > > | --disable-checking --libdir=/usr/lib64 > > | --enable-libgcj > > | --with-gxx-include-dir=/usr/include/g++ > > | --with-slibdir=/lib64 --with-system-zlib > > | --enable-shared --enable-__cxa_atexit > > | x86_64-suse-linux > > ----------------------+--------------------------------------------------------- > > C compiler flags | -O3 --param max-inline-insns-single=35000 --param > > | max-inline-insns=100000 --param > > | inline-unit-growth=10000 --param > > | large-function-growth=200000 -Winline > > ----------------------+--------------------------------------------------------- > > linker | /usr/bin/gcc > > | GNU/3.3.3/3.3.3 (SuSE Linux) > > | gcc version 3.3.3 (SuSE Linux) > > | Reading specs from > > | /usr/lib64/gcc-lib/x86_64-suse-linux/3.3.3/specs > > | Configured with: ../configure --enable-threads=posix > > | --prefix=/usr --with-local-prefix=/usr/local > > | --infodir=/usr/share/info --mandir=/usr/share/man > > | --enable-languages=c,c++,f77,objc,java,ada > > | --disable-checking --libdir=/usr/lib64 > > | --enable-libgcj > > | --with-gxx-include-dir=/usr/include/g++ > > | --with-slibdir=/lib64 --with-system-zlib > > | --enable-shared --enable-__cxa_atexit > > | x86_64-suse-linux > > ----------------------+--------------------------------------------------------- > > linker flags | -O3 --param max-inline-insns-single=35000 --param > > | max-inline-insns=100000 --param > > | inline-unit-growth=10000 --param > > | large-function-growth=200000 -Winline > > | -L/home/autopar/upc_infiniband/opt/lib -lupcr-vapi-seq > > | -lumalloc -L/home/autopar/upc_infiniband/opt/lib > > | -L/usr/local/ibgd/driver/infinihost/lib64 > > | -lgasnet-vapi-seq -lvapi -lmtl_common -lmosal -lmpga > > | -lpthread -L/usr/lib64/gcc-lib/x86_64-suse-linux/3.3.3 > > | -lgcc -lm > > ----------------------+--------------------------------------------------------- > -- Paul H. Hargrove PHHargrove_at_lbl_dot_gov Future Technologies Group HPC Research Department Tel: +1-510-495-2352 Lawrence Berkeley National Laboratory Fax: +1-510-486-6900