Re: UPC on Windows

From: Debabrata Midya (Debabrata.Midya_at_services_dot_nsw_dot_gov.au)
Date: Tue Apr 20 2010 - 17:02:42 PDT

  • Next message: Paul H. Hargrove: "Re: UPC on Windows"
    Paul,
     
    Thank you very much for such a quick response.
     
    Finally, I am able to finish up to make install.
     
    I have some problem to compile hello.upc.
     
    To compile hello.upc, I have issued the following commands:
     
    1. To access hello.upc 
     
    $ cd /cygdrive/d/upc/berkeley_upc-2.10.0/upc-examples
     
    2. To compile
     
    $ /cygdrive/d/upc/bin/upcc -o hello hello.upc
     
    upcc: Error: Can't connect to
    http://upc-translator.lbl.gov/upcc-2.10.0.cgi: Connection timed out
     
    [Note: I have downloaded only berkeley_upc-2.10.0.tar.gz in the
    directory: D:\S-PLUS7\R\Parallel\Berkeley]
     
    Once again, thank you very much for the time you have given.
     
    Regards,
     
    Deb
    
    >>> "Paul H. Hargrove" <PHHargrove@lbl.gov> 20/04/2010 4:09 pm >>>
    Deb,
    
    A:
    
    berkeley_upc-2.10.0 should be the directory created when you ran the 
    "tar" command to unpack the source archive.
    What do you see if you run
      cd /cygdrive/d/upc
      ls
    
    Unless I made a mistake giving the directions, I expect you should see
    
    "build" and "berkeley_upc-2.10.0".
    If you "cd build" then "../berkeley_upc-2.10.0/configure" should refer
    
    to the file "configure" unpacked from the archive.
    
    
    B:
      MPI_CFLAGS has an upper-case "eye"
      MPI_LIBS has a lowercase "ell"
    
    -Paul
    
    Debabrata Midya wrote:
    > Paul,
    >  
    > Thank you very much for such a quick response.
    >  
    > I need your assistance here.
    >  
    > Part A:
    >  
    > I have tried and it has shown an error: bash: 
    > ../berkeley_upc-2.10.0/configure: No such file or directory.
    >  
    > I have tried like this:
    >  
    > 1. $cd build
    >  
    > bash: cd: build: No such file or directory.
    >  
    > 2. $mkdir build
    >  
    > 3. $cd build
    >  
    > 4. The following in one line:
    >  
    > ../berkeley_upc-2.10.0/configure --prefix=/cygdrive/d/upc
    > MPIRUN_CMD='/cygdrive/d/MPICH2/bin/mpiexec -n %N %C'
    > MPI_CC=gcc MPI_CFLAGS=-I/cygdrive/d/MPICH2/include
    > MPI_LIBS='-L/cygdrive/d/MPICH2/lib -lmpi' --enable-mpi
    > bash: ../berkeley_upc-2.10.0/configure: No such file or directory.
    >  
    > Part B:
    >  
    > The third line:
    >  
    > MPI_CC=gcc MPI_CFLAGS=-I/cygdrive/d/MPICH2/include
    > [MPI_CC=gcc MPI_CFLAGS=-I Is it upper case of letter i?]
    >  
    > The fourth line:
    >  
    > MPI_LIBS='-L/cygdrive/d/MPICH2/lib -lmpi' --enable-mpi
    > [MPI_LIBS='-L/cygdrive/d/MPICH2/lib -l Is it upper case of letter
    i?]
    >  
    > Once again, thank you very much for your time.
    >  
    > Regards,
    >  
    > Deb
    >
    > >>> "Paul H. Hargrove" <PHHargrove@lbl.gov> 20/04/2010 5:08 am >>>
    > Deb,
    >   My answers appear below.
    > -Paul
    >
    > Debabrata Midya wrote:
    > > Paul,
    > > 
    > > Thank you very much for such a quick response.
    > > 
    > > 1. I was able to run up to line 4 (out of 5 commands)
    > > 
    > > 2. ../berkeley_upc-2.10.0/configure --prefix=/cygdrive/d/upc
    > > MPIRUN_CMD='mpiexec -n %N %C' --enable-mpi
    > > The problem is here:
    > > 
    > >
    > > checking for /usr/bin/env… /usr/bin/env
    > >
    > > checking for dig… no
    > >
    > > checking for nslookup… /cygdrive/c/WINDOWS/system32/nslookup
    > >
    > > checking for gmake… no
    > >
    > > checking for make… no
    > >
    > > configure: error: cannot find GNU make
    > >
    > > Failed during dbg configure, exit=1
    > > 
    > > 2A: Where can I get GNU make? After getting it, where can I
    install
    > > it? Is it necessary to provide path in the environmental variable
    to
    > > make use of GNU make?
    >
    > GNU Make is another Cygwin package to install.  It should be named
    > either "make" or "gmake".
    >
    >
    > > 
    > > 2B: After installation of GNU make, should I need to run only the
    > > fifth line, i.e.,
    > > 
    > > ../berkeley_upc-2.10.0/configure --prefix=/cygdrive/d/upc
    > > MPIRUN_CMD='mpiexec -n %N %C' --enable-mpi
    > > 
    >
    > Yes, but I did some research and expect that will fail to configure
    MPI
    > support (our defaults are not correct for MPICH2 on Cygwin).
    > I think you'll need the following (all as one line):
    >
    > ../berkeley_upc-2.10.0/configure --prefix=/cygdrive/d/upc
    > MPIRUN_CMD='/cygdrive/d/MPICH2/bin/mpiexec -n %N %C'
    > MPI_CC=gcc MPI_CFLAGS=-I/cygdrive/d/MPICH2/include
    > MPI_LIBS='-L/cygdrive/d/MPICH2/lib -lmpi' --enable-mpi
    >
    > > 3. You have mentioned in your e-mail that "If that all works, then
    > > "make" and "make install" are the next to
    > > commands to run".
    > > 
    > > 3A: Will you please give me an example for it?
    >
    > make
    > make install
    >
    >
    > > 
    > > 3B: How can I run the example code hello.upc?
    >
    > To compile:
    >   upcc -o hello hello.upc
    >
    > To run with 4 UPC threads:
    >   upcrun -n 4 hello
    >
    >
    > > 
    > > Once again, thank you very much for the time you have given.
    > > 
    > > Regards,
    > > 
    > > Deb
    > >
    > > >>> "Paul H. Hargrove" <PHHargrove@lbl.gov> 19/04/2010 12:29 pm
    >>>
    > > Deb,
    > >
    > > Our instructions all a reader who is familiar with a Unix-type
    > > environment.
    > > Some hints that should help:
    > >
    > > + You should be using the Cygwin "bash" shell, not the DOS command
    
    > prompt.
    > > + berkeley_upc-2.10.0.tar.gz is a compressed "tar" archive
    containing
    > > the source code - you need to unpack it
    > > + The "\" at the end of the configure command is a Unix shell thing
    for
    > > continuing a line.  So, if you entered the MPI_CC=... on the same
    line
    > > you might have more success
    > > + MPI_CC is a setting for the MPI compiler, not the mpiexec
    command
    > > (which runs mpi apps), but the default probably works
    > > + You do need a setting for MPIRUN_CMD (which will be a "template"
    that
    > > include mpiexec).
    > > + CC and C++ default to gcc and g++ when they are available
    > > + To install in D:\upc you probably need "--prefix=/cygdrive/d/upc"
    on
    > > the configure command line
    > >
    > > So combining those, you probably want to enter the following five
    > > commands in the Cygwin "bash" shell:
    > >
    > > cd /cygdrive/d/upc
    > > tar xfz 
    > /cygdrive/d/S-PLUS7/R/Parallel/Berkeley/berkeley_upc-2.10.0.tar.gz
    > > mkdir build
    > > cd build
    > > ../berkeley_upc-2.10.0/configure --prefix=/cygdrive/d/upc
    > > MPIRUN_CMD='mpiexec -n %N %C' --enable-mpi
    > >
    > > If that all works, then "make" and "make install" are the next to
    > > commands to run.
    > > The --enable-mpi ensures that if the default MPI_CC setting
    doesn't
    > > work, then the configure step will stop (rather than letting you
    > > accidentally build Berkeley UPC without MPI support).  If that
    happens,
    > > we can try to figure out the proper setting for MPI_CC.
    > >
    > > -Paul
    > >
    > > Debabrata Midya wrote:
    > > > Paul,
    > > >
    > > > Thanks in advance. I need your assistance to install Berkeley UPC
    on
    > > > windows XP.
    > > >
    > > > 1. I have installed cygwin in D:\cygwin directory and I have
    provided
    > > > the path D:\cygwin\bin in the environmental variable.
    > > >     I have installed the packages you have mentioned.
    > > >
    > > > 2. I have downloaded berkeley_upc-2.10.0.tar.gz and I have put it
    in
    > > > D:\S-PLUS7\R\Parallel\Berkeley.
    > > >
    > > > 3. I have gone through the INSTALL.txt and I am trying to build a
    make
    > > > file. I think, I have problem here.
    > > >
    > > > mkdir d:\upc
    > > > cd d:\upc
    > > > D:\S-PLUS7\R\Parallel\Berkeley\berkeley_upc-2.10.0.tar.gz
    /configure
    > > > CC=gcc CXX=g++ \
    > > > MPI_CC=mpiexec
    > > >
    > > > Error at the dos prompt: MPI_CC is not recognised as an internal
    or
    > > > external command, operable program or batch file.
    > > > Notes: 1. I have installed MPICH2 in D:\MPICH2 and I have
    provided the
    > > > path D:\MPICH2\bin in the environmental variable. As per test, it
    is
    > > > working well.
    > > >           2. I like to install Berkeley UPC in D:\upc directory.
    > > >
    > > > Once again, thank you very much for the time you have given.
    > > >
    > > > Regards,
    > > >
    > > > Deb
    > > >
    > > >
    > > > >>> "Paul H. Hargrove" <PHHargrove@lbl.gov> 9/04/2010 3:55 pm
    >>>
    > > > Deb,
    > > >
    > > > 1.  Our internal notes for preparation of that huge tarball list
    the
    > > > following as the minimum required Cygwin packages:
    > > >   autoconf automake bash coreutils cvs emacs flex gcc4 gdb indent
    less
    > > > more m4 nano ncftp openssh patch patchutils pdksh perl_manpages
    pine
    > > > ping rsync tcsh time wget vim zsh
    > > > However, that might not be perfectly up-to-date, and I suspect
    some of
    > > > those aren't truly necessary.  However, you can always re-run the
    
    > Cygwin
    > > > installer to add more packages later if you need them.
    > > >
    > > > I suspect you need at least "tar" as well, to unpack the
    sources.
    > > >
    > > > 2.  You need "A".
    > > > The source-to-source translator in "B" does not build on Cygwin.
    > > > However, the default configuration when you build "A" uses a
    > > > network-based translator service we run, eliminating the need for
    most
    > > > users to build "B".
    > > >
    > > > You should be able to follow the instructions in INSTALL.txt in
    the
    > > > source tarball to build and install the Berkeley UPC Compiler.
    > > >
    > > > You can find the manual pages for the "upcc" compiler command
    and
    > > > "upcrun" job launcher at:
    > > >    http://upc.lbl.gov/docs/user/upcc.html 
    > > > and
    > > >   http://upc.lbl.gov/docs/user/upcrun.html 
    > > >
    > > > The file upc-examples/hello.upc in the source tarball is a
    simple
    > > > example UPC program.
    > > >
    > > > -Paul
    > > >
    > > >
    > > > Debabrata Midya wrote:
    > > > > Paul,
    > > > >
    > > > > Thank you very much for such a quick response.
    > > > >
    > > > > I need your assistance for the followings:
    > > > >
    > > > > 1. Installation of Cygwin: Select packages to install
    > > > >
    > > > > Should I select all packages or there is a list of minimum 
    > packages I
    > > > > can select to install to work with The Berkeley UPC compiler.
    > > > >
    > > > > 2. Source code for Berkeley UPC (under 7MB)
    > > > >
    > > > > (from http://upc.lbl.gov/download/source.shtml#runtime) 
    > <http://upc.lbl.gov/download/source.shtml#runtime%29>
    > > <http://upc.lbl.gov/download/source.shtml#runtime%29>
    > > > <http://upc.lbl.gov/download/source.shtml#runtime%29>
    > > > >
    > > > > *Berkeley UPC source downloads*
    > > > >
    > > > > A. The Berkeley UPC Runtime/front-end package (source
    distribution):
    > > > > **
    > > > > Berkeley UPC runtime (and front-end) , Version 2.10.0:*
    > > > > *berkeley_upc-2.10.0.tar.gz
    > > > >
    <http://upc.lbl.gov/download/release/berkeley_upc-2.10.0.tar.gz>
    > > (5.7MB)
    > > > >
    > > > > B. The Berkeley UPC-to-C translator (source distribution):
    > > > >
    > > > > The Berkeley UPC-to-C translator, version 2.10.0:*
    > > > > *berkeley_upc_translator-2.10.0.tar.gz
    > > > >
    > > >
    > > 
    >
    <http://upc.lbl.gov/download/release/berkeley_upc_translator-2.10.0.tar.gz>
    
    >
    > >
    > > >
    > > > > ( 6.9MB)
    > > > >
    > > > > Should I need to download both A and B?
    > > > >
    > > > > 3. build from that
    > > > >
    > > > > How can I build after completing 1 & 2?
    > > > >
    > > > > May I request you to provide me couple of lines as a
    reference?
    > > > >
    > > > > Once again thank you very much for the time you have given.
    > > > >
    > > > > Regards,
    > > > >
    > > > > Deb
    > > > >
    > > > > >>> "Paul H. Hargrove" PHHargrove@lbl.gov> 9/04/2010 2:21 pm
    >>
    > > > >
    <mailto:PHHargrove@lbl.gov%3E%209/04/2010%202:21%20pm%20%3E%3E>
    > > > > Debabrata ,
    > > > >
    > > > > The Berkeley UPC compiler is mainly written for POSIX-like
    > > environments,
    > > > > which does not include native Windows XP.
    > > > > However, Cygwin is a POSIX-like environment for Windows that
    is
    > > > > sufficient to allow Berkeley UPC (and many other applications 
    > written
    > > > > for Linux or other Unix) to run.
    > > > > Cygwin is a substantial infrastructure and that accounts for
    the
    > > bulk of
    > > > > the 1.2GB download.
    > > > >
    > > > > If you have already installed Cygwin on your machine then you
    could
    > > > > download just the source code for Berkeley UPC (under 7MB) and
    build
    > > > > from that.
    > > > >
    > > > > -Paul
    > > > >
    > > > >
    > > > > Debabrata Midya wrote:
    > > > > > Hi upc-users,
    > > > > >
    > > > > > Thanks in advance.
    > > > > >
    > > > > > I am Deb, Statistician at NSW Department of Services, 
    > Technology and
    > > > > > Administration, Sydney, Australia.
    > > > > >
    > > > > > I am new to this group.
    > > > > >
    > > > > > I am currently using gcc <TDM-1 mingw32>  4.4.1 on Windows XP
    
    > and I
    > > > > > have some experience of using OpenMP.
    > > > > >
    > > > > > I need your assistance to start with UPC on Windows.
    > > > > >
    > > > > > I have found in the web site of
    > > > > > http://upc.lbl.gov/download/binaries.shtml#windows that
    > > *Berkeley UPC
    > > > > > v2.10.0 Binary Installer* - Installs the Cygwin
    > > > > > <http://www.cygwin.com/> environment, and a prebuilt version
    
    > of the
    > > > > > Berkeley UPC runtime. But the file *Tar-gzipped installer 
    size
    > > > > > is (1268MB)*
    > > > > > <http://upc.lbl.gov/download/berkeley_upc-2.10.0-bin.tar.gz>.
    It
    > > will
    > > > > > take quite a while to download. Is there any alternative to
    have a
    > > > > > copy of it?
    > > > > >
    > > > > > Once again, thank you very much for the time you have given.
    > > > > >
    > > > > > I am looking forward for your reply.
    > > > > >
    > > > > > Regards,
    > > > > >
    > > > > >
    > > > > > Debabrata Midya (Deb)
    > > > > >
    > > > > >
    > > > > >
    > > > > >
    > > > >
    > > >
    > > 
    >
    *************************************************************************************
    > > > > >
    > > > > > This email message, including any attached files, is
    > > confidential and
    > > > > > intended solely for the use of the individual or entity to
    whom
    > > it is
    > > > > > addressed.
    > > > > >
    > > > > > The Department of Services, Technology and Administration
    > > > prohibits the
    > > > > > right to publish, copy, distribute or disclose any
    information
    > > > > contained in
    > > > > > this email, or its attachments, by any party other than the 
    > intended
    > > > > > recipient. If you have received this email in error please
    notify
    > > > > the sender
    > > > > > and delete it from your system.
    > > > > >
    > > > > > No employee or agent is authorised to conclude any binding 
    > agreement
    > > > > > on behalf of the Department of Services, Technology and
    > > Administration
    > > > > > by email. The views or opinions presented in this email are
    solely
    > > > > those of
    > > > > > the author and do not necessarily represent those of the 
    > Department,
    > > > > > except where the sender expressly, and with authority, states
    them
    > > > > to be
    > > > > > the views of the Department of Services, Technology and
    > > > Administration.
    > > > > >
    > > > > > The Department of Services, Technology and Administration 
    > accepts no
    > > > > > liability for any loss or damage arising from the use of
    this
    > > > email and
    > > > > > recommends that the recipient check this email and any
    attached
    > > > > files for
    > > > > > the presence of viruses.
    > > > > >
    > > > > >
    > > > >
    > > >
    > > 
    >
    *************************************************************************************
    > > > > >
    > > > >
    > > > >
    > > > > --
    > > > > Paul H. Hargrove                          PHHargrove@lbl.gov 
    > > > > Future Technologies Group                 Tel: +1-510-495-2352
    > > > > HPC Research Department                   Fax: +1-510-486-6900
    > > > > Lawrence Berkeley National Laboratory 
    > > > >
    > > > >
    > > >
    > > 
    >
    *************************************************************************************
    > > > >
    > > > > This email message, including any attached files, is 
    > confidential and
    > > > > intended solely for the use of the individual or entity to whom
    
    > it is
    > > > > addressed.
    > > > >
    > > > > The Department of Services, Technology and Administration
    > > prohibits the
    > > > > right to publish, copy, distribute or disclose any information
    > > > contained in
    > > > > this email, or its attachments, by any party other than the
    intended
    > > > > recipient. If you have received this email in error please
    notify
    > > > the sender
    > > > > and delete it from your system.
    > > > >
    > > > > No employee or agent is authorised to conclude any binding
    agreement
    > > > > on behalf of the Department of Services, Technology and 
    > Administration
    > > > > by email. The views or opinions presented in this email are
    solely
    > > > those of
    > > > > the author and do not necessarily represent those of the
    Department,
    > > > > except where the sender expressly, and with authority, states
    them
    > > > to be
    > > > > the views of the Department of Services, Technology and
    > > Administration.
    > > > >
    > > > > The Department of Services, Technology and Administration
    accepts no
    > > > > liability for any loss or damage arising from the use of this
    > > email and
    > > > > recommends that the recipient check this email and any
    attached
    > > > files for
    > > > > the presence of viruses.
    > > > >
    > > > >
    > > >
    > > 
    >
    *************************************************************************************
    > > > >
    > > >
    > > >
    > > > --
    > > > Paul H. Hargrove                          PHHargrove@lbl.gov 
    > > > Future Technologies Group                 Tel: +1-510-495-2352
    > > > HPC Research Department                   Fax: +1-510-486-6900
    > > > Lawrence Berkeley National Laboratory  
    > > >
    > > >
    > > 
    >
    *************************************************************************************
    > > >
    > > > This email message, including any attached files, is confidential
    and
    > > > intended solely for the use of the individual or entity to whom
    it is
    > > > addressed.
    > > >
    > > > The Department of Services, Technology and Administration 
    > prohibits the
    > > > right to publish, copy, distribute or disclose any information
    > > contained in
    > > > this email, or its attachments, by any party other than the
    intended
    > > > recipient. If you have received this email in error please
    notify
    > > the sender
    > > > and delete it from your system.
    > > >
    > > > No employee or agent is authorised to conclude any binding
    agreement
    > > > on behalf of the Department of Services, Technology and
    Administration
    > > > by email. The views or opinions presented in this email are
    solely
    > > those of
    > > > the author and do not necessarily represent those of the
    Department,
    > > > except where the sender expressly, and with authority, states
    them
    > > to be
    > > > the views of the Department of Services, Technology and 
    > Administration.
    > > >
    > > > The Department of Services, Technology and Administration accepts
    no
    > > > liability for any loss or damage arising from the use of this 
    > email and
    > > > recommends that the recipient check this email and any attached
    > > files for
    > > > the presence of viruses.
    > > >
    > > >
    > > 
    >
    *************************************************************************************
    > > > 
    > >
    > >
    > > --
    > > Paul H. Hargrove                          PHHargrove@lbl.gov 
    > > Future Technologies Group                 Tel: +1-510-495-2352
    > > HPC Research Department                   Fax: +1-510-486-6900
    > > Lawrence Berkeley National Laboratory   
    > >
    > > 
    >
    *************************************************************************************
    > >
    > > This email message, including any attached files, is confidential
    and
    > > intended solely for the use of the individual or entity to whom it
    is
    > > addressed.
    > >
    > > The Department of Services, Technology and Administration prohibits
    the
    > > right to publish, copy, distribute or disclose any information 
    > contained in
    > > this email, or its attachments, by any party other than the
    intended
    > > recipient. If you have received this email in error please notify 
    > the sender
    > > and delete it from your system.
    > >
    > > No employee or agent is authorised to conclude any binding
    agreement
    > > on behalf of the Department of Services, Technology and
    Administration
    > > by email. The views or opinions presented in this email are solely
    
    > those of
    > > the author and do not necessarily represent those of the
    Department,
    > > except where the sender expressly, and with authority, states them
    
    > to be
    > > the views of the Department of Services, Technology and
    Administration.
    > >
    > > The Department of Services, Technology and Administration accepts
    no
    > > liability for any loss or damage arising from the use of this email
    and
    > > recommends that the recipient check this email and any attached 
    > files for
    > > the presence of viruses.
    > >
    > > 
    >
    *************************************************************************************
    > >  
    >
    >
    > -- 
    > Paul H. Hargrove                          PHHargrove@lbl.gov 
    > Future Technologies Group                 Tel: +1-510-495-2352
    > HPC Research Department                   Fax: +1-510-486-6900
    > Lawrence Berkeley National Laboratory    
    >
    >
    *************************************************************************************
    >
    > This email message, including any attached files, is confidential
    and
    > intended solely for the use of the individual or entity to whom it
    is
    > addressed. 
    >
    > The Department of Services, Technology and Administration prohibits
    the 
    > right to publish, copy, distribute or disclose any information
    contained in 
    > this email, or its attachments, by any party other than the intended
    
    > recipient. If you have received this email in error please notify the
    sender 
    > and delete it from your system.
    >
    > No employee or agent is authorised to conclude any binding agreement
    
    > on behalf of the Department of Services, Technology and
    Administration 
    > by email. The views or opinions presented in this email are solely
    those of 
    > the author and do not necessarily represent those of the Department,
    
    > except where the sender expressly, and with authority, states them to
    be 
    > the views of the Department of Services, Technology and
    Administration.
    >
    > The Department of Services, Technology and Administration accepts no
    
    > liability for any loss or damage arising from the use of this email
    and 
    > recommends that the recipient check this email and any attached files
    for 
    > the presence of viruses.
    >
    >
    *************************************************************************************
    >   
    
    
    -- 
    Paul H. Hargrove                          PHHargrove@lbl.gov 
    Future Technologies Group                 Tel: +1-510-495-2352
    HPC Research Department                   Fax: +1-510-486-6900
    Lawrence Berkeley National Laboratory     
    
    *************************************************************************************
    
    This email message, including any attached files, is confidential and
    intended solely for the use of the individual or entity to whom it is
    addressed. 
    
    The Department of Services, Technology and Administration prohibits the 
    right to publish, copy, distribute or disclose any information contained in 
    this email, or its attachments, by any party other than the intended 
    recipient. If you have received this email in error please notify the sender 
    and delete it from your system.
    
    No employee or agent is authorised to conclude any binding agreement 
    on behalf of the Department of Services, Technology and Administration 
    by email. The views or opinions presented in this email are solely those of 
    the author and do not necessarily represent those of the Department, 
    except where the sender expressly, and with authority, states them to be 
    the views of the Department of Services, Technology and Administration.
    
    The Department of Services, Technology and Administration accepts no 
    liability for any loss or damage arising from the use of this email and 
    recommends that the recipient check this email and any attached files for 
    the presence of viruses.
    
    *************************************************************************************
    

  • Next message: Paul H. Hargrove: "Re: UPC on Windows"