Re: UPC on Windows

From: Paul H. Hargrove (PHHargrove_at_lbl_dot_gov)
Date: Mon Apr 19 2010 - 12:08:56 PDT

  • Next message: Debabrata Midya: "Re: UPC on Windows"
    Deb,
      My answers appear below.
    -Paul
    
    Debabrata Midya wrote:
    > Paul,
    >  
    > Thank you very much for such a quick response.
    >  
    > 1. I was able to run up to line 4 (out of 5 commands)
    >  
    > 2. ../berkeley_upc-2.10.0/configure --prefix=/cygdrive/d/upc
    > MPIRUN_CMD='mpiexec -n %N %C' --enable-mpi
    > The problem is here:
    >  
    >
    > checking for /usr/bin/env… /usr/bin/env
    >
    > checking for dig… no
    >
    > checking for nslookup… /cygdrive/c/WINDOWS/system32/nslookup
    >
    > checking for gmake… no
    >
    > checking for make… no
    >
    > configure: error: cannot find GNU make
    >
    > Failed during dbg configure, exit=1
    >  
    > 2A: Where can I get GNU make? After getting it, where can I install 
    > it? Is it necessary to provide path in the environmental variable to 
    > make use of GNU make?
    
    GNU Make is another Cygwin package to install.  It should be named 
    either "make" or "gmake".
    
    
    >  
    > 2B: After installation of GNU make, should I need to run only the 
    > fifth line, i.e.,
    >  
    > ../berkeley_upc-2.10.0/configure --prefix=/cygdrive/d/upc
    > MPIRUN_CMD='mpiexec -n %N %C' --enable-mpi
    >  
    
    Yes, but I did some research and expect that will fail to configure MPI 
    support (our defaults are not correct for MPICH2 on Cygwin).
    I think you'll need the following (all as one line):
    
    ../berkeley_upc-2.10.0/configure --prefix=/cygdrive/d/upc 
    MPIRUN_CMD='/cygdrive/d/MPICH2/bin/mpiexec -n %N %C'
    MPI_CC=gcc MPI_CFLAGS=-I/cygdrive/d/MPICH2/include 
    MPI_LIBS='-L/cygdrive/d/MPICH2/lib -lmpi' --enable-mpi
    
    > 3. You have mentioned in your e-mail that "If that all works, then 
    > "make" and "make install" are the next to
    > commands to run".
    >  
    > 3A: Will you please give me an example for it?
    
    make
    make install
    
    
    >  
    > 3B: How can I run the example code hello.upc?
    
    To compile:
      upcc -o hello hello.upc
    
    To run with 4 UPC threads:
      upcrun -n 4 hello
    
    
    >  
    > Once again, thank you very much for the time you have given.
    >  
    > Regards,
    >  
    > Deb
    >
    > >>> "Paul H. Hargrove" <PHHargrove_at_lbl_dot_gov> 19/04/2010 12:29 pm >>>
    > Deb,
    >
    > Our instructions all a reader who is familiar with a Unix-type 
    > environment.
    > Some hints that should help:
    >
    > + You should be using the Cygwin "bash" shell, not the DOS command prompt.
    > + berkeley_upc-2.10.0.tar.gz is a compressed "tar" archive containing
    > the source code - you need to unpack it
    > + The "\" at the end of the configure command is a Unix shell thing for
    > continuing a line.  So, if you entered the MPI_CC=... on the same line
    > you might have more success
    > + MPI_CC is a setting for the MPI compiler, not the mpiexec command
    > (which runs mpi apps), but the default probably works
    > + You do need a setting for MPIRUN_CMD (which will be a "template" that
    > include mpiexec).
    > + CC and C++ default to gcc and g++ when they are available
    > + To install in D:\upc you probably need "--prefix=/cygdrive/d/upc" on
    > the configure command line
    >
    > So combining those, you probably want to enter the following five
    > commands in the Cygwin "bash" shell:
    >
    > cd /cygdrive/d/upc
    > tar xfz /cygdrive/d/S-PLUS7/R/Parallel/Berkeley/berkeley_upc-2.10.0.tar.gz
    > mkdir build
    > cd build
    > ../berkeley_upc-2.10.0/configure --prefix=/cygdrive/d/upc
    > MPIRUN_CMD='mpiexec -n %N %C' --enable-mpi
    >
    > If that all works, then "make" and "make install" are the next to
    > commands to run.
    > The --enable-mpi ensures that if the default MPI_CC setting doesn't
    > work, then the configure step will stop (rather than letting you
    > accidentally build Berkeley UPC without MPI support).  If that happens,
    > we can try to figure out the proper setting for MPI_CC.
    >
    > -Paul
    >
    > Debabrata Midya wrote:
    > > Paul,
    > > 
    > > Thanks in advance. I need your assistance to install Berkeley UPC on
    > > windows XP.
    > > 
    > > 1. I have installed cygwin in D:\cygwin directory and I have provided
    > > the path D:\cygwin\bin in the environmental variable.
    > >     I have installed the packages you have mentioned.
    > > 
    > > 2. I have downloaded berkeley_upc-2.10.0.tar.gz and I have put it in
    > > D:\S-PLUS7\R\Parallel\Berkeley.
    > > 
    > > 3. I have gone through the INSTALL.txt and I am trying to build a make
    > > file. I think, I have problem here.
    > > 
    > > mkdir d:\upc
    > > cd d:\upc
    > > D:\S-PLUS7\R\Parallel\Berkeley\berkeley_upc-2.10.0.tar.gz /configure
    > > CC=gcc CXX=g++ \
    > > MPI_CC=mpiexec
    > > 
    > > Error at the dos prompt: MPI_CC is not recognised as an internal or
    > > external command, operable program or batch file.
    > > Notes: 1. I have installed MPICH2 in D:\MPICH2 and I have provided the
    > > path D:\MPICH2\bin in the environmental variable. As per test, it is
    > > working well.
    > >           2. I like to install Berkeley UPC in D:\upc directory.
    > > 
    > > Once again, thank you very much for the time you have given.
    > > 
    > > Regards,
    > > 
    > > Deb
    > > 
    > >
    > > >>> "Paul H. Hargrove" <PHHargrove_at_lbl_dot_gov> 9/04/2010 3:55 pm >>>
    > > Deb,
    > >
    > > 1.  Our internal notes for preparation of that huge tarball list the
    > > following as the minimum required Cygwin packages:
    > >   autoconf automake bash coreutils cvs emacs flex gcc4 gdb indent less
    > > more m4 nano ncftp openssh patch patchutils pdksh perl_manpages pine
    > > ping rsync tcsh time wget vim zsh
    > > However, that might not be perfectly up-to-date, and I suspect some of
    > > those aren't truly necessary.  However, you can always re-run the Cygwin
    > > installer to add more packages later if you need them.
    > >
    > > I suspect you need at least "tar" as well, to unpack the sources.
    > >
    > > 2.  You need "A".
    > > The source-to-source translator in "B" does not build on Cygwin.
    > > However, the default configuration when you build "A" uses a
    > > network-based translator service we run, eliminating the need for most
    > > users to build "B".
    > >
    > > You should be able to follow the instructions in INSTALL.txt in the
    > > source tarball to build and install the Berkeley UPC Compiler.
    > >
    > > You can find the manual pages for the "upcc" compiler command and
    > > "upcrun" job launcher at:
    > >    http://upc.lbl.gov/docs/user/upcc.html
    > > and
    > >   http://upc.lbl.gov/docs/user/upcrun.html
    > >
    > > The file upc-examples/hello.upc in the source tarball is a simple
    > > example UPC program.
    > >
    > > -Paul
    > >
    > >
    > > Debabrata Midya wrote:
    > > > Paul,
    > > >
    > > > Thank you very much for such a quick response.
    > > >
    > > > I need your assistance for the followings:
    > > >
    > > > 1. Installation of Cygwin: Select packages to install
    > > >
    > > > Should I select all packages or there is a list of minimum packages I
    > > > can select to install to work with The Berkeley UPC compiler.
    > > >
    > > > 2. Source code for Berkeley UPC (under 7MB)
    > > >
    > > > (from http://upc.lbl.gov/download/source.shtml#runtime) 
    > <http://upc.lbl.gov/download/source.shtml#runtime%29>
    > > <http://upc.lbl.gov/download/source.shtml#runtime%29>
    > > >
    > > > *Berkeley UPC source downloads*
    > > >
    > > > A. The Berkeley UPC Runtime/front-end package (source distribution):
    > > > **
    > > > Berkeley UPC runtime (and front-end) , Version 2.10.0:*
    > > > *berkeley_upc-2.10.0.tar.gz
    > > > <http://upc.lbl.gov/download/release/berkeley_upc-2.10.0.tar.gz> 
    > (5.7MB)
    > > >
    > > > B. The Berkeley UPC-to-C translator (source distribution):
    > > >
    > > > The Berkeley UPC-to-C translator, version 2.10.0:*
    > > > *berkeley_upc_translator-2.10.0.tar.gz
    > > >
    > > 
    > <http://upc.lbl.gov/download/release/berkeley_upc_translator-2.10.0.tar.gz> 
    >
    > >
    > > > ( 6.9MB)
    > > >
    > > > Should I need to download both A and B?
    > > >
    > > > 3. build from that
    > > >
    > > > How can I build after completing 1 & 2?
    > > >
    > > > May I request you to provide me couple of lines as a reference?
    > > >
    > > > Once again thank you very much for the time you have given.
    > > >
    > > > Regards,
    > > >
    > > > Deb
    > > >
    > > > >>> "Paul H. Hargrove" PHHargrove_at_lbl_dot_gov> 9/04/2010 2:21 pm >>
    > > > <mailto:PHHargrove_at_lbl_dot_gov%3E%209/04/2010%202:21%20pm%20%3E%3E>
    > > > Debabrata ,
    > > >
    > > > The Berkeley UPC compiler is mainly written for POSIX-like 
    > environments,
    > > > which does not include native Windows XP.
    > > > However, Cygwin is a POSIX-like environment for Windows that is
    > > > sufficient to allow Berkeley UPC (and many other applications written
    > > > for Linux or other Unix) to run.
    > > > Cygwin is a substantial infrastructure and that accounts for the 
    > bulk of
    > > > the 1.2GB download.
    > > >
    > > > If you have already installed Cygwin on your machine then you could
    > > > download just the source code for Berkeley UPC (under 7MB) and build
    > > > from that.
    > > >
    > > > -Paul
    > > >
    > > >
    > > > Debabrata Midya wrote:
    > > > > Hi upc-users,
    > > > >
    > > > > Thanks in advance.
    > > > >
    > > > > I am Deb, Statistician at NSW Department of Services, Technology and
    > > > > Administration, Sydney, Australia.
    > > > >
    > > > > I am new to this group.
    > > > >
    > > > > I am currently using gcc <TDM-1 mingw32>  4.4.1 on Windows XP and I
    > > > > have some experience of using OpenMP.
    > > > >
    > > > > I need your assistance to start with UPC on Windows.
    > > > >
    > > > > I have found in the web site of
    > > > > http://upc.lbl.gov/download/binaries.shtml#windows that 
    > *Berkeley UPC
    > > > > v2.10.0 Binary Installer* - Installs the Cygwin
    > > > > <http://www.cygwin.com/> environment, and a prebuilt version of the
    > > > > Berkeley UPC runtime. But the file *Tar-gzipped installer  size
    > > > > is (1268MB)*
    > > > > <http://upc.lbl.gov/download/berkeley_upc-2.10.0-bin.tar.gz>. It 
    > will
    > > > > take quite a while to download. Is there any alternative to have a
    > > > > copy of it?
    > > > >
    > > > > Once again, thank you very much for the time you have given.
    > > > >
    > > > > I am looking forward for your reply.
    > > > >
    > > > > Regards,
    > > > >
    > > > >
    > > > > Debabrata Midya (Deb)
    > > > >
    > > > >
    > > > >
    > > > >
    > > >
    > > 
    > *************************************************************************************
    > > > >
    > > > > This email message, including any attached files, is 
    > confidential and
    > > > > intended solely for the use of the individual or entity to whom 
    > it is
    > > > > addressed.
    > > > >
    > > > > The Department of Services, Technology and Administration
    > > prohibits the
    > > > > right to publish, copy, distribute or disclose any information
    > > > contained in
    > > > > this email, or its attachments, by any party other than the intended
    > > > > recipient. If you have received this email in error please notify
    > > > the sender
    > > > > and delete it from your system.
    > > > >
    > > > > No employee or agent is authorised to conclude any binding agreement
    > > > > on behalf of the Department of Services, Technology and 
    > Administration
    > > > > by email. The views or opinions presented in this email are solely
    > > > those of
    > > > > the author and do not necessarily represent those of the Department,
    > > > > except where the sender expressly, and with authority, states them
    > > > to be
    > > > > the views of the Department of Services, Technology and
    > > Administration.
    > > > >
    > > > > The Department of Services, Technology and Administration accepts no
    > > > > liability for any loss or damage arising from the use of this
    > > email and
    > > > > recommends that the recipient check this email and any attached
    > > > files for
    > > > > the presence of viruses.
    > > > >
    > > > >
    > > >
    > > 
    > *************************************************************************************
    > > > >
    > > >
    > > >
    > > > --
    > > > Paul H. Hargrove                          PHHargrove_at_lbl_dot_gov
    > > > Future Technologies Group                 Tel: +1-510-495-2352
    > > > HPC Research Department                   Fax: +1-510-486-6900
    > > > Lawrence Berkeley National Laboratory  
    > > >
    > > >
    > > 
    > *************************************************************************************
    > > >
    > > > This email message, including any attached files, is confidential and
    > > > intended solely for the use of the individual or entity to whom it is
    > > > addressed.
    > > >
    > > > The Department of Services, Technology and Administration 
    > prohibits the
    > > > right to publish, copy, distribute or disclose any information
    > > contained in
    > > > this email, or its attachments, by any party other than the intended
    > > > recipient. If you have received this email in error please notify
    > > the sender
    > > > and delete it from your system.
    > > >
    > > > No employee or agent is authorised to conclude any binding agreement
    > > > on behalf of the Department of Services, Technology and Administration
    > > > by email. The views or opinions presented in this email are solely
    > > those of
    > > > the author and do not necessarily represent those of the Department,
    > > > except where the sender expressly, and with authority, states them
    > > to be
    > > > the views of the Department of Services, Technology and 
    > Administration.
    > > >
    > > > The Department of Services, Technology and Administration accepts no
    > > > liability for any loss or damage arising from the use of this 
    > email and
    > > > recommends that the recipient check this email and any attached
    > > files for
    > > > the presence of viruses.
    > > >
    > > >
    > > 
    > *************************************************************************************
    > > > 
    > >
    > >
    > > --
    > > Paul H. Hargrove                          PHHargrove_at_lbl_dot_gov
    > > Future Technologies Group                 Tel: +1-510-495-2352
    > > HPC Research Department                   Fax: +1-510-486-6900
    > > Lawrence Berkeley National Laboratory   
    > >
    > > 
    > *************************************************************************************
    > >
    > > This email message, including any attached files, is confidential and
    > > intended solely for the use of the individual or entity to whom it is
    > > addressed.
    > >
    > > The Department of Services, Technology and Administration prohibits the
    > > right to publish, copy, distribute or disclose any information 
    > contained in
    > > this email, or its attachments, by any party other than the intended
    > > recipient. If you have received this email in error please notify 
    > the sender
    > > and delete it from your system.
    > >
    > > No employee or agent is authorised to conclude any binding agreement
    > > on behalf of the Department of Services, Technology and Administration
    > > by email. The views or opinions presented in this email are solely 
    > those of
    > > the author and do not necessarily represent those of the Department,
    > > except where the sender expressly, and with authority, states them 
    > to be
    > > the views of the Department of Services, Technology and Administration.
    > >
    > > The Department of Services, Technology and Administration accepts no
    > > liability for any loss or damage arising from the use of this email and
    > > recommends that the recipient check this email and any attached 
    > files for
    > > the presence of viruses.
    > >
    > > 
    > *************************************************************************************
    > >  
    >
    >
    > -- 
    > Paul H. Hargrove                          PHHargrove_at_lbl_dot_gov
    > Future Technologies Group                 Tel: +1-510-495-2352
    > HPC Research Department                   Fax: +1-510-486-6900
    > Lawrence Berkeley National Laboratory    
    >
    > *************************************************************************************
    >
    > This email message, including any attached files, is confidential and
    > intended solely for the use of the individual or entity to whom it is
    > addressed. 
    >
    > The Department of Services, Technology and Administration prohibits the 
    > right to publish, copy, distribute or disclose any information contained in 
    > this email, or its attachments, by any party other than the intended 
    > recipient. If you have received this email in error please notify the sender 
    > and delete it from your system.
    >
    > No employee or agent is authorised to conclude any binding agreement 
    > on behalf of the Department of Services, Technology and Administration 
    > by email. The views or opinions presented in this email are solely those of 
    > the author and do not necessarily represent those of the Department, 
    > except where the sender expressly, and with authority, states them to be 
    > the views of the Department of Services, Technology and Administration.
    >
    > The Department of Services, Technology and Administration accepts no 
    > liability for any loss or damage arising from the use of this email and 
    > recommends that the recipient check this email and any attached files for 
    > the presence of viruses.
    >
    > *************************************************************************************
    >   
    
    
    -- 
    Paul H. Hargrove                          PHHargrove_at_lbl_dot_gov
    Future Technologies Group                 Tel: +1-510-495-2352
    HPC Research Department                   Fax: +1-510-486-6900
    Lawrence Berkeley National Laboratory     
    

  • Next message: Debabrata Midya: "Re: UPC on Windows"