DFS+MPI Configuration on Virtual Machine

Here is some summary on DFS+MPI on VM configuration.

check system information

cat /proc/cpuinfo
/sbin/lspci
rpm -qa | grep nfs, having some nfs

"tupac is just hosting the VM's, nfshead is going to be where u configure the NFS service and the other MPIxxxx will be clients that will mount an NFS drive by connecting to nfshead.  u need to log into the mpixxx VMs and get their IPs and add those to the config file on the NFS server so they can have access, but i think u can just leave it open for anyone as opposed to doing a deny/allow list."

pswd: 'root'

chkconfig --list

cat /etc/redhat-release
portmap-->rpcbind

osuml-ssh mpi.r248.0
mpi.node  mkdir /media/nfs

NFS
yum install rpcbind.x86_64
yum install nfs-utils
rpcinfo -p nfshead.osuml


UNFS3 server
Open: /usr/local/sbin/unfsd
client"
/sbin/mount.nfs nfshead.osuml:/home/public /media/nfs -v -o nolock, 'vers=3'


MPI
yum install gcc-gfortran
yum groupinstall "Development Tools"

/home/user/ .bash_profile
export PATH=/usr/local/mpich2-1.1/bin:$PATH
export LD_LIBRARY_PATH=/usr/local/mpich2-1.1:$LD_LIBRARY_PATH

mpirun -np 4 ./hello  别忘记在hello的运行程序前加./

scp rongshi@tupac.cse.ohio-state.edu:/home/rongshi/mpich* /home/

/home/  mpi NPB
cd - 退到之前目录

NPB
cat /proc/cpuinfo | grep proc | wc -l
make bt NPROCS=1 CLASS=A  (nprocs必须平方数，class S,W,A)
mpiexec -np 16 -hostfile hosts ./bt.A.16

Copy binary to all machines, scp命令
Some benchmarks (cg, ft, mg, lu, is) run on a power-of-2 number of processes. Others (sp, bt) run on a square number of processes
http://www.nas.nasa.gov/publications/npb_problem_sizes.html


***********************************************ref******************************************
3。修改conf/make.def文件：
    33行：MPIF77＝mpif77 ＃设定编译器
    35行：FLINK   = mpif77
    40行：FMPI＿LIB ＝ －L/data2/software/mpich-gcc/lib -lmpich ＃连接器会到这里找MPICH库
    45行：FMPI_INC = -I /data2/software/mpich-gcc/include ＃mpif.h在该路径下
    80行： MPICC = mpicc
    82行：CLINK   = mpicc
    87行： CMPI_LIB  = -L/data2/software/mpich-gcc/lib/ -lmpich
    93行：CMPI_INC = -I /data2/software/mpich-gcc/include   ＃mpi.h在该路径3
********************************************************************************************


infiniband, torque
.rhosts , /etc/hosts.equiv
/etc/sysconfig/networking/profiles/default
ask for having the ability to restart VM's and checkpoint them


real IPs:
mpi.r248.0, inet addr:164.107.119.45  Bcast:164.107.119.255  Mask:255.255.255.0
mpi.r248.1, inet addr:164.107.119.44  Bcast:164.107.119.255  Mask:255.255.255.0
nfshead.osuml, inet addr:164.107.119.49  Bcast:164.107.119.255  Mask:255.255.255.0

he's using a special service which has its network settings under:

/osuml.virtual.dir
if u do: cat host.net.config, u'll see the real IP it's using, it's actually an OSU IP
mpi.r248.1<---base.devel.osuml, cannot change
delete. ssh.keys: ssh-keygen -R hostname

LU Benchmark Result
Lu:   mpiexec -np 16 ./lu.A.16
Time in seconds =                  2322.43
Total processes =                       16
Compiled procs  =                       16
Mop/s total     =                    51.37
Mop/s/process   =                     3.21
Operation type  =           floating point
Verification    =               SUCCESSFUL
Version         =                    3.3.1
Compile date    =              16 Jun 2012
 

http://www.mcs.anl.gov/research/projects/mpi/www/www3/MPI_Wtime.html

http://ftp.gnu.org/gnu/binutils/binutils-2.20.1.tar.bz2
http://download.savannah.gnu.org/releases/libunwind/libunwind-0.99.tar.gz

-L/home/mpi/mpiP/mpiPtool/lib/libmpiP.a
-L/home/mpi/mpiP/binutils/lib64/libiberty.a
 
-lbfd的路径是 -L/home/mpi/mpiP/binutils/lib
libbfd.a  libbfd.la  libopcodes.a  libopcodes.la
-lunwind的路径是 -L/home/mpi/mpiP/libunwind/lib 当库很多：
 libunwind.a           libunwind-setjmp.la        libunwind.so.7.0.0
libunwind-generic.a   libunwind-setjmp.so        libunwind-x86_64.a

nsdi 2006 virtual machine migration cambridge

Open-->timeron flag ---> create timer.flag file
nprocs =      4          minimum     maximum     average
 timer  1 (total   ):    144.7813    146.9991    146.3170
 timer  2 (rcomp   ):      3.4501      3.7636      3.5692
 timer  3 (rcomm   ):    141.0177    143.4550    142.7421
 timer  4 (verify  ):      0.4111      2.0859      0.8575
 
mpi.r248.0  ~/.bash_profile  内容
export RPAPIHOME=/root/kv.man/
alias upd.cmds="history | grep upd | tail -n 20"
alias add.cmds="history | grep add | tail -n 20"
alias rmv.cmds="history | grep rmv | tail -n 20"
hostname mpi.r248.0

export PATH=/usr/bin:/home/mpi/mpich2/gbuild-4.3.2/bin:$PATH
export LD_LIBRARY_PATH=/usr/local/mpich2-1.4/lib:/home/mpi/mpiP/libunwind/lib:$LD_LIBRARY_PATH


mpiP
error:
mpiP on x86_64 platforms requires libunwind.
Please install libunwind and, if necessary, configure mpiP with
appropriate CFLAGS and LDFLAGS settings.
添加：CFLAGS=-I(path to/libunwind/install/include