OpenFOAM for CFD Applications

• Lecture 1 - 12 November :  Introduction and set-up
• Lecture 2 - 14 November :  Parallel simulation
  
• Lecture 3 - 19 November :  Data analysis and visualization
• Lecture 4 - 21 November :  Mesh generation
  
  
• Homework 1
• Assigned, 9 November
• Due:  15 November
  
  
• Homework 2
• Assigned, 15 November
• Due:  22 November
  

• Available on github

# Assignment 8 - Due Friday 8 November 2013
#
# Introduction to OpenFOAM:  set-up and tutorials
#
# 1. load the OpenFOAM environment on BlueRidge using the OpenFOAM module
#
# 2. modify your .bashrc so that it is automatically loaded upon login
#
# 3. verify that the OpenFOAM installation is functional
#
# 4. identify the environment variables which are set by the 
#    OpenFOAM environment.  Based on these variables, identify:  
#    which C++ compiler was used, was OpenFOAM compiled as single- or
#    double-precision, which MPI library is OpenFOAM linked to?
#
# 5. identify important OpenFOAM linux aliases.  Hint:  look in 
#    $WM_PROJECT_DIR/etc/config/
#
# 6. copy the tutorials in $FOAM_TUTORIALS to your $WORK directory
#
# 7. run the backward-facing-step tutorial, 
#    $WORK/tutorials/incompressible/simpleFoam/pitzDaily. 
#
# 8. run a tutorial of your choice.  
#
#
#  What to hand in:
#
# 1.  A text-file "report" which documents output from parts 2, 3, 4, 5.
#
# 2.  Plot the solution residuals from part 7 to document convergence.   
#     Make an image of the velocity field using ParaView.
#
# 3.  Communicate the results from part 8 using a plot and a visualization.  
#     Make sure to identify the solver and case that you studied.  
#

• OpenFOAM is a free-to-use open-source numerical simulation software with extensive CFD and multi-physics capabilities

• Free-to-use means using the software without paying for license and support, including massively parallel computers: free 10,000-CPU CFD license!

• Software under active development, capabilities mirror those of commercial CFD

• Substantial user base in industry, research labs, and universities

• Possibility of extension to non-traditional, complex or coupled physics

• Physics model implementation through equation mimicking

• Discretization: Polyhedral Finite Volume Method, second order in space and time

• Lagrangian particle tracking (discrete element model)

• Finite Area Method: 2-D FVM on curved surface in 3-D

• Automatic mesh motion, support for topological changes

• Parallelism via a domain decomposition model

• Flexible Handling of Arbitrary Equations Sets
• Natural language of continuum mechanics:   partial differential equations
  

• Example: turbulence kinetic energy equation

• Objective: Represent differential equations in their natural language
  

• Correspondence between implementation and the original equation is clear
  
  

• OpenFOAM is a CFD Toolbox written in C++
  
• Software
• Liberal use of C++ abstraction
• Run-time selection of libraries
• Five basic classes
• Libraries
• Numerical algorithms and physical models
• Utilities:
• meshing, pre-processing, parallel computing, post-processing, etc.
• Solvers
• Designed for specific classes of problems, e.g., incompressible flow, compressible flow, multiphase flow, etc.

• Finite-volume discretization
• Set in system/fvSchemes
• Term-by-term prescription of temporal and spatial (divergence, Laplacian, gradient) operators

• Algebraic solvers and solution parameters

• Set in system/fvSolution
• solvers:  PCG, PBiCG, GAMG, etc.
• relaxationFactors
• iteration loops

• RANS and LES turbulence models
• variants for incompressible and compressible flow
• Linear eddy-viscosity models and RSTM 
• wall treatment:  wall functions, roughness

• Thermo-physical models for liquids and gases

• Non-Newtonian viscosity models

• Chemical reaction library interface to Chemkin

• Diesel spray

• steady incompressible RANS simulation (simpleFoam) of a 2D airfoil
  
• tutorial name:  $FOAM_TUTORIALS/incompressible/airFoil2D
• inlet conditions (0/U and 0/nut)

• U  [0 1 -1 0 0 0 0]  (25.75 3.62 0);
  nut  [0 2 -1 0 0 0 0] 0.14; 

• turbulence model (constant/RASProperties)

RASModel        SpalartAllmaras; 

• fluid properties (constant/transportProperties)                                                                                     

transportModel  Newtonian;
nu [ 0 2 -1 0 0 0 0 ] 1e-05; 

• openfoam.org
• code download
• some documentation
• user guide
• C++ source - Doxygen
• CFD Online
• discussion forum
• OpenFOAM Workshop
• slides from previous workshops
• training material
  
• OpenFOAM Wiki
  

1. Modules
2. .bashrc file
3. Environment variables
4. Aliases
5. Tutorials
6. Job submission

• Bash shell start up file located in $HOME/.bashrc
  
• Contains additions to $PATH, aliases, environment variables
• For OpenFOAM, I have the following additions

• module unload mvapich2module load openmpimodule load gslmodule load OpenFOAM. /opt/apps/intel13_1/openmpi1_6/OpenFOAM/2.2.0/OpenFOAM-2.2.0/etc/bashrc

[17:27:00][egp@brlogin1:egp]13017$ env|grep FOAM_
FOAM_SOLVERS=/opt/apps/intel13_1/openmpi1_6/OpenFOAM/2.2.0/OpenFOAM-2.2.0/applications/solvers
FOAM_EXT_LIBBIN=/opt/apps/intel13_1/openmpi1_6/OpenFOAM/2.2.0/ThirdParty-2.2.0/platforms/linux64IccDPOpt/lib
FOAM_APPBIN=/opt/apps/intel13_1/openmpi1_6/OpenFOAM/2.2.0/OpenFOAM-2.2.0/platforms/linux64IccDPOpt/bin
FOAM_TUTORIALS=/opt/apps/intel13_1/openmpi1_6/OpenFOAM/2.2.0/OpenFOAM-2.2.0/tutorials
FOAM_JOB_DIR=/opt/apps/intel13_1/openmpi1_6/OpenFOAM/2.2.0/jobControl
FOAM_SITE_APPBIN=/opt/apps/intel13_1/openmpi1_6/OpenFOAM/2.2.0/site/2.2.0/platforms/linux64IccDPOpt/bin
FOAM_APP=/opt/apps/intel13_1/openmpi1_6/OpenFOAM/2.2.0/OpenFOAM-2.2.0/applications
FOAM_SITE_LIBBIN=/opt/apps/intel13_1/openmpi1_6/OpenFOAM/2.2.0/site/2.2.0/platforms/linux64IccDPOpt/lib
FOAM_SRC=/opt/apps/intel13_1/openmpi1_6/OpenFOAM/2.2.0/OpenFOAM-2.2.0/src
FOAM_SIGFPE=
FOAM_UTILITIES=/opt/apps/intel13_1/openmpi1_6/OpenFOAM/2.2.0/OpenFOAM-2.2.0/applications/utilities
FOAM_USER_LIBBIN=/home/egp/OpenFOAM/egp-2.2.0/platforms/linux64IccDPOpt/lib
FOAM_INST_DIR=/opt/apps/intel13_1/openmpi1_6/OpenFOAM/2.2.0
OPENFOAM_BIN=/opt/apps/intel13_1/openmpi1_6/OpenFOAM/2.2.0/OpenFOAM-2.2.0/bin
FOAM_MPI=openmpi-system
FOAM_LIBBIN=/opt/apps/intel13_1/openmpi1_6/OpenFOAM/2.2.0/OpenFOAM-2.2.0/platforms/linux64IccDPOpt/lib
FOAM_SETTINGS=
FOAM_RUN=/home/egp/OpenFOAM/egp-2.2.0/run
OPENFOAM_DIR=/opt/apps/intel13_1/openmpi1_6/OpenFOAM/2.2.0
FOAM_USER_APPBIN=/home/egp/OpenFOAM/egp-2.2.0/platforms/linux64IccDPOpt/bin 

alias h=history
alias ls="ls -G"
alias work="cd $WORK"
alias scr="cd $SCRATCH"
alias pvload="module swap intel gcc/4.7.2 && module load qt python ParaView"
alias ofload="module swap gcc/4.7.2 intel"
alias pv="touch foam.foam && paraview --data=foam.foam"
alias pvs="touch foam.foam && pvserver -ch=localhost -rc" 

• Copy tutorials from $FOAM_TUTORIALS
  
• Since OpenFOAM is installed for all users, the tutorials are in a location where you do not have write permissions
  

[17:27:03][egp@brlogin1:egp]13018$ echo $FOAM_TUTORIALS/opt/apps/intel13_1/openmpi1_6/OpenFOAM/2.2.0/OpenFOAM-2.2.0/tutorials 

[17:29:20][egp@brlogin1:egp]13019$ echo $FOAM_RUN/home/egp/OpenFOAM/egp-2.2.0/run 
[17:29:53][egp@brlogin1:egp]13020$ run
[17:31:23][egp@brlogin1:run]13021$ cp $FOAM_TUTORIALS tutorials 

[17:31:23][egp@brlogin1:run]13021$ cd tutorials/
[17:35:19][egp@brlogin1:tutorials]13024$ ls -l
total 265
-rwxr-xr-x  1 egp  490 Jun  2 22:00 Allclean
-rwxr-xr-x  1 egp 2857 Jun  2 22:00 Allrun
-rwxr-xr-x  1 egp 5991 Jun  2 22:00 Alltest
drwxr-xr-x  5 egp   99 Jun  2 22:00 basic
drwxr-xr-x  8 egp  159 Jun  2 22:00 combustion
drwxr-xr-x 11 egp  289 Jun  2 22:00 compressible
drwxr-xr-x  4 egp   61 Jun  2 22:00 discreteMethods
drwxr-xr-x  3 egp   25 Jun  2 22:00 DNS
drwxr-xr-x  4 egp   60 Jun  2 22:00 electromagnetics
drwxr-xr-x  3 egp   31 Jun  2 22:00 financial
drwxr-xr-x  8 egp  238 Jun  2 22:00 heatTransfer
drwxr-xr-x 15 egp  423 Jun  2 22:00 incompressible
drwxr-xr-x  9 egp  268 Jun  2 22:00 lagrangian
drwxr-xr-x  4 egp   64 Jun  2 22:00 mesh
drwxr-xr-x 17 egp  522 Jun  2 22:00 multiphase
drwxr-xr-x  3 egp   26 Jun  2 22:00 resources
drwxr-xr-x  4 egp   89 Jun  2 22:00 stressAnalysis 

qsub -I -W group_list=blueridge -q normal_q -l nodes=2:ppn=16 -l walltime=5:00 -A AOE5984 

qsub case1.job 

#!/bin/bash

#PBS -l walltime=24:00:00
#PBS -l nodes=12:ppn=16
#PBS -W group_list=blueridge
#PBS -q normal_q
#PBS -A AOE5984
#PBS -M egp@vt.edu
#PBS -m bea

module purge
module load intel openmpi OpenFOAM

cd $PBS_O_WORKDIR
pwd

# Print a message before running the program 
# echo "------------------------------------------"
# echo "Running decomposePar!" 
# echo "------------------------------------------"
decomposePar -cellDist 2>&1 | tee log.decomposePar

# Print a message before running the program 
echo "------------------------------------------"
echo "Running pisoFOAM!" 
echo "Number of processors = " $PBS_NP
echo "------------------------------------------"
mpirun -bind-to-core -np $PBS_NP pisoFOAM -parallel 2>&1 | tee log.pisoFOAM

# Print a message before running the program 
echo "------------------------------------------"
echo "Running sample utility!" 
echo "Number of processors = " $PBS_NP
echo "------------------------------------------"
mpirun -bind-to-core -np $PBS_NP sample -parallel 2>&1 | tee log.sample

exit;