Big model using big RAM

1

hello every one,
I am trying to run a big model 4 milion fo nodes by using a supermachine 256gb ram.
The simulations goes down surely for the size of the model. But it looks as the run does not consider all RAM of the supermachine.
Does anyone know how use all RAM?
I am using Pardiso solver and ccx_dynamic.exe

image
image595×441 19.1 KB

2

Are you using the double precision version (“i8”)?

and add:
set MKL_INTERFACE_LAYER=ILP64

1 Like
3

Hello,
I downloaded the file that you sent me.
What is the command string to run the simulation?

4 
set MKL_INTERFACE_LAYER=ILP64
%CCX_PATH%\ccx_i8.exe -i model

Solver: only PARDISO (i8)

5

I implemented these commands on the belowe file. But it does not work

image
image585×432 19 KB

6

What is displayed (output)?

7

This is the file updated with your command line.
What do you mean with displayed(output)?
Can you help to modify this file correctly?

image
image632×516 12.9 KB

8

You run this batch file in cmd window, any output from there?

9

No output, I run batch file and it crashed

10

I got this dos window and it crashed istantanuosly

image
image952×510 10.5 KB

11

Copy ccx_i8.exe and Intel MKL library to folder with yours inp file, open in this folder cmd windows:

set MKL_INTERFACE_LAYER=ILP64
set MKL_NUM_THREADS=8
./ccx_i8.exe -i xyz.inp
12

Fix (add " ")?:
set CCX_PATH="C:\CBLNTN01\CALCULIX\HOUSING\MODELLI_SUPER_MACCHINA\C3D10"

13

image
image1304×467 32.3 KB

This is the folder where I copy mkl library and my model anf Calculix.bat is the batch file.
It does not work. I got just this window
image
image967×443 4.86 KB

14

no xyz.inp, only name -i xyz

15

nothing change. I have already deleted .inp

16

image
image1275×586 33.7 KB

17

add " " to CCX_PATH
and add
set MKL_THREADING_LAYER=GNU

18

set CCX_PATH=C:\CBLNTN01\PROVE\PROVE
set MKL_INTERFACE_LAYER=ILP64
set MKL_NUM_THREADS=8
set MKL_THREADING_LAYER=GNU
cmd /k “CCX_PATH”\ccx_i8.exe -i MODELLO_COMPLETO_ALL_BEARING_MAT_NONLIN

image
image929×321 5.72 KB

I got this dos windows

19

set CCX_PATH="C:\CBLNTN01\PROVE\PROVE"

cmd /k %CCX_PATH%\ccx_i8.exe -i MODELLO_COMPLETO_ALL_BEARING_MAT_NONLIN

20

Try this version of ccx_i8:

And return to yours .bat, like:

rem Batch file for ccx with PaStiX/SPOOLES/PARDISO/iterative solvers
rem @echo off

rem ==== Set path to CalculiX executable here ====
set CALCULIX_ROOT=C:\PROGRA~2\BCONVE~1
set PATH=%CALCULIX_ROOT%\CalculiX\UMATs;%CALCULIX_ROOT%\CalculiX\MKL_PARDISO;%PATH%
set CCX_PATH="%CALCULIX_ROOT%\CalculiX\ccx"

rem ==== CalculiX settings ========
set CCX_NPROC_RESULTS=8
set CCX_NPROC_STIFFNESS=8
set OMP_NUM_THREADS=8

rem ==== MKL (PARDISO) settings ========
set MKL_NUM_THREADS=8
set MKL_DYNAMIC=FALSE
set OMP_DYNAMIC=FALSE
set MKL_INTERFACE_LAYER=ILP64
set MKL_THREADING_LAYER=GNU

rem ==== PaStiX settings ========
set OPENBLAS_NUM_THREADS=1
rem Must be used for this version
set PASTIX_MIXED_PRECISION=1
rem 1 - yes(*), 0 - no
set PASTIX_ORDERING=0
rem 0 - Scotch(*), 1 - Metis
set PASTIX_SCHEDULER=0
rem 0 - Static(*), 1 - StarPU, 3 - Sequential, 2 - parsec (not working yet)

rem ==== Final CCX run  command ====
%CCX_PATH%\ccx_i8.exe -i ccx