프로그램 사용/openHPC2020. 12. 15. 12:06

예제에서 컴퓨트 노드를 c1 이런식으로 이름을 지어놨는데

openhpc-로 접두를 바꾸면서 생기는 문제

에러 그대로 NodeName을 판별할 수 없다는데

아래 경로의 파일을 수정해주면 문제없이 된다.

cp /opt/ohpc/admin/images/centos8.2/etc/slurm/slurm.conf.ohpc /opt/ohpc/admin/images/centos8.2/etc/slurm/slurm.conf

vi /opt/ohpc/admin/images/centos8.2/etc/slurm/slurm.conf

NodeName=openhpc-[1-2] Sockets=2 CoresPerSocket=8 ThreadsPerCore=2 State=UNKNOWN 
PartitionName=normal Nodes=openhpc-[1-2] Default=YES MaxTime=24:00:00 State=UP Oversubscribe=EXCLUSIVE 

 

-

도대체 머가 문제일까...

 

# slurmd -v
slurmd: fatal: Unable to determine this slurmd's NodeName
# slurmd -V
slurm 20.02.5
# slurmd -C
NodeName=openhpc-1 CPUs=1 Boards=1 SocketsPerBoard=1 CoresPerSocket=1 ThreadsPerCore=1 RealMemory=968
UpTime=0-00:30:27

[링크 : https://www.raspberrypi.org/forums/viewtopic.php?t=245429]

[링크 : https://serverfault.com/questions/988027/slurm-service-running-failed-again-i-dont-know-why]

[링크 : https://medium.com/@racedowling/slurmd-exits-with-error-slurmd-718-fatal-unable-to-determine-this-slurmds-nodename-on-both-7542564befbf]

 

'프로그램 사용 > openHPC' 카테고리의 다른 글

openmpi 및 예제  (0) 2020.12.22
openmpi on centos8  (0) 2020.12.17
environment module / lmod  (0) 2020.12.15
openHPC 설치 part3?  (0) 2020.12.15
OpenFabrics interface - ofi  (0) 2020.12.14
Posted by 구차니
프로그램 사용/openHPC2020. 12. 15. 11:11

 

[링크 : https://github.com/cea-hpc/modules]

[링크 : https://modules.readthedocs.io/en/latest/cookbook/compiler-etc-dependencies.html]

[링크 : https://modules.readthedocs.io/en/latest/INSTALL.html]

 

[링크 : https://lmod.readthedocs.io/en/latest/]

[링크 : https://lmod.readthedocs.io/en/latest/030_installing.html]

'프로그램 사용 > openHPC' 카테고리의 다른 글

openmpi on centos8  (0) 2020.12.17
slurmd: fatal: Unable to determine this slurmd's NodeName  (0) 2020.12.15
openHPC 설치 part3?  (0) 2020.12.15
OpenFabrics interface - ofi  (0) 2020.12.14
MVAPICH2  (0) 2020.12.14
Posted by 구차니
프로그램 사용/openHPC2020. 12. 15. 10:18

 

4.3 에서 module 명령이 안되기 시작하면서

4.4~4.6이 정상적으로 설치되지 않는다.

4.1 Development Tools
4.2 Compilers

yum -y install ohpc-autotools
yum -y install EasyBuild-ohpc
yum -y install hwloc-ohpc
yum -y install spack-ohpc
yum -y install valgrind-ohpc
yum -y install gnu9-compilers-ohpc

4.3 MPI Stacks
yum -y install mpich-ucx-gnu9-ohpc
module avail mpich

4.4 Performance Tools
yum -y install ohpc-gnu9-perf-tools

4.5 Setup default development environment
yum -y install lmod-defaults-gnu9-openmpi4-ohpc

4.6 3rd Party Libraries and Tools
yum -y install ohpc-gnu9-mpich-parallel-libs
yum -y install ohpc-gnu9-openmpi4-parallel-libs

4.7 Optional Development Tool Builds
yum -y install intel-compilers-devel-ohpc
yum -y install intel-mpi-devel-ohpc

5 Resource Manager Startup
systemctl enable munge
systemctl enable slurmctld
systemctl start munge
systemctl start slurmctld

+
yum -y install yum install pdsh-ohpc

pdsh -w $compute_prefix[1-2] systemctl start munge
pdsh -w $compute_prefix[1-2] systemctl start slurmd
scontrol update nodename=c[1-4] state=idle

7 Run a Test Job
useradd -m test
wwsh file resync passwd shadow group
pdsh -w $compute_prefix[1-2] /warewulf/bin/wwgetfiles

7.1 Interactive execution
su - test
 mpicc -O3 /opt/ohpc/pub/examples/mpi/hello.c
 srun -n 8 -N 2 --pty /bin/bash[test@c1 ~]$ prun ./a.out

7.2 Batch execution
 cp /opt/ohpc/pub/examples/slurm/job.mpi .
 cat job.mpi
 #!/bin/bash
 #SBATCH -J test # Job name
 #SBATCH -o job.%j.out # Name of stdout output file (%j expands to %jobId)
 #SBATCH -N 2 # Total number of nodes requested
 #SBATCH -n 16 # Total number of mpi tasks #requested
 #SBATCH -t 01:30:00 # Run time (hh:mm:ss) - 1.5 hours
 # Launch MPI-based executable
 prun ./a.out

 sbatch job.mpi

 

# yum install ohpc-gnu9-perf-tools
마지막 메타 데이터 만료 확인 : 0:00:55 전에 2020년 12월 14일 (월) 오후 09시 28분 27초.
오류:
 문제: package ohpc-gnu9-perf-tools-2.0-47.1.ohpc.2.0.x86_64 requires scalasca-gnu9-mpich-ohpc, but none of the providers can be installed
  - package scalasca-gnu9-mpich-ohpc-2.5-2.3.ohpc.2.0.x86_64 requires lmod-ohpc >= 7.6.1, but none of the providers can be installed
  - cannot install the best candidate for the job
  - nothing provides lua-filesystem needed by lmod-ohpc-8.2.10-15.1.ohpc.2.0.x86_64
  - nothing provides lua-posix needed by lmod-ohpc-8.2.10-15.1.ohpc.2.0.x86_64
(설치할 수 없는 패키지를 건너 뛰려면 '--skip-broken'을 (를) 추가하십시오. 또는 '--nobest'은/는 최상의 선택된 패키지만 사용합니다)
# yum -y install gnu9-compilers-ohpc
마지막 메타 데이터 만료 확인 : 0:01:36 전에 2020년 12월 14일 (월) 오후 09시 28분 27초.
패키지 gnu9-compilers-ohpc-9.3.0-15.1.ohpc.2.0.x86_64이/가 이미 설치되어 있습니다.
종속성이 해결되었습니다.
할 것이 없음.
완료되었습니다!
#  yum -y install mpich-ucx-gnu9-ohpc
마지막 메타 데이터 만료 확인 : 0:01:46 전에 2020년 12월 14일 (월) 오후 09시 28분 27초.
패키지 mpich-ucx-gnu9-ohpc-3.3.2-13.1.ohpc.2.0.x86_64이/가 이미 설치되어 있습니다.
종속성이 해결되었습니다.
할 것이 없음.
완료되었습니다!
# yum -y install ohpc-gnu9-perf-tools
마지막 메타 데이터 만료 확인 : 0:02:45 전에 2020년 12월 14일 (월) 오후 09시 28분 27초.
오류:
 문제: package ohpc-gnu9-perf-tools-2.0-47.1.ohpc.2.0.x86_64 requires scalasca-gnu9-mpich-ohpc, but none of the providers can be installed
  - package scalasca-gnu9-mpich-ohpc-2.5-2.3.ohpc.2.0.x86_64 requires lmod-ohpc >= 7.6.1, but none of the providers can be installed
  - cannot install the best candidate for the job
  - nothing provides lua-filesystem needed by lmod-ohpc-8.2.10-15.1.ohpc.2.0.x86_64
  - nothing provides lua-posix needed by lmod-ohpc-8.2.10-15.1.ohpc.2.0.x86_64
(설치할 수 없는 패키지를 건너 뛰려면 '--skip-broken'을 (를) 추가하십시오. 또는 '--nobest'은/는 최상의 선택된 패키지만 사용합니다)
# yum install lmod-ohpc
마지막 메타 데이터 만료 확인 : 0:03:12 전에 2020년 12월 14일 (월) 오후 09시 28분 27초.
오류:
 문제: cannot install the best candidate for the job
  - nothing provides lua-filesystem needed by lmod-ohpc-8.2.10-15.1.ohpc.2.0.x86_64
  - nothing provides lua-posix needed by lmod-ohpc-8.2.10-15.1.ohpc.2.0.x86_64
(설치할 수 없는 패키지를 건너 뛰려면 '--skip-broken'을 (를) 추가하십시오. 또는 '--nobest'은/는 최상의 선택된 패키지만 사용합니다)
#  yum -y install lmod-defaults-gnu9-openmpi4-ohpc
마지막 메타 데이터 만료 확인 : 0:03:47 전에 2020년 12월 14일 (월) 오후 09시 28분 27초.
오류:
 문제: package lmod-defaults-gnu9-openmpi4-ohpc-2.0-4.1.ohpc.2.0.noarch requires lmod-ohpc, but none of the providers can be installed
  - conflicting requests
  - nothing provides lua-filesystem needed by lmod-ohpc-8.2.10-15.1.ohpc.2.0.x86_64
  - nothing provides lua-posix needed by lmod-ohpc-8.2.10-15.1.ohpc.2.0.x86_64
(설치할 수 없는 패키지를 건너 뛰려면 '--skip-broken'을 (를) 추가하십시오. 또는 '--nobest'은/는 최상의 선택된 패키지만 사용합니다)

'프로그램 사용 > openHPC' 카테고리의 다른 글

slurmd: fatal: Unable to determine this slurmd's NodeName  (0) 2020.12.15
environment module / lmod  (0) 2020.12.15
OpenFabrics interface - ofi  (0) 2020.12.14
MVAPICH2  (0) 2020.12.14
ip, ifconfig 없이 ip 알아내기  (0) 2020.12.08
Posted by 구차니

RTL-SDR 용으로 구매했던 녀석(RTL2832U + FC0012)를 아버지께서 안쓰신대서 돌려받아왔는데

kodi에 PVR client로 ARM(RPi)가 Yes로 되어있는 NextPVR을 설치했지만 안된다.

[링크 : https://kodi.wiki/view/PVR/Backends]

 

아무튼 FM이라도 나오면 좋으련만.. 라즈베리 파이로 CPU 성능이 될지 모르겠네

[링크 : https://www.rtl-sdr.com/tag/kodi/]

[링크 : http://esmasol.de/open-source/kodi-add-on-s/fm-radio-receiver/]

[링크 : https://kodi.wiki/view/Add-on:RTL-SDR_FM_Radio_Client]

 

'프로그램 사용 > kodi(xbmc)' 카테고리의 다른 글

kodi samba operation not permitted  (2) 2020.12.12
kodi 전체화면 / 창화면  (0) 2020.07.05
kodi 단축키  (0) 2020.03.29
Wifi direct  (0) 2018.04.02
KODI / DLNA 설정  (0) 2018.04.02
Posted by 구차니

의외로 많이 느리다고 해야하나?

대충 30MB/s 정도 겨우 나오는 듯..

그나저나 저 CPU 점유율 보소... ㄷㄷ

NAT로 구성되서 저렇게 많이 먹고 속도도 안나는 건가?

 

Posted by 구차니
프로그램 사용/openHPC2020. 12. 14. 16:13

MPICH2 ofi, ucx

[링크 : https://www.mpich.org/about/news/]

 

OpenFabrics Interfaces

[링크 : https://ofiwg.github.io/libfabric/]

 

Unified Communication X

[링크 : https://www.openucx.org/

'프로그램 사용 > openHPC' 카테고리의 다른 글

environment module / lmod  (0) 2020.12.15
openHPC 설치 part3?  (0) 2020.12.15
MVAPICH2  (0) 2020.12.14
ip, ifconfig 없이 ip 알아내기  (0) 2020.12.08
centos kernel update  (0) 2020.12.08
Posted by 구차니
프로그램 사용/openHPC2020. 12. 14. 16:01

MVAPICH: MPI over InfiniBand, Omni-Path, Ethernet/iWARP, and RoCE

[링크 : https://mvapich.cse.ohio-state.edu/]

 

기본적으로 infiniband, ommipath, RDMA(xeon) 등에서 작동되는 녀석이지

일반적인 기가비트 이더넷 등에서 작동할 녀석은 아닌듯?

[링크 : https://en.wikipedia.org/wiki/MVAPICH]

 

특이하게도 가상화쪽에서 SR-IOV가 나오는것도 존재한다.

'프로그램 사용 > openHPC' 카테고리의 다른 글

openHPC 설치 part3?  (0) 2020.12.15
OpenFabrics interface - ofi  (0) 2020.12.14
ip, ifconfig 없이 ip 알아내기  (0) 2020.12.08
centos kernel update  (0) 2020.12.08
centos kernel이 사라졌다 -ㅁ-  (0) 2020.12.08
Posted by 구차니
Linux/centos2020. 12. 14. 14:36

/etc/inittab이 안되서 찾아보니

systemctl set-default 명령을 통해서 바꾸면 된다.

 

# systemctl get-default
graphical.target

# systemctl set-default multi-user.target
Created symlink /etc/systemd/system/default.target → /usr/lib/systemd/system/multi-user.target.

# systemctl get-default
multi-user.target

# systemctl list-units -t target -a
  UNIT                      LOAD      ACTIVE   SUB    DESCRIPTION
  basic.target              loaded    active   active Basic System
  cryptsetup.target         loaded    active   active Local Encrypted Volumes
  emergency.target          loaded    inactive dead   Emergency Mode
  getty-pre.target          loaded    inactive dead   Login Prompts (Pre)
  getty.target              loaded    active   active Login Prompts
  graphical.target          loaded    inactive dead   Graphical Interface
  initrd-fs.target          loaded    inactive dead   Initrd File Systems
  initrd-root-device.target loaded    inactive dead   Initrd Root Device
  initrd-root-fs.target     loaded    inactive dead   Initrd Root File System
  initrd-switch-root.target loaded    inactive dead   Switch Root
  initrd.target             loaded    inactive dead   Initrd Default Target
  local-fs-pre.target       loaded    active   active Local File Systems (Pre)
  local-fs.target           loaded    active   active Local File Systems
  multi-user.target         loaded    active   active Multi-User System
  network-online.target     loaded    active   active Network is Online
  network-pre.target        loaded    active   active Network (Pre)
  network.target            loaded    active   active Network
  nfs-client.target         loaded    active   active NFS client services
  nss-lookup.target         loaded    inactive dead   Host and Network Name Lookups
  nss-user-lookup.target    loaded    active   active User and Group Name Lookups
  paths.target              loaded    active   active Paths
  remote-fs-pre.target      loaded    active   active Remote File Systems (Pre)
  remote-fs.target          loaded    active   active Remote File Systems
  rescue.target             loaded    inactive dead   Rescue Mode
  rpc_pipefs.target         loaded    active   active rpc_pipefs.target
  rpcbind.target            loaded    active   active RPC Port Mapper
  shutdown.target           loaded    inactive dead   Shutdown
  slices.target             loaded    active   active Slices
  sockets.target            loaded    active   active Sockets
  sound.target              loaded    active   active Sound Card
  sshd-keygen.target        loaded    active   active sshd-keygen.target
  swap.target               loaded    active   active Swap
  sysinit.target            loaded    active   active System Initialization
● syslog.target             not-found inactive dead   syslog.target
  time-sync.target          loaded    inactive dead   System Time Synchronized
  timers.target             loaded    active   active Timers
  umount.target             loaded    inactive dead   Unmount All Filesystems

LOAD   = Reflects whether the unit definition was properly loaded.
ACTIVE = The high-level unit activation state, i.e. generalization of SUB.
SUB    = The low-level unit activation state, values depend on unit type.

37 loaded units listed.
To show all installed unit files use 'systemctl list-unit-files'.

[링크 : https://www.linuxfork.com/how-to-change-the-run-level-on-rhel-centos-7-8/]

 

+

아래는 안되는 왜 한지 모르겠는 뻘짓

 

--force를 주고도 한번에 안되서 여러번을 하고 나서야 되네..

stop 하고 나서 된건진 잘 모르겠다.

그리고 여전히 gui로 켜지는건 달라지지 않았다 ㅠㅠ

]# systemctl list-units -t target -a
  UNIT                      LOAD      ACTIVE   SUB    DESCRIPTION
  basic.target              loaded    active   active Basic System
  cryptsetup.target         loaded    active   active Local Encrypted Volumes
  emergency.target          loaded    inactive dead   Emergency Mode
  getty-pre.target          loaded    inactive dead   Login Prompts (Pre)
  getty.target              loaded    active   active Login Prompts
  graphical.target          loaded    active   active Graphical Interface
  initrd-fs.target          loaded    inactive dead   Initrd File Systems
  initrd-root-device.target loaded    inactive dead   Initrd Root Device
  initrd-root-fs.target     loaded    inactive dead   Initrd Root File System
  initrd-switch-root.target loaded    inactive dead   Switch Root
  initrd.target             loaded    inactive dead   Initrd Default Target
  local-fs-pre.target       loaded    active   active Local File Systems (Pre)
  local-fs.target           loaded    active   active Local File Systems
  multi-user.target         loaded    active   active Multi-User System
  network-online.target     loaded    active   active Network is Online
  network-pre.target        loaded    active   active Network (Pre)
  network.target            loaded    active   active Network
  nfs-client.target         loaded    active   active NFS client services
  nss-lookup.target         loaded    inactive dead   Host and Network Name Lookups
  nss-user-lookup.target    loaded    active   active User and Group Name Lookups
  paths.target              loaded    active   active Paths
  remote-fs-pre.target      loaded    active   active Remote File Systems (Pre)
  remote-fs.target          loaded    active   active Remote File Systems
  rescue.target             loaded    inactive dead   Rescue Mode
  rpc_pipefs.target         loaded    active   active rpc_pipefs.target
  rpcbind.target            loaded    active   active RPC Port Mapper
  shutdown.target           loaded    inactive dead   Shutdown
  slices.target             loaded    active   active Slices
  sockets.target            loaded    active   active Sockets
  sound.target              loaded    active   active Sound Card
  sshd-keygen.target        loaded    active   active sshd-keygen.target
  swap.target               loaded    active   active Swap
  sysinit.target            loaded    active   active System Initialization
● syslog.target             not-found inactive dead   syslog.target
  time-sync.target          loaded    inactive dead   System Time Synchronized
  timers.target             loaded    active   active Timers
  umount.target             loaded    inactive dead   Unmount All Filesystems

LOAD   = Reflects whether the unit definition was properly loaded.
ACTIVE = The high-level unit activation state, i.e. generalization of SUB.
SUB    = The low-level unit activation state, values depend on unit type.

37 loaded units listed.
To show all installed unit files use 'systemctl list-unit-files'.


# systemctl status graphical.target
● graphical.target - Graphical Interface
   Loaded: loaded (/usr/lib/systemd/system/graphical.target; indirect; vendor preset: disabled)
   Active: active since Mon 2020-12-14 00:20:24 EST; 7min ago
     Docs: man:systemd.special(7)

12월 14 00:20:24 localhost.localdomain systemd[1]: Reached target Graphical Interface.

# systemctl disable  graphical.target
Removed /etc/systemd/system/default.target.

# systemctl disable graphical.target --force

# systemctl status graphical.target
● graphical.target - Graphical Interface
   Loaded: loaded (/usr/lib/systemd/system/graphical.target; static; vendor preset: disabled)
   Active: inactive (dead) since Mon 2020-12-14 00:33:58 EST; 8s ago
     Docs: man:systemd.special(7)

12월 14 00:29:09 localhost.localdomain systemd[1]: Reached target Graphical Interface.
12월 14 00:33:58 localhost.localdomain systemd[1]: Stopped target Graphical Interface.

]# systemctl list-units -t target -a
  UNIT                      LOAD      ACTIVE   SUB    DESCRIPTION
  basic.target              loaded    active   active Basic System
  cryptsetup.target         loaded    active   active Local Encrypted Volumes
  emergency.target          loaded    inactive dead   Emergency Mode
  getty-pre.target          loaded    inactive dead   Login Prompts (Pre)
  getty.target              loaded    active   active Login Prompts
  graphical.target          loaded    inactive dead   Graphical Interface
  initrd-fs.target          loaded    inactive dead   Initrd File Systems
  initrd-root-device.target loaded    inactive dead   Initrd Root Device
  initrd-root-fs.target     loaded    inactive dead   Initrd Root File System
  initrd-switch-root.target loaded    inactive dead   Switch Root
  initrd.target             loaded    inactive dead   Initrd Default Target
  local-fs-pre.target       loaded    active   active Local File Systems (Pre)
  local-fs.target           loaded    active   active Local File Systems
  multi-user.target         loaded    active   active Multi-User System
  network-online.target     loaded    active   active Network is Online
  network-pre.target        loaded    active   active Network (Pre)
  network.target            loaded    active   active Network
  nfs-client.target         loaded    active   active NFS client services
  nss-lookup.target         loaded    inactive dead   Host and Network Name Lookups
  nss-user-lookup.target    loaded    active   active User and Group Name Lookups
  paths.target              loaded    active   active Paths
  remote-fs-pre.target      loaded    active   active Remote File Systems (Pre)
  remote-fs.target          loaded    active   active Remote File Systems
  rescue.target             loaded    inactive dead   Rescue Mode
  rpc_pipefs.target         loaded    active   active rpc_pipefs.target
  rpcbind.target            loaded    active   active RPC Port Mapper
  shutdown.target           loaded    inactive dead   Shutdown
  slices.target             loaded    active   active Slices
  sockets.target            loaded    active   active Sockets
  sound.target              loaded    active   active Sound Card
  sshd-keygen.target        loaded    active   active sshd-keygen.target
  swap.target               loaded    active   active Swap
  sysinit.target            loaded    active   active System Initialization
● syslog.target             not-found inactive dead   syslog.target
  time-sync.target          loaded    inactive dead   System Time Synchronized
  timers.target             loaded    active   active Timers
  umount.target             loaded    inactive dead   Unmount All Filesystems

LOAD   = Reflects whether the unit definition was properly loaded.
ACTIVE = The high-level unit activation state, i.e. generalization of SUB.
SUB    = The low-level unit activation state, values depend on unit type.

37 loaded units listed.
To show all installed unit files use 'systemctl list-unit-files'.

 

[링크 : https://linuxconfig.org/how-to-change-a-runlevel-on-rhel-7-linux-system]

'Linux > centos' 카테고리의 다른 글

centos yum local repository  (0) 2024.12.23
centos8 virbr0?  (0) 2020.12.14
centos 8.3-2011 용량이 많이 늘었나?  (0) 2020.12.14
centos stream?  (0) 2020.12.10
centos 8.2 네트워크 설정  (0) 2020.12.02
Posted by 구차니
Linux/centos2020. 12. 14. 12:59

centos8.2는 minimal로 설치해서 그런가 virbr0 가 안생기더니 풀버전으로 설치했더니 생기네.

 

libvirtd 데몬으로 인해서 생기는 녀석이라고 한다.

 

[링크 : https://fliedcat.tistory.com/167]

'Linux > centos' 카테고리의 다른 글

centos yum local repository  (0) 2024.12.23
centos8 init level 3로 부팅시키기  (0) 2020.12.14
centos 8.3-2011 용량이 많이 늘었나?  (0) 2020.12.14
centos stream?  (0) 2020.12.10
centos 8.2 네트워크 설정  (0) 2020.12.02
Posted by 구차니
Linux/centos2020. 12. 14. 12:55

 

 

 

8.2-2004 에서는 minimal 버전이라 그랬나 10기가에서도 깔렸는데

8.3-2011 에서는 10GB 밖에 안되니 용량 늘려라고 진행 자체가 안된다

 

그런데 8.2 에서는 minimal이 있었는데

8.3 에서는 왜 minimal을 제공하지 않는 걸까?

 

+

virtual box 에서 centos8.3 설치하니 네트워크가 아노딘다.

virbr0가 잡히고 enp3s 어쩌구는 ip를 못받아온다. 멀까?

 

+

그래픽 컨트롤러가 원래 VMSVGA 였던가?

'Linux > centos' 카테고리의 다른 글

centos8 init level 3로 부팅시키기  (0) 2020.12.14
centos8 virbr0?  (0) 2020.12.14
centos stream?  (0) 2020.12.10
centos 8.2 네트워크 설정  (0) 2020.12.02
ls 퍼미션에 .의 의미  (0) 2020.04.01
Posted by 구차니