프로그램 사용/openHPC2020. 12. 2. 17:24

 

# wwsh --help
wwsh [wwsh options] [command] [object] [command options]
------------------------------------------------------------------------------
WWSH OPTIONS:
     --nodhcp       -- Do not update dhcpd.conf file.
  -d|--debug        -- Enable Debug Output
     --help         -- Print this help
  -v|--verbose      -- Enable Verbose Output
  -q|--quiet        -- Enable Quiet Mode
  -y|--yes|--noask  -- Assume 'Yes' to all questions


WWSH COMMANDS:
  help              -- Print command (module) help

# wwsh help
Warewulf command line shell interface

Welcome to the Warewulf shell interface. This application allows you
to interact with the Warewulf backend database and modules via a
single interface.

  bootstrap        Manage your bootstrap images
  dhcp             Manage DHCP service and configuration
  events           Control how events are handled
  exit             Exit/leave the Warewulf shell
  file             Manage files within the Warewulf data store
  ipmi             Node IPMI configuration
  node             Node manipulation commands
  object           Generically manipulate all Warewulf data store entries
  output           Set the output verbosity level
  provision        Node provision manipulation commands
  pxe              Manage PXE configuration
  quit             Exit/leave the Warewulf shell
  ssh              Spawn parallel ssh connections to nodes.
  vnfs             Manage your VNFS images

 

# wwsh help file
USAGE:
     file <command> [options] [targets]

SUMMARY:
     The file command is used for manipulating file objects.  It allows you to
     import, export, create, and modify files within the Warewulf data store.
     File objects may be used to supply files to nodes at provision time,
     dynamically create files or scripts based on Warewulf data and more.

COMMANDS:
     import             Import a file into a file object
     export             Export file object(s)
     edit               Edit the file in the data store directly
     new                Create a new file in the data store
     set                Set file attributes/metadata
     show               Show the contents of a file
     list               List a summary of imported file(s)
     print              Print all file attributes
     (re)sync           Sync the data of a file object with its source(s)
     delete             Remove a node configuration from the data store
     help               Show usage information

OPTIONS:
     -l, --lookup       Identify files by specified property (default: "name")
     -p, --program      What external program should be used (edit/show)
     -D, --path         Set destination (i.e., output) path for this file
     -o, --origin       Set origin (i.e., input) path for this file
     -m, --mode         Set permission attribute for this file
     -u, --uid          Set the UID for this file
     -g, --gid          Set the GID for this file
     -n, --name         Set the reference name for this file (not path!)
         --interpreter  Set the interpreter name to parse this file
         --overwrite    Overwrite the metadata in the file object on sync() to match the file at the origin path

NOTE:  Use "UNDEF" to erase the current contents of a given field.

EXAMPLES:
     Warewulf> file import /path/to/file/to/import --name=hosts-file
     Warewulf> file import /path/to/file/to/import/with/given-name
     Warewulf> file edit given-name
     Warewulf> file set given-name --origin=UNDEF --mode=0700
     Warewulf> file set hosts-file --path=/etc/hosts --mode=0644 --uid=0
     Warewulf> file list
     Warewulf> file delete name123 given-name

 

# wwsh help ssh
USAGE:
     ssh [nodes/targets] [command]

SUMMARY:
     Run ssh connections to node(s) in parallel by either node names, group
     or any other known lookup.

TARGETS:
     The target(s) specify which node(s) will be affected by the chosen
     action(s).  By default, node(s) will be identified by their name(s).
     Use the --lookup option to specify another property (e.g., "hwaddr"
     or "groups").

     All targets can be bracket expanded as follows:

         n00[0-99]       All nodes from n0000 through n0099 (inclusive)
         n00[00,10-99]   n0000 and all nodes from n0010 through n0099

OPTIONS:

     -l, --lookup        Identify nodes by specified property (default: "name")
     -a, --allnodes      Send command to all configured nodes

EXAMPLES:

     Warewulf> ssh n00[00-49] hostname
     Warewulf> ssh -l groups compute,interactive hostname


[root@localhost warewulf]# wwsh help node
USAGE:
     node <command> [options] [targets]

SUMMARY:
     The node command is used for viewing and manipulating node objects.

COMMANDS:
         new             Create a new node configuration
         set             Modify an existing node configuration
         list            List a summary of nodes
         print           Print the node configuration
         delete          Remove a node configuration from the data store
         clone           Clone a node configuration to another node
         help            Show usage information

TARGETS:
     The target(s) specify which node(s) will be affected by the chosen
     action(s).  By default, node(s) will be identified by their name(s).
     Use the --lookup option to specify another property (e.g., "hwaddr"
     or "groups").

     All targets can be bracket expanded as follows:

         n00[0-99]       All nodes from n0000 through n0099 (inclusive)
         n00[00,10-99]   n0000 and all nodes from n0010 through n0099

OPTIONS:
     -l, --lookup        Identify nodes by specified property (default: "name")
     -1                  With list command, output node name only
     -g, --groups        Specify all groups to which this node belongs
         --groupadd      Add node to specified group(s)
         --groupdel      Remove node from specified group(s)
     -D, --netdev        Specify network device to add or modify (defaults: eth0)
         --netdel        Remove specified netdev from node
         --netrename     Rename a given network interface
     -I, --ipaddr        Set IP address of given netdev
     -M, --netmask       Set subnet mask of given netdev
     -N, --network       Set network address of netdev
     -G, --gateway       Set gateway of given netdev
     -H, --hwaddr        Set hardware/MAC address
     -b, --bonddevs      Set bonding slave devices
     -B, --bondmode      Set bonding mode
     -f, --fqdn          Set FQDN of given netdev
     -m, --mtu           Set MTU of given netdev
     -p, --hwprefix      Specify a prefix for hardware/MAC address of a given netdev
     -c, --cluster       Specify cluster name for this node
         --domain        Specify domain name for this node
     -n, --name          Specify new name for this node
     -a, --arch          Specify architecture for this node (defaults: x86_64)
     -e, --enabled       Set whether the node is enabled (defaults: True)

EXAMPLES:
     Warewulf> node new n0000 --netdev=eth0 --hwaddr=xx:xx:xx:xx:xx:xx
     Warewulf> node set n0000 -D eth0 -I 10.0.0.10 -G 10.0.0.1
     Warewulf> node set n0000 --netdev=eth0 --netmask=255.255.255.0
     Warewulf> node set --groupadd=mygroup,hello,bye --cluster=mycluster n0000
     Warewulf> node set --groupdel=bye --set=vnfs=sl6.vnfs
     Warewulf> node list xx:xx:xx:xx:xx:xx --lookup=hwaddr
     Warewulf> node print --lookup=groups mygroup hello group123
     Warewulf> node clone n0000 new0000
     Warewulf> node set --enabled=false n0000
     Warewulf> node set --arch=x86_64 n0000

'프로그램 사용 > openHPC' 카테고리의 다른 글

openHPC 설치 part2?  (0) 2020.12.04
warewulf 유틸리티  (0) 2020.12.02
openHPC 설치 part 1?  (2) 2020.12.02
ipmi simulator  (0) 2020.12.02
IPoIB - IP over InfiniBand , OFED, PSM  (0) 2020.12.02
Posted by 구차니
프로그램 사용/openHPC2020. 12. 2. 16:01

제약어가 많아져서 무지 귀찮네 -_-

 

 

1. Centos 8.2 설치
2. 환경설정
[sms]# systemctl disable firewalld
[sms]# systemctl stop firewalld

3. 타임서버 관련 설정
[sms]# yum install chrony
[sms]# systemctl enable chronyd.service
[sms]# echo "server ${ntp_server}" >> /etc/chrony.conf
[sms]# echo "allow all" >> /etc/chrony.conf
[sms]# systemctl restart chronyd

3. 프로비저닝 패키지 설치
[sms]# yum install http://repos.openhpc.community/OpenHPC/2/CentOS_8/x86_64/ohpc-release-2-1.el8.x86_64.rpm
[sms]# yum install dnf-plugins-core
[sms]# yum config-manager --set-enabled PowerTools
[sms]# yum -y install ohpc-base
[sms]# yum -y install ohpc-warewulf

4. 리소스 매니저 설치
[sms]# yum -y install ohpc-slurm-server
[sms]# cp /etc/slurm/slurm.conf.ohpc /etc/slurm/slurm.conf
[sms]# vi /etc/slurm/slurm.conf
ControlMachine=linux0
[sms]# perl -pi -e "s/device = eth1/device = ${sms_eth_internal}/" /etc/warewulf/provision.conf
[sms]# ip link set dev ${sms_eth_internal} up
[sms]# ip address add ${sms_ip}/${internal_netmask} broadcast + dev ${sms_eth_internal}
[sms]# systemctl enable httpd.service
[sms]# systemctl restart httpd
[sms]# systemctl enable dhcpd.service
[sms]# systemctl enable tftp
[sms]# systemctl restart tftp

5. 프로비저닝 이미지 제작(compute node를 위한 slurm client 설치)
[sms]# export CHROOT=/opt/ohpc/admin/images/centos8.2
[sms]# wwmkchroot -v centos-8 $CHROOT
[sms]# dnf -y --installroot $CHROOT install epel-release
[sms]# cp -p /etc/yum.repos.d/OpenHPC*.repo $CHROOT/etc/yum.repos.d

[sms]# yum -y --installroot=$CHROOT install ohpc-base-compute
[sms]# cp -p /etc/resolv.conf $CHROOT/etc/resolv.conf

[sms]# cp /etc/passwd /etc/group $CHROOT/etc
[sms]# yum -y --installroot=$CHROOT install ohpc-slurm-client
[sms]# chroot $CHROOT systemctl enable munge
+
[sms]# chroot $CHROOT systemctl enable slurmd

[sms]# echo SLURMD_OPTIONS="--conf-server ${sms_ip}" > $CHROOT/etc/sysconfig/slurmd
[sms]# yum -y --installroot=$CHROOT install chrony
[sms]# echo "server ${sms_ip}" >> $CHROOT/etc/chrony.conf
[sms]# yum -y --installroot=$CHROOT install kernel-`uname -r`
[sms]# yum -y --installroot=$CHROOT install lmod-ohpc

6. customize system configuration
[sms]# wwinit database
[sms]# wwinit ssh_keys

[sms]# echo "/home *(rw,no_subtree_check,fsid=10,no_root_squash)" >> /etc/exports
[sms]# echo "/opt/ohpc/pub *(ro,no_subtree_check,fsid=11)" >> /etc/exports
[sms]# exportfs -a
[sms]# systemctl restart nfs-server
[sms]# systemctl enable nfs-server

[sms]# echo "${sms_ip}:/home /home nfs nfsvers=3,nodev,nosuid 0 0" >> $CHROOT/etc/fstab
[sms]# echo "${sms_ip}:/opt/ohpc/pub /opt/ohpc/pub nfs nfsvers=3,nodev 0 0" >> $CHROOT/etc/fstab

[sms]# perl -pi -e 's/# End of file/\* soft memlock unlimited\n$&/s' /etc/security/limits.conf
[sms]# perl -pi -e 's/# End of file/\* hard memlock unlimited\n$&/s' /etc/security/limits.conf
[sms]# perl -pi -e 's/# End of file/\* hard memlock unlimited\n$&/s' $CHROOT/etc/security/limits.conf
[sms]# perl -pi -e 's/# End of file/\* soft memlock unlimited\n$&/s' $CHROOT/etc/security/limits.conf
[sms]# echo "account required pam_slurm.so" >> $CHROOT/etc/pam.d/sshd

7. warewulf 설정 (import files)
[sms]# wwsh file import /etc/passwd
[sms]# wwsh file import /etc/group
[sms]# wwsh file import /etc/shadow
[sms]# wwsh file import /etc/munge/munge.key

8. finalizing provisioing configuration
[sms]# wwbootstrap `uname -r`

9. Assemble VNFS(Virtual Node File System) image
[sms]# wwvnfs --chroot $CHROOT

'프로그램 사용 > openHPC' 카테고리의 다른 글

warewulf 유틸리티  (0) 2020.12.02
wwsh (warewulf shell)  (0) 2020.12.02
ipmi simulator  (0) 2020.12.02
IPoIB - IP over InfiniBand , OFED, PSM  (0) 2020.12.02
openHPC warewulf + slurm  (0) 2020.12.02
Posted by 구차니
프로그램 사용/openHPC2020. 12. 2. 15:46

openHPC에서 ipmi가 필수인진 모르겠지만

혹시나 모르니 검색중..

 

[링크 : https://stackoverflow.com/questions/30502528/is-there-any-ipmi-simulator]

[링크 : https://github.com/rmxymh/infra-ecosphere]

[링크 : http://openipmi.sourceforge.net/]

'프로그램 사용 > openHPC' 카테고리의 다른 글

wwsh (warewulf shell)  (0) 2020.12.02
openHPC 설치 part 1?  (2) 2020.12.02
IPoIB - IP over InfiniBand , OFED, PSM  (0) 2020.12.02
openHPC warewulf + slurm  (0) 2020.12.02
warewulf  (0) 2020.11.26
Posted by 구차니

warewulf 클라이언트로 써볼 수 있을려나?

 

[링크 : https://www.joinc.co.kr/w/Site/cloud/virtualbox/PXE]

Posted by 구차니
프로그램 사용/openHPC2020. 12. 2. 14:34

openHPC 내용을 보다보니 못보는 용어가 나와서 검색!

 

[링크 : https://www.kernel.org/doc/html/latest/infiniband/ipoib.html]

[링크 : https://docs.mellanox.com/pages/viewpage.action?pageId=19798180]

 

 

Mellanox OFED is a single Virtual Protocol Internconnect (VPI) software stack based on the OpenFabrics (OFED) Linux stack, and operates across all Mellanox network adapter solutions supporting 10, 20, 40 and 56 Gb/s InfiniBand (IB); 10Gb/s and 40Gb/s Ethernet; and 2.5 or 5.0 GT/s PCI Express 2.0 and 8 GT/s PCI Express 3.0 uplinks to servers.

[링크 : https://www.mellanox.com/related-docs/prod_software/Mellanox OFED Linux User Manual 1_5_3-3_0_0.pdf]

 

OpenFabrics Enterprise Distribution (OFED*)

Performance Scaled Messaging (PSM) which is included in OFED brings a purpose-designed, lightweight, connectionless architecture that was specifically created to optimize HPC communications.

[링크 : https://www.intel.com/.../high-performance-computing-fabrics/true-scale-infiniband-software-and-tools.html]

'프로그램 사용 > openHPC' 카테고리의 다른 글

openHPC 설치 part 1?  (2) 2020.12.02
ipmi simulator  (0) 2020.12.02
openHPC warewulf + slurm  (0) 2020.12.02
warewulf  (0) 2020.11.26
openHPC  (0) 2020.11.25
Posted by 구차니
개소리 왈왈/컴퓨터2020. 12. 2. 14:23

lg gram과 삼성 UHD 디스플레이 조합으로 써보는데

4k 모니터 에다가 쏴도 1080p만 되는 것 같고, 윈도우에서는 해상도 설정이 뜨지 않는다.

그리고 화면 배율이 달라서 노트북에서는 100% 인데

TV로 옮기면 2배 커지고, TV에서 노트북으로 옮기면 커져있다가 줄어드는데 좀 어색하다고 해야하나..

아무튼 되는것만 확인.

 

데스크탑에서 블루투스 리시버 꽂고 해볼까?

 

[링크 : https://blog.naver.com/zibrinlab/221095377355]

Posted by 구차니
프로그램 사용/openHPC2020. 12. 2. 12:19

설치 문서를 보고 있는데 역시 개인이 가볍게(?) 설치할 만한 규모가 아니다.

 

문서에서는 최소 5대를 가지고 설치해야 하는데

그나마도 lustre같은 파일 시스템이 아닌 nfs로 구성하는 것이고

lustre나 BeeGFS 분산파일 시스템 추가되면 최소 2대 이상이 더 필요해진다.

 

마스터 노드와 컴퓨트 노드 총 5대로 구성을 하고

마스터 노드는 SMS(System Management Server)와 프로비저닝(warewulf)을 제공한다.

1.2 Requirements/Assumptions
This installation recipe assumes the availability of a single head node master, and four compute nodes.The master node serves as the overall system management server (SMS) and is provisioned with CentOS 8.2 and is subsequently configured to provision the remaining compute nodes with Warewulf in a stateless configuration. The terms master and SMS are used interchangeably in this guide. For power management, we assume that the compute node baseboard management controllers (BMCs) are available via IPMI from the chosen master host. For file systems, we assume that the chosen master server will host an NFS file system that is made available to the compute nodes. Installation information is also discussed to optionally mount a parallel file system and in this case, the parallel file system is assumed to exist previously

 

HPC systems rely on synchronized clocks throughout the system and the NTP protocol can be used to facilitate this synchronization

 

[링크 : https://github.com/openhpc/ohpc/releases/download/v2.0.GA/Install_guide-CentOS8-Warewulf-SLURM-2.0-x86_64.pdf]

 

 

[링크 : https://www.admin-magazine.com/HPC/Articles/warewulf_cluster_manager_completing_the_environment]

'프로그램 사용 > openHPC' 카테고리의 다른 글

ipmi simulator  (0) 2020.12.02
IPoIB - IP over InfiniBand , OFED, PSM  (0) 2020.12.02
warewulf  (0) 2020.11.26
openHPC  (0) 2020.11.25
beowulf 프로그램은 없다  (0) 2020.11.25
Posted by 구차니

호스트 IP를 비워두니 작동을 안한다.

localhost로 될진 모르겠지만 IP 라고 하니 일단은 127.0.0.1로 입력하니 작동함

 

[링크 : https://www.nemonein.xyz/2020/01/3048/]

Posted by 구차니

특이하게 파일 - 네트워크 작업 관리자가 아니라

파일 - 환경설정으로 가야하네?

 

 

 

가상머신 설정

 

이렇게 설정해주면 다른 가상머신도

virtualbox의 NAT network 하나에 연결이 된다.

'프로그램 사용 > VirtualBox & VMware' 카테고리의 다른 글

virtualbox PXE boot  (0) 2020.12.02
virtualbox NAT port forward 설정  (0) 2020.12.02
virtual box headless mode  (0) 2020.11.10
virtualbox 전체화면 적용할 모니터 고르기  (0) 2020.09.11
virtualbox headless  (0) 2019.07.15
Posted by 구차니
Linux/centos2020. 12. 2. 10:29

minimal 버전으로 설치하긴 했는데 네트워크 넘겼는지 기억이 나지 않는다 -_ㅠ

virtual box에서 NAT로 설정하고 설치를 했는데 네트워크가 잡히지 않아서 확인해보니

nmcli유틸을 이용해서 네트워크를 올려주어야 한다.

$ sudo nmcli connection down enp1s0 && sudo nmcli connection up enp1s0

[링크 : https://linuxconfig.org/rhel-8-configure-static-ip-address]

 

위에대로 하면 1회성에 한해 네트워크 설정이 잡히는데

다시 설정 파일을 보니 ONBOOT=no로 되어있었다.

 

 

$ sudo vi /etc/sysconfig/network-script/ifcfg-enp0s3
ONBOOT=yes
#ONBOOT=no

[링크 : https://www.lesstif.com/system-admin/centos-network-centos-static-ip-13631535.html]

 

아니 이런건 기본값이 yes로 해달란 말이야.. ㅠㅠ

'Linux > centos' 카테고리의 다른 글

centos 8.3-2011 용량이 많이 늘었나?  (0) 2020.12.14
centos stream?  (0) 2020.12.10
ls 퍼미션에 .의 의미  (0) 2020.04.01
centos7 minimal / X11 사용하기  (0) 2020.02.04
리눅스 로그인 실패 로그  (2) 2019.07.07
Posted by 구차니