구차니의 잡동사니 모음

[링크 : https://unix.stackexchange.com/questions/365225/how-to-get-the-ipv4-address-for-an-interface-from-proc]

# yum update kernel
Last metadata expiration check: 20:00:35 ago on Mon 07 Dec 2020 01:42:34 AM EST.
Dependencies resolved.
Nothing to do.
Complete!

# grub2-editenv list
saved_entry=c324aa0738b34f58b1304edca552d426-4.18.0-193.28.1.el8_2.x86_64
kernelopts=root=/dev/mapper/cl-root ro crashkernel=auto resume=/dev/mapper/cl-swap rd.lvm.lv=cl/root rd.lvm.lv=cl/swap
boot_success=0

# grub2-set-default 0

[링크 : https://jeongyd.tistory.com/56]

+

위의 방식으로 되지 않아서 다른 방법 찾는중

그런데 yum clean all 은 웬지 설치된 패키지 전부 지우는 느낌인데..

[링크 : https://phoenixnap.com/kb/how-to-update-upgrade-centos]

저번주 까지만 해도 멀쩡히 잘 되었던 녀석이 갑자기 안된다.

그래서 찾아보는데.. 아무래도 구버전이 되어서 live에서 내려가 버린듯..

아무튼 설치는 했는데 다시 하려니 매치되는게 없다고 그런다...

[링크 : https://forums.centos.org/viewtopic.php?t=76325&p=320884]

[링크 : http://mirror.centos.org/centos/8/BaseOS/x86_64/os/Packages/?C=M;O=D]

[링크 : https://vault.centos.org/8.2.2004/BaseOS/x86_64/os/Packages/]

[링크 : http://rpmfind.net/linux/RPM/centos/8.2.2004/baseos/x86_64/Packages/kernel-4.18.0-193.el8.x86_64.html]

warewulf 유틸리티인데 스크립트였네?

# cat /usr/bin/wwmkchroot
#!/bin/bash
#
#
# Copyright (c) 2001-2003 Gregory M. Kurtzer
#
# Copyright (c) 2003-2011, The Regents of the University of California,
# through Lawrence Berkeley National Laboratory (subject to receipt of any
# required approvals from the U.S. Dept. of Energy).  All rights reserved.
#
# $Id: wwmkchroot 913 2012-04-19 00:33:31Z gmk $

prefix="/usr"
exec_prefix="/usr"
libexecdir="/usr/libexec"


usage() {
    echo "$0 [options] TEMPLATE_NAME PATH"
    echo
    echo "OPTIONS:"
    echo "    -d        Debug output"
    echo "    -g        Disable install GPG checks"
    echo "    -v        Verbose output"
    echo "    -h        Show usage"
    echo
    echo "TEMPLATE_NAME (select one of the following):"
    for i in $libexecdir/warewulf/wwmkchroot/*.tmpl; do
        NAME=`basename $i | sed -e 's/\.tmpl$//'`
        DESC=`grep '^#DESC: ' $i | sed -e 's/#DESC: //'`
        printf "   * %-20s %s\n" "$NAME" "$DESC"
    done
    echo
    echo "PATH:"
    echo "   This is the location where the VNFS will be created"
    echo
    echo "EXAMPLES:"
    echo
    echo " # wwmkchroot rhel-generic /var/chroots/rhel"
    echo " # wwmkchroot debian8-64 /var/chroots/deb8"
    echo
}

unset VERBOSE
unset DEBUG
unset NOGPGCHECK
DEVNULL="/dev/null"

### Argument processing
while getopts ":dhvg" opt; do
    case $opt in
        d)
            VERBOSE=1
            DEBUG=1
            DEVNULL="/dev/stdout"
            set -x
        ;;
        v)
            VERBOSE=1
        ;;
       \?)
            printf "ERROR: $OPTARG not recognized.\n\n" 1>&2
            usage
            exit 1
        ;;
        h)
            usage
            exit 0
        ;;
        g)
            NOGPGCHECK=1
        ;;
    esac
done

shift $((OPTIND-1))

export VNFSTEMPLATE=$1
shift
export CHROOTDIR=$1
shift

if [ -z "$VNFSTEMPLATE" ]; then
    printf "ERROR: Missing VNFS template name\n\n"
    usage
    exit 1
fi

#### Check for template directory
if ! [ -d "$libexecdir/warewulf/wwmkchroot" ]; then
    echo "ERROR: Template directory ($libexecdir/warewulf/wwmkchroot) does not exist!"
    exit 1
fi

pushd $libexecdir/warewulf/wwmkchroot >$DEVNULL

#### Load functions
test -n "$VERBOSE" && printf "\n==== Loading general template functions\n"
if [ -f "./functions" ]; then
    . "./functions"
else
    echo "ERROR: Can not find $libexecdir/warewulf/wwmkchroot/functions"
    exit 1
fi

#### Load OS templates
test -n "$VERBOSE" && printf "\n==== Loading template\n"
if [ -f "$VNFSTEMPLATE.tmpl" ]; then
    test -n "$VERBOSE" && echo "Using $libexecdir/warewulf/wwmkchroot/$VNFSTEMPLATE.tmpl"
    . "$VNFSTEMPLATE.tmpl"
else
    echo "ERROR: Can not find $libexecdir/warewulf/wwmkchroot/$VNFSTEMPLATE.tmpl"
    exit 1
fi

popd >$DEVNULL

if [ -z "$CHROOTDIR" ]; then
    echo "ERROR: You must define the directory to build the chroot"
    usage
    exit 1
fi

#### Running template functions
test -n "$VERBOSE" && printf "\n==== Starting chroot build\n"
for function in $FUNCTIONS; do
    test -n "$VERBOSE" && echo "== Running: $function"
    $function || exit 1
done

실행하다 보면 /usr/libexec/warewulf/wwmkchroot/*.tmpl을 건드리는데

# cat centos-8.tmpl
#DESC: Red Hat Enterprise Linux 8

# The general RHEL include has all of the necessary functions, but requires
# some basic variables specific to each chroot type to be defined.

# Use DNF as the package manager
PKG_MGR=dnf
EXTRA_ARGS="--releasever=8"
PLATFORMID="platform:el8"

# Uncomment to disable GPG checks on added repos
# REPO_NOGPGCHECK=1

. include-rhel

# Define the location of the YUM repository
if [ -z "$YUM_MIRROR" ]; then
    if [ -z "$YUM_MIRROR_BASE" ]; then
        YUM_MIRROR_BASE="http://mirror.centos.org/centos-8"
    fi
    YUM_MIRROR="${YUM_MIRROR_BASE}/8/BaseOS/\$basearch/os","${YUM_MIRROR_BASE}/8/AppStream/\$basearch/os","${YUM_MIRROR_BASE}/8/PowerTools/\$basearch/os"
fi

# Install only what is necessary/specific for this distribution
PKGLIST="basesystem bash chkconfig coreutils e2fsprogs ethtool
    filesystem findutils gawk grep initscripts iproute iputils
    net-tools nfs-utils pam psmisc rsync sed setup
    shadow-utils rsyslog tzdata util-linux words
    zlib tar less gzip which util-linux openssh-clients
    openssh-server dhclient pciutils vim-minimal shadow-utils
    strace cronie crontabs cpio wget redhat-release hostname grub2-common glibc-langpack-en"

그 경로를 하나씩 내려가다 보니 아래와 같이 BaseOS 다음에 platform architecutre 구분이 들어가게 된다.

mirror.centos.org/centos-8/8/BaseOS/

mirror.centos.org/centos-8/8/BaseOS/aarch64/

mirror.centos.org/centos-8/8/BaseOS/x86_64/

해당 부분에 대해서는

$basearch 변수를 사용하는데 그걸 바꾸어서 적용하면 임의로 크로스 플랫폼(?)으로 적용이 가능할 지도 모르겠다.

And also need to change $YUM_MIRROR to the local repository.

Corresponds to wwmkchroot written in "3.6 Define compute image for provisioning" of each Usage.

[root@aarch64 /]# export YUM_MIRROR=""/repos/centos-<version>.<release>/BaseOS", "/repos/centos-<version>.<release>/AppStream", "/repos/centos-<version>.<release>-aarch64/PowerTools""
[root@aarch64 /]# wwmkchroot -d centos-<version> $CHROOT

[링크 : https://github.com/NaohiroTamura/cross-sms-aarch64.sh/blob/master/README.md]

나머지는 uname -r로

커널 버전과 아키텍쳐를 받아와서 티가 안나는데

초기 설치하는 패키지가 다르다.

[sms]# yum install http://repos.openhpc.community/OpenHPC/2/CentOS_8/x86_64/ohpc-release-2-1.el8.x86_64.rpm

[sms]# yum install http://repos.openhpc.community/OpenHPC/2/CentOS_8/aarch64/ohpc-release-2-1.el8.aarch64.rpm

혹시나 해서 x86 linux에 aarch64 패키지를 설치해 보았지만 역시나 에러가 발생한다.

dose not have a compatible architecture

문서 자체가 arm64 코어 기반 하드웨어가 node master여야 하는 듯..

# yum install http://repos.openhpc.community/OpenHPC/2/CentOS_8/aarch64/ohpc-release-2-1.el8.aarch64.rpm
CentOS-8 - AppStream                            2.7 kB/s | 4.3 kB     00:01
CentOS-8 - Base                                 3.7 kB/s | 3.9 kB     00:01
CentOS-8 - Extras                               1.2 kB/s | 1.5 kB     00:01
OpenHPC-2 - Base                                2.0 kB/s | 1.5 kB     00:00
OpenHPC-2 - Updates                             3.4 kB/s | 2.9 kB     00:00
Extra Packages for Enterprise Linux Modular 8 - 3.4 kB/s | 8.5 kB     00:02
Extra Packages for Enterprise Linux 8 - x86_64  2.6 kB/s | 4.8 kB     00:01
Extra Packages for Enterprise Linux 8 - x86_64  1.3 MB/s | 8.5 MB     00:06
ohpc-release-2-1.el8.aarch64.rpm                 13 kB/s |  10 kB     00:00
Error:
 Problem: conflicting requests
  - package ohpc-release-2-1.el8.aarch64 does not have a compatible architecture
(try to add '--skip-broken' to skip uninstallable packages or '--nobest' to use not only best candidate packages)

+

cross 나오는것 봐서는 x86-64에서 aarch64의 VNFS를 만들도록 하는 내용 같긴한데..

[링크 : https://github.com/NaohiroTamura/cross-sms-aarch64.sh/blob/master/README.md]

라이선스는 GPL

네트워크 모니터링에서 시작한것 같긴한데

결국에는 모든 장치에 대한 모니터링 까지 제공하는 듯?

[링크 : https://www.nagios.org/]

[링크 : https://en.wikipedia.org/wiki/Nagios]

[링크 : https://logz.io/blog/prometheus-vs-nagios-metrics/]

nagios enterprise 사 버전이라고 해야하려나?

nagios XI 등은 구매가 가능한데 비용은 안나오고 양식을 채워넣으라고만 하니 알수가 없다. 

github 버전도 라이선스 있어야 하는지 좀 더 조사가 필요하다

[링크 : https://www.metricfire.com/blog/prometheus-vs-nagios/]

[링크 : https://github.com/NagiosEnterprises]

nagios core는 무료

GUI를 얹은게 nagios XI(유료)

NRDP - Nagios Remote Data Processor

NCPA - Nagios Cross Platform Agent

[링크 : http://blog.naver.com/ki630808/221837041442]

LBNL - Lawrence Berkeley National Laboratory

NHC - Node Health Check

[링크 : https://github.com/mej/nhc] 

virtualbox에서 DHCP 사용 끄고

master node 설정에서 BOOTPROTO=none 으로 해서 static ip로 설정하도록 설정(아래 내용 참고)

[링크 : https://linuxconfig.org/rhel-8-configure-static-ip-address]

Finalizing provisioning configuration

클라이언트 노드들을 켤 준비를 해준다.

전원 on! 하니 오오오

PXE 부팅하는거 첨 보는 느낌인데?!?!? 아무튼 부팅은 성공!

하지만 root 로그인이 안되서 멀 잘못했네 멘붕중 ㅠㅠ

/ 는 tmpfs도 되어있어서 아마.. 램디스크 처럼 날아갈 것 같고

이전에 설정되었던 fstab에 의해서 붙긴한데 이제 멀 더 해야 하려나..

---

wwsh node new 이후에 node list로 확인

postnetdown이 멀까...

warewulf 답게 ww로 프로그램 이름이 시작한다.

초기화 명령으로 database랑 ssh_keys는 했는데 의외로 초기화 하는 항목이 많다?

자동으로 새로운 컴퓨터 노드를 등록해주는 유틸리티

wwsh node를 통해서도 추가가 가능하다.

# wwnodescan
USAGE: /usr/bin/wwnodescan [options] nodes....
    SUMMARY:
        Scan for new systems making DHCP requests.

    GENERAL OPTIONS:
        -h, --help              Show the help/utilization summary
        -d, --debug             Display debugging information
        -v, --verbose           Be more verbose in output
        -f, --file <file>       Create Warewulf script instead of auto-import
        -l, --listen <iface>    Interface to listen on (tcpdump -D for list)
        -c, --tcpdump <cmd>     Specify the full path to the tcpdump command
        -T, --tshark <cmd>      Specify the full path to the tshark command (Only IB Mode)
        -x, --max [<cnt>]       Exit after <cnt> new nodes (0 for auto)

    MODES:
        -t, --test              Test mode; do not modify data store
        -r, --replace           Replace existing nodes (by name)
        -a, --autoconfig        Assign HW addresses to unassigned nodes
        -I, --infiniband        Use tshark to look for Client Identifier, compatible with Mellanox FlexBoot.

    SETTINGS:
        -n, --netdev <dev>      Network device for the new node(s)
        -i, --ipaddr <addr>     IP address for the new node(s)
        -m, --netmask <mask>    Netmask for the new node(s)
        -V, --vnfs <vnfs>       VNFS for the node(s)
        -b, --bootstrap <name>  Bootstrap for the node(s)
        -g, --groups <groups>   Groups for the node(s)

    NODES:
        You can scan for any number of nodes; this program will exit after all
        specified nodes have been found.  The IP address provided will be
        incremented for each node found, and nodes will be added in the order
        given on the command line.

    DEFAULTS:
        As with all object types, you can create a template node object called
        DEFAULT whose attributes will be used as the default values for all
        new nodes.  You can override some of these defaults using the options
        shown above.

    EXAMPLES:
        # wwnodescan --ipaddr 10.0.1.10 --netmask 255.255.0.0 --vnfs=sl6.vnfs
            --bootstrap=`uname -r` n0000 n0001

        # wwsh node new DEFAULT --groups=grp1,test
        # wwsh provision node DEFAULT --vnfs=sl6.vnfs --bootstrap=`uname -r`
        # wwnodescan --ipaddr 10.0.1.100 --netmask 255.255.0.0 n00[02-19]

VNFS 이미지를 만들때 시작 지점과 배포판을 지정할때 사용

wwmkvnfs 로 만든 디렉토리를 VNFS 이미지로 생성하는 유틸리티

# wwvnfs
_FORTIFY_SOURCE requires compiling with optimization (-O) at /usr/lib64/perl5/features.ph line 207.
USAGE: /usr/bin/wwvnfs [options] (name)

OPTIONS:

   -c, --chroot      Path to the chroot to use for this VNFS image
   -r, --root        Alias for --chroot
   -h, --help        Usage and help summary
   -o, --output      Output the binary VNFS to a file instead of importing it
                     directly into Warewulf
   -e, --exclude     Exclude a file or directory from the VNFS image
       --excludefile Path to a file that contains a list of files and directories to
                     exclude from the VNFS image
       --hybridize   Hybridize a list of files or directories from the VNFS image
                     (requires --hybridpath to be set, or files are just excluded)
       --hybridizefile Path to a file that contains a list of files and directories to
                     be hybridized from the VNFS image
       --hybridpath  Path to use within the VNFS where the links will be pointed to in
                     the final image (this needs to be added to the VNFS fstab!)

NOTES:

   When wwvnfs is run for the first time on a VNFS, it will attempt to create a
   configuration file in the default warewulf config dir (/etc/warewulf/vnfs/) or in
   the users ~/.warewulf/vnfs directory. Once the configuration file has been written
   and updated, you can simply run 'wwvnfs [vnfs_name]' to rebuild the image. You can
   temporarily override any of these options via command line arguments.

EXAMPLES:

   # wwvnfs --chroot=/var/chroots/rhel-6
   # wwvnfs custom_name --chroot=/var/chroots/rhel-6 --hybridpath=/hybrid/vnfs_name
   # wwvnfs --chroot=/var/chroots/rhel-6 --output=rhel-6.vnfs
   # wwvnfs custom_name

openHPC 문서 상에는 없는 녀석들. 정체가 머냐?

# wwuseradd
Adding user to this master
Usage: useradd [options] LOGIN
       useradd -D
       useradd -D [options]

Options:
  -b, --base-dir BASE_DIR       base directory for the home directory of the
                                new account
  -c, --comment COMMENT         GECOS field of the new account
  -d, --home-dir HOME_DIR       home directory of the new account
  -D, --defaults                print or change default useradd configuration
  -e, --expiredate EXPIRE_DATE  expiration date of the new account
  -f, --inactive INACTIVE       password inactivity period of the new account
  -g, --gid GROUP               name or ID of the primary group of the new
                                account
  -G, --groups GROUPS           list of supplementary groups of the new
                                account
  -h, --help                    display this help message and exit
  -k, --skel SKEL_DIR           use this alternative skeleton directory
  -K, --key KEY=VALUE           override /etc/login.defs defaults
  -l, --no-log-init             do not add the user to the lastlog and
                                faillog databases
  -m, --create-home             create the user's home directory
  -M, --no-create-home          do not create the user's home directory
  -N, --no-user-group           do not create a group with the same name as
                                the user
  -o, --non-unique              allow to create users with duplicate
                                (non-unique) UID
  -p, --password PASSWORD       encrypted password of the new account
  -r, --system                  create a system account
  -R, --root CHROOT_DIR         directory to chroot into
  -P, --prefix PREFIX_DIR       prefix directory where are located the /etc/* files
  -s, --shell SHELL             login shell of the new account
  -u, --uid UID                 user ID of the new account
  -U, --user-group              create a group with the same name as the user
  -Z, --selinux-user SEUSER     use a specific SEUSER for the SELinux user mapping

# wwsh --help
wwsh [wwsh options] [command] [object] [command options]
------------------------------------------------------------------------------
WWSH OPTIONS:
     --nodhcp       -- Do not update dhcpd.conf file.
  -d|--debug        -- Enable Debug Output
     --help         -- Print this help
  -v|--verbose      -- Enable Verbose Output
  -q|--quiet        -- Enable Quiet Mode
  -y|--yes|--noask  -- Assume 'Yes' to all questions


WWSH COMMANDS:
  help              -- Print command (module) help

# wwsh help
Warewulf command line shell interface

Welcome to the Warewulf shell interface. This application allows you
to interact with the Warewulf backend database and modules via a
single interface.

  bootstrap        Manage your bootstrap images
  dhcp             Manage DHCP service and configuration
  events           Control how events are handled
  exit             Exit/leave the Warewulf shell
  file             Manage files within the Warewulf data store
  ipmi             Node IPMI configuration
  node             Node manipulation commands
  object           Generically manipulate all Warewulf data store entries
  output           Set the output verbosity level
  provision        Node provision manipulation commands
  pxe              Manage PXE configuration
  quit             Exit/leave the Warewulf shell
  ssh              Spawn parallel ssh connections to nodes.
  vnfs             Manage your VNFS images

# wwsh help file
USAGE:
     file <command> [options] [targets]

SUMMARY:
     The file command is used for manipulating file objects.  It allows you to
     import, export, create, and modify files within the Warewulf data store.
     File objects may be used to supply files to nodes at provision time,
     dynamically create files or scripts based on Warewulf data and more.

COMMANDS:
     import             Import a file into a file object
     export             Export file object(s)
     edit               Edit the file in the data store directly
     new                Create a new file in the data store
     set                Set file attributes/metadata
     show               Show the contents of a file
     list               List a summary of imported file(s)
     print              Print all file attributes
     (re)sync           Sync the data of a file object with its source(s)
     delete             Remove a node configuration from the data store
     help               Show usage information

OPTIONS:
     -l, --lookup       Identify files by specified property (default: "name")
     -p, --program      What external program should be used (edit/show)
     -D, --path         Set destination (i.e., output) path for this file
     -o, --origin       Set origin (i.e., input) path for this file
     -m, --mode         Set permission attribute for this file
     -u, --uid          Set the UID for this file
     -g, --gid          Set the GID for this file
     -n, --name         Set the reference name for this file (not path!)
         --interpreter  Set the interpreter name to parse this file
         --overwrite    Overwrite the metadata in the file object on sync() to match the file at the origin path

NOTE:  Use "UNDEF" to erase the current contents of a given field.

EXAMPLES:
     Warewulf> file import /path/to/file/to/import --name=hosts-file
     Warewulf> file import /path/to/file/to/import/with/given-name
     Warewulf> file edit given-name
     Warewulf> file set given-name --origin=UNDEF --mode=0700
     Warewulf> file set hosts-file --path=/etc/hosts --mode=0644 --uid=0
     Warewulf> file list
     Warewulf> file delete name123 given-name

# wwsh help ssh
USAGE:
     ssh [nodes/targets] [command]

SUMMARY:
     Run ssh connections to node(s) in parallel by either node names, group
     or any other known lookup.

TARGETS:
     The target(s) specify which node(s) will be affected by the chosen
     action(s).  By default, node(s) will be identified by their name(s).
     Use the --lookup option to specify another property (e.g., "hwaddr"
     or "groups").

     All targets can be bracket expanded as follows:

         n00[0-99]       All nodes from n0000 through n0099 (inclusive)
         n00[00,10-99]   n0000 and all nodes from n0010 through n0099

OPTIONS:

     -l, --lookup        Identify nodes by specified property (default: "name")
     -a, --allnodes      Send command to all configured nodes

EXAMPLES:

     Warewulf> ssh n00[00-49] hostname
     Warewulf> ssh -l groups compute,interactive hostname


[root@localhost warewulf]# wwsh help node
USAGE:
     node <command> [options] [targets]

SUMMARY:
     The node command is used for viewing and manipulating node objects.

COMMANDS:
         new             Create a new node configuration
         set             Modify an existing node configuration
         list            List a summary of nodes
         print           Print the node configuration
         delete          Remove a node configuration from the data store
         clone           Clone a node configuration to another node
         help            Show usage information

TARGETS:
     The target(s) specify which node(s) will be affected by the chosen
     action(s).  By default, node(s) will be identified by their name(s).
     Use the --lookup option to specify another property (e.g., "hwaddr"
     or "groups").

     All targets can be bracket expanded as follows:

         n00[0-99]       All nodes from n0000 through n0099 (inclusive)
         n00[00,10-99]   n0000 and all nodes from n0010 through n0099

OPTIONS:
     -l, --lookup        Identify nodes by specified property (default: "name")
     -1                  With list command, output node name only
     -g, --groups        Specify all groups to which this node belongs
         --groupadd      Add node to specified group(s)
         --groupdel      Remove node from specified group(s)
     -D, --netdev        Specify network device to add or modify (defaults: eth0)
         --netdel        Remove specified netdev from node
         --netrename     Rename a given network interface
     -I, --ipaddr        Set IP address of given netdev
     -M, --netmask       Set subnet mask of given netdev
     -N, --network       Set network address of netdev
     -G, --gateway       Set gateway of given netdev
     -H, --hwaddr        Set hardware/MAC address
     -b, --bonddevs      Set bonding slave devices
     -B, --bondmode      Set bonding mode
     -f, --fqdn          Set FQDN of given netdev
     -m, --mtu           Set MTU of given netdev
     -p, --hwprefix      Specify a prefix for hardware/MAC address of a given netdev
     -c, --cluster       Specify cluster name for this node
         --domain        Specify domain name for this node
     -n, --name          Specify new name for this node
     -a, --arch          Specify architecture for this node (defaults: x86_64)
     -e, --enabled       Set whether the node is enabled (defaults: True)

EXAMPLES:
     Warewulf> node new n0000 --netdev=eth0 --hwaddr=xx:xx:xx:xx:xx:xx
     Warewulf> node set n0000 -D eth0 -I 10.0.0.10 -G 10.0.0.1
     Warewulf> node set n0000 --netdev=eth0 --netmask=255.255.255.0
     Warewulf> node set --groupadd=mygroup,hello,bye --cluster=mycluster n0000
     Warewulf> node set --groupdel=bye --set=vnfs=sl6.vnfs
     Warewulf> node list xx:xx:xx:xx:xx:xx --lookup=hwaddr
     Warewulf> node print --lookup=groups mygroup hello group123
     Warewulf> node clone n0000 new0000
     Warewulf> node set --enabled=false n0000
     Warewulf> node set --arch=x86_64 n0000