구차니의 잡동사니 모음

SSD 도 모델이군..

[링크 : https://pjreddie.com/darknet/yolo/]

[링크 : https://junjiwon1031.github.io/2017/09/08/Single-Shot-Multibox-Detector.html]

[링크 : https://medium.com/curg/you-only-look-once-다-단지-한-번만-보았을-뿐이라구-bddc8e6238e2]

[링크 : https://curt-park.github.io/2017-03-26/yolo/]

[링크 : https://pjreddie.com/darknet/yolo/]

[링크 : https://zeuseyera.github.io/darknet-kr/3_ImageNet_BunRyu/BunRyu.html]

*net?

AlexNet

[링크 : https://en.wikipedia.org/wiki/AlexNet]

VGGNet 이라는 CNN모델

[링크 : https://89douner.tistory.com/61]

LeNet, ZFNet, ...

[링크 : https://blog.naver.com/laonple/221218707503]

inception/googlenet

[링크 : https://ikkison.tistory.com/86]

[링크 : https://kangbk0120.github.io/articles/2018-01/inception-googlenet-review]

net으로 끝나서 먼가 했는데 일단은 이미지 데이터베이스, 단어 데이터베이스 인 듯.

단지 데이터베이스이기 때문에 딥 러닝에 용이해서 언급이 되는 건가?

ImageNet is an image database organized according to the WordNet hierarchy

[링크 : http://www.image-net.org/] imagenet

WordNet® is a large lexical database of English.

[링크 : https://wordnet.princeton.edu/] wordnet

COCO - Common Object in COntext

[링크 : https://cocodataset.org/#home]

회문인가?

찾는데 정말 안나오네 ㅠㅠ

[링크 : https://slurm.schedmd.com/mpi_guide.html]

Process Management Interface Exascale (PMIx) 

[링크 : https://openpmix.github.io/]

These process managers communicate with MPICH processes using a predefined interface called as PMI (process management interface).

[링크 : https://wiki.mpich.org/mpich/index.php/Frequently_Asked_Questions]

+

slurm.schedmd.com/mpiplugins.html

openhpc 문서에서 하라는대로만 따라해서

어떤 원리로 어떻게 관리되는지 알지 못해서 구조를 좀 파악해야할 필요가 발생 ㅠㅠ

[링크 : https://github.com/nicksan2c/wwsh]

[링크 : https://dokuwiki.wesleyan.edu/doku.php?id=cluster:144]

+

> file /usr/bin/ww*
/usr/bin/wwan:        symbolic link to bluetooth
/usr/bin/wwbootstrap: Perl script text executable
/usr/bin/wwconfig:    Perl script text executable
/usr/bin/wwinit:      Bourne-Again shell script, ASCII text executable
/usr/bin/wwlivesync:  Perl script text executable
/usr/bin/wwmkchroot:  Bourne-Again shell script, ASCII text executable
/usr/bin/wwnodescan:  Perl script text executable
/usr/bin/wwsh:        Perl script text executable
/usr/bin/wwuseradd:   POSIX shell script, ASCII text executable
/usr/bin/wwvnfs:      Perl script text executable

wwsh list 모음

> wwsh bootstrap list
BOOTSTRAP NAME            SIZE (M)      ARCH
5.3.18-lp152.57-default   58.0          x86_64

> wwsh ipmi list
NAME                AUTO    IPMI_IPADDR    IPMI_NETMASK
================================================================================
openhpc-1           no      UNDEF          UNDEF
openhpc-2           no      UNDEF          UNDEF

> wwsh node list
NAME                GROUPS              IPADDR              HWADDR
================================================================================
openhpc-1           UNDEF               10.0.2.4            08:00:27:4b:df:4f
openhpc-2           UNDEF               10.0.2.5            08:00:27:f9:ca:3f

> wwsh object list
NAME                       _TYPE
======================================================
passwd                     file
group                      file
shadow                     file
munge.key                  file
5.3.18-lp152.57-default    bootstrap
leap15.2                   vnfs
network                    file
openhpc-1                  node
dynamic_hosts              file
openhpc-2                  node

> wwsh provision list
NODE                VNFS            BOOTSTRAP             FILES
================================================================================
openhpc-1           leap15.2        5.3.18-lp152.57-de... dynamic_hosts,grou...
openhpc-2           leap15.2        5.3.18-lp152.57-de... dynamic_hosts,grou...

> wwsh vnfs list
VNFS NAME            SIZE (M)   ARCH       CHROOT LOCATION
leap15.2             480.1      x86_64     /opt/ohpc/admin/images/leap15.2

도움말 모음

rtl-sdr을 쓰지 않고 원본 드라이버로 먼가하고 싶긴한데 영 안되네..

rtl-sdr

libusb

librtlsdr

여러가지가 보이는데 서로 연관이 어떻게 되는건가..

[링크 : http://blog.tcltk.co.kr/?p=888]

[링크 : http://github.com/steve-m/librtlsdr/blob/master/src/librtlsdr.c]

mpirun

[링크 : http://www.brightcomputing.com/Blog/bid/151678/How-to-run-Linpack-across-a-Bright-Linux-cluster]

[링크 : http://www.open-mpi.org/faq/?category=slurm]

+ 2021.01.07

[링크 : https://juser.fz-juelich.de/record/851266/files/Parallel Programming (MPI) and Batch Usage (SLURM).pdf]

[링크 : https://thelinuxcluster.com/.../running-linpack-hpl-test-on-linux-cluster-with-openmpi-and-intel-compilers/]

[링크 : https://ulhpc-tutorials.readthedocs.io/en/latest/parallel/mpi/HPL/]

[링크 : https://stackoverflow.com/questions/13999415/how-do-you-specify-nodes-on-mpiruns-command-line]

[링크 : https://www.open-mpi.org/faq/?category=running#mpirun-scheduling]

mpirun 에 host 기재하기

mpirun 에 hostfile로 지정하기

[링크 : https://docs.oracle.com/cd/E19923-01/820-6793-10/ExecutingPrograms.html]

플러그 인을 보다 보니 PAL TV를 흑백으로 보여주는게 있네?

dll로 주어지는데 어떤식으로 프로그래밍 하는지 참 궁금하다.

능력되면 국내 DMB에 대해서 한번 디코딩 해보고 싶기도 하지만

은근히 대역폭이 넓어서 될 진 모르겠네..

[링크 : http://www.rtl-sdr.ru/page/no-title-2]

[링크 : https://www.rtl-sdr.com/sdrsharp-plugins/]

부팅하다 커널 패닉나서 다시 보니

vnfs를 정상적으로 붙이지 못하는 것 같네..

우여곡절 끝에 찾아보니 저놈의 checksum 값이 나오는 항목은 찾았는데..

vnfs가 어떤식으로 구성이 되는진 모르겠으나..

[링크 : https://groups.io/g/OpenHPC-users/topic/stateful_provisioning_issues/7717941?p=]

# md5sum /srv/warewulf/bootstrap/x86_64/5/initfs.gz
94a63f3001bf9f738bd716a5ab71d61f  /srv/warewulf/bootstrap/x86_64/5/initfs.gz

이거 그건가...? extracting 에서 error가 발생했는데 엉뚱한데를 짚은건가?

+

2021.01.07

그러고 보니 왜 ID가 6인거지?

+

정상작동하는 openhpc/centos 에서도 ID:6 인데 extrating은 정상적으로 넘어간다.

체크섬도 여기서 나오는 같이랑 동일한데, SKIPPED 인건 문제가 없는건가.. 기본값이 SKIP인가?

굴러 다니고 안쓰고 있던(?) 미니 CD에서

어떤 프로그램을 써서 보는건가 했는데 찾아보니 나오긴 하네

[링크 : http://www.blazevideo.com/hdtv-player/]

[링크 : http://dalvikplanet.blogspot.com/2017/03/how-to-get-working-rtl2832u-r820t2-on.html]

[링크 : https://www.amazon.co.uk/Cheap-DVB-T-RTL2832U-R820T-antenna/dp/B00BYQMGZG]

얘도 SDR이네 ㅠㅠ

[링크 : https://www.onetransistor.eu/2017/08/fmplayer-realtek-rtl2832u.html]

+

드라이버 받아서 설치하니 먼가 되긴한데 evaluation 날짜 지났다고(지금 깔았는데?)

채널 탐색이 안된다 ㅠㅠ

+

smartdvb라는게 보여서 해보는데...

국내에서는 어짜피 DVB-T / DAB가 없으니 안되려나?

아무튼 이것저것 만져보는데 FM은 안보인다

언제나 그렇듯!

.bashrc에 환경 변수 설정

다만, /root 의 .bashrc로 생성해서 환경 변수를 넣어 주는것이 편리하다. (추후 "sudo su -" 를 쓰기 편하기 위해)

openSUSE는 eth1로 뜨네?

2020/12/02 - [프로그램 사용/slurm] - openHPC 설치 part 1?

+ DHCP로 ip는 받는데 tftp로 파일을 받아오지 못해서 확인해보니

SuSEfirewall2 라는 서비스 대신 firewalld로 suse leap 15 버전에서는 서비스 명칭이 변경되었다.

ohpc용 저장소 추가 (특이하게 rpm을 쓰네?)

ohpc용 기본 패키지 설치

zypper는 처음 써보는데.. 아무생각없이 하라는 대로 했더니 -n 옵션이 reject로 기본 입력되서 설치가 되지 않는다.

그냥 -n 빼고 물어볼 때 t(temporary)나 a(always)를 선택해 주어야 한다.

(sudo su 로 해보니 root는 -n이 y이고 일반 유저는 reject으로 설정이 되어있는 듯 하다)

> sudo zypper -n install ohpc-base ohpc-warewulf

New repository or package signing key received:

  Repository:       OpenHPC-2 - Base
  Key Name:         private OBS (key without passphrase) <defaultkey@localobs>
  Key Fingerprint:  5392744D 3C543ED5 784765E6 8A306019 DA565C6C
  Key Created:      Tue 17 Dec 2019 04:09:12 AM KST
  Key Expires:      (does not expire)
  Subkey:           210B8BF01271E2F2 2019-12-17 [does not expire]
  Rpm Name:         gpg-pubkey-da565c6c-5df7d658


Do you want to reject the key, trust temporarily, or trust always? [r/t/a/?] (r): r
Error building the cache:
[OpenHPC|http://repos.openhpc.community/OpenHPC/2/Leap_15] Valid metadata not found at specified URL
History:
 - Signature verification failed for repomd.xml
 - Can't provide /repodata/repomd.xml

Warning: Skipping repository 'OpenHPC-2 - Base' because of the above error.

귀찮으니 죽죽죽~ ㅋㅋ

3.3 Add provisioning services on master node
$ sudo su -
systemctl enable chronyd.service
echo "server ${ntp_server}" >> /etc/chrony.conf
echo "allow all" >> /etc/chrony.conf
systemctl restart chronyd

3.4 Add resource management services on master node
zypper -n install ohpc-slurm-server
cp /etc/slurm/slurm.conf.ohpc /etc/slurm/slurm.conf
perl -pi -e "s/ControlMachine=\S+/ControlMachine=${sms_name}/" /etc/slurm/slurm.conf

3.7 Complete basic Warewulf setup for master node
perl -pi -e "s/device = eth1/device = ${sms_eth_internal}/" /etc/warewulf/provision.conf
perl -pi -e "s/^DHCPD_INTERFACE=\S+/DHCPD_INTERFACE=${sms_eth_internal}/" /etc/sysconfig/dhcpd
systemctl enable tftp.socket
perl -pi -e "s#\#tftpdir = /var/lib/#tftpdir = /srv/#" /etc/warewulf/provision.conf
export MODFILE=/etc/apache2/conf.d/warewulf-httpd.conf
perl -pi -e "s#modules/mod_perl.so\$#/usr/lib64/apache2/mod_perl.so#" $MODFILE
perl -pi -e "s#modules/mod_version.so\$#/usr/lib64/apache2/mod_version.so#" $MODFILE

ip link set dev ${sms_eth_internal} up
ip address add ${sms_ip}/${internal_netmask} broadcast + dev ${sms_eth_internal}

systemctl enable mysql
systemctl restart mysql
systemctl enable apache2.service
systemctl restart apache2
systemctl enable dhcpd.service
systemctl enable tftp.socket
systemctl start tftp.socket

3.8.1 Build initial BOS image
mkdir -p -m 755 $CHROOT
mkdir -m 755 $CHROOT/dev
mknod -m 666 $CHROOT/dev/zero c 1 5
wwmkchroot -v opensuse-15.2 $CHROOT
cp -p /etc/zypp/repos.d/OpenHPC*.repo $CHROOT/etc/zypp/repos.d
zypper -n --root $CHROOT --no-gpg-checks --gpg-auto-import-keys refresh

3.8.2 Add OpenHPC components
zypper -n --root $CHROOT install ohpc-base-compute
cp -p /etc/resolv.conf $CHROOT/etc/resolv.conf
zypper -n --root $CHROOT --no-gpg-checks --gpg-auto-import-keys refresh
cp /etc/passwd /etc/group $CHROOT/etc
zypper -n --root $CHROOT install ohpc-slurm-client
chroot $CHROOT systemctl enable munge
echo SLURMD_OPTIONS="--conf-server ${sms_ip}" > $CHROOT/etc/sysconfig/slurmd
cp /opt/ohpc/pub/examples/udev/60-ipath.rules $CHROOT/etc/udev/rules.d/
zypper -n --root $CHROOT install chrony #(에러 발생)
chroot $CHROOT systemctl enable chrony #(에러 발생)
echo "server ${sms_ip}" >> $CHROOT/etc/chrony.conf
zypper -n --root $CHROOT install kernel-default
zypper -n --root $CHROOT install lmod-ohpc
chroot $CHROOT systemctl enable sshd.service
mv $CHROOT/etc/hostname $CHROOT/etc/hostname.orig

3.8.3 Customize system configuration
wwinit database
wwinit ssh_keys
echo "${sms_ip}:/home /home nfs nfsvers=3,nodev,nosuid 0 0" >> $CHROOT/etc/fstab
echo "${sms_ip}:/opt/ohpc/pub /opt/ohpc/pub nfs nfsvers=3,nodev 0 0" >> $CHROOT/etc/fstab
echo "/home *(rw,no_subtree_check,fsid=10,no_root_squash)" >> /etc/exports
echo "/opt/ohpc/pub *(ro,no_subtree_check,fsid=11)" >> /etc/exports
exportfs -a
systemctl restart nfs-server
systemctl enable nfs-server

3.8.5 Import files
wwsh file import /etc/passwd
wwsh file import /etc/group
wwsh file import /etc/shadow
wwsh file import /etc/munge/munge.key

3.9.1 Assemble bootstrap image
wwbootstrap `uname -r`

3.9.2 Assemble Virtual Node File System (VNFS) image
wwvnfs --chroot $CHROOT

3.9.3 Register nodes for provisioning
echo "GATEWAYDEV=${eth_provision}" > /tmp/network.$$
wwsh -y file import /tmp/network.$$ --name network
wwsh -y file set network --path /etc/sysconfig/network --mode=0644 --uid=0
for ((i=0; i<$num_computes; i++)) ; do
wwsh -y node new ${c_name[i]} --ipaddr=${c_ip[i]} --hwaddr=${c_mac[i]} -D ${eth_provision}
done
wwsh -y provision set "${compute_regex}" --vnfs=leap15.2 --bootstrap=`uname -r` \
--files=dynamic_hosts,passwd,group,shadow,munge.key,network
systemctl restart dhcpd
wwsh pxe update