Notes: Difference between revisions

From Omnia
Jump to navigation Jump to search
(Created page with "= 2024.01.20 = == Redudnant NFS == Ubuntu 22 LTS Create a Highly Available NFS Service with Gluster and Oracle Linux https://docs.oracle.com/en/learn/ol-ha-nfs/index.html apt remove nfs-kernel-server apt update apt install -y corosync glusterfs-cli glusterfs-server nfs-ganesha-gluster pacemaker pcs pcp-zeroconf fence-agents Create an XFS filesystem: sudo mkfs.xfs -f -i size=512 -L gluster-000 /dev/sdb Create Mountpoint: sudo mkdir -p /data/gfs echo 'LABEL=...")
 
 
(7 intermediate revisions by the same user not shown)
Line 1: Line 1:
= 2024.02.06 =
== FOG Project ==
A free open-source network computer cloning and management solution
https://fogproject.org/
FOG Wiki
https://wiki.fogproject.org/wiki
FOG Documentation
https://docs.fogproject.org/en/latest
Advanced Boot Menu
https://docs.fogproject.org/en/latest/kb/customization/advanced-boot-menu/
---
Building undionly.kpxe - FOG Project
https://wiki.fogproject.org/wiki/index.php?title=Building_undionly.kpxe
wget https://svn.code.sf.net/p/freeghost/code/trunk/src/ipxe/src/ipxescript
ipxescript:
<pre>
#!ipxe
ifopen
isset ${net0/mac} && dhcp net0 || goto dhcpnet1
echo Received DHCP answer on interface net0 && goto proxycheck
:dhcpnet1
isset ${net1/mac} && dhcp net1 || goto dhcpnet2
echo Received DHCP answer on interface net1 && goto proxycheck
:dhcpnet2
isset ${net2/mac} && dhcp net2 || goto dhcpall
echo Received DHCP anser on infterface net2 && goto proxycheck
:dhcpall
dhcp && goto proxycheck || goto dhcperror
:dhcperror
prompt --key s --timeout 10000 DHCP failed, hit 's' for the iPXE shell; reboot in 10 seconds && shell || reboot
:proxycheck
isset ${proxydhcp/next-server} && set next-server ${proxydhcp/next-server} || goto nextservercheck
:nextservercheck
isset ${next-server} && goto netboot || goto setserv
:setserv
echo -n Please enter tftp server: && read next-server && goto netboot || goto setserv
:netboot
chain tftp://${next-server}/default.ipxe ||
prompt --key s --timeout 10000 Chainloading failed, hit 's' for the iPXE shell; reboot in 10 seconds && shell || reboot
</pre>
== MAAS DHCP Notes ==
How do I modify the pxe config in MAAS? - Ask Ubuntu
https://askubuntu.com/questions/130772/how-do-i-modify-the-pxe-config-in-maas
iPXE can't boot UEFI mode via USB key - Printable Version
https://forum.ipxe.org/printthread.php?tid=13245
== MAAS DHCP ==
networking - How do I use MAAS and Juju with an existing DHCP server? - Ask Ubuntu
https://askubuntu.com/questions/427030/how-do-i-use-maas-and-juju-with-an-existing-dhcp-server
<pre>
subnet 192.168.2.0 netmask 255.255.255.0 {
  range 192.168.2.128 192.168.2.254;
  option routers 192.168.2.1;
  filename "/pxelinux.0";
}
</pre>
next-server
---
Additional Configuration — MAAS 1.6 documentation
http://web.archive.org/web/20140705024900/http://maas.ubuntu.com/docs/configure.html
<pre>
subnet 192.168.122.0 netmask 255.255.255.0 {
    filename "pxelinux.0";
    option subnet-mask 255.255.255.0;
    option broadcast-address 192.168.122.255;
    option domain-name-servers 192.168.122.136;
    range dynamic-bootp 192.168.122.5 192.168.122.135;
}
</pre>
---
MaaS with an external DHCP server (EdgeMax)
https://portegi.es/blog/maas-1
<pre>
bootfile-name bootx64.efi
bootfile-server 192.168.4.118
subnet-parameters "filename &quot;bootx64.efi&quot;;"
tftp-server-name 192.168.4.118
</pre>
based on /var/lib/maas/dhcpd.conf you get...
<pre>
#
# Bootloaders
#
if option arch = 00:00 {
    # pxe
    filename "pxelinux.0";
} elsif option arch = 00:07 {
    # uefi_amd64
    filename "bootx64.efi";
} elsif option arch = 00:09 {
    # uefi_amd64
    filename "bootx64.efi";
} elsif option arch = 00:0B {
    # uefi_arm64
    filename "grubaa64.efi";
} elsif option arch = 00:0C {
    # open-firmware_ppc64el
    filename "bootppc64.bin";
} elsif option arch = 00:0E {
    # powernv
    filename "pxelinux.0";
    option path-prefix "ppc64el/";
} else {
    # pxe
    filename "pxelinux.0";
}
</pre>
Although this site references 'grubx64.efi' - https://discourse.maas.io/t/arm-and-uefi-clients-dont-get-boot-from-maas/7831
=== MAAS Preesed ===
/etc/maas/preseeds/generic
/etc/maas/preseeds/preseed-master
ref:
Additional Configuration — MAAS 1.6 documentation
http://web.archive.org/web/20140705024900/http://maas.ubuntu.com/docs/configure.html
=== MAAS Windows ===
Creating a MAAS Image Builder Server (Windows Server 2022 example) — Crying Cloud
https://www.cryingcloud.com/blog/2022/10/19/create-azure-stack-hci-images-for-use-with-maas
MAAS | How to customise images
https://maas.io/docs/customising-images-for-specific-needs
= 2024.01.20 =
= 2024.01.20 =



Latest revision as of 01:29, 10 February 2024

2024.02.06

FOG Project

A free open-source network computer cloning and management solution
https://fogproject.org/
FOG Wiki
https://wiki.fogproject.org/wiki
FOG Documentation
https://docs.fogproject.org/en/latest
Advanced Boot Menu
https://docs.fogproject.org/en/latest/kb/customization/advanced-boot-menu/

---

Building undionly.kpxe - FOG Project
https://wiki.fogproject.org/wiki/index.php?title=Building_undionly.kpxe
wget https://svn.code.sf.net/p/freeghost/code/trunk/src/ipxe/src/ipxescript

ipxescript:

#!ipxe
ifopen
isset ${net0/mac} && dhcp net0 || goto dhcpnet1
echo Received DHCP answer on interface net0 && goto proxycheck

:dhcpnet1
isset ${net1/mac} && dhcp net1 || goto dhcpnet2
echo Received DHCP answer on interface net1 && goto proxycheck

:dhcpnet2
isset ${net2/mac} && dhcp net2 || goto dhcpall
echo Received DHCP anser on infterface net2 && goto proxycheck

:dhcpall
dhcp && goto proxycheck || goto dhcperror

:dhcperror
prompt --key s --timeout 10000 DHCP failed, hit 's' for the iPXE shell; reboot in 10 seconds && shell || reboot

:proxycheck
isset ${proxydhcp/next-server} && set next-server ${proxydhcp/next-server} || goto nextservercheck

:nextservercheck
isset ${next-server} && goto netboot || goto setserv

:setserv
echo -n Please enter tftp server: && read next-server && goto netboot || goto setserv

:netboot
chain tftp://${next-server}/default.ipxe ||
prompt --key s --timeout 10000 Chainloading failed, hit 's' for the iPXE shell; reboot in 10 seconds && shell || reboot

MAAS DHCP Notes

How do I modify the pxe config in MAAS? - Ask Ubuntu
https://askubuntu.com/questions/130772/how-do-i-modify-the-pxe-config-in-maas
iPXE can't boot UEFI mode via USB key - Printable Version
https://forum.ipxe.org/printthread.php?tid=13245

MAAS DHCP

networking - How do I use MAAS and Juju with an existing DHCP server? - Ask Ubuntu
https://askubuntu.com/questions/427030/how-do-i-use-maas-and-juju-with-an-existing-dhcp-server
subnet 192.168.2.0 netmask 255.255.255.0 {
  range 192.168.2.128 192.168.2.254;
  option routers 192.168.2.1;
  filename "/pxelinux.0";
}
next-server

---

Additional Configuration — MAAS 1.6 documentation
http://web.archive.org/web/20140705024900/http://maas.ubuntu.com/docs/configure.html
subnet 192.168.122.0 netmask 255.255.255.0 {
    filename "pxelinux.0";
    option subnet-mask 255.255.255.0;
    option broadcast-address 192.168.122.255;
    option domain-name-servers 192.168.122.136;
    range dynamic-bootp 192.168.122.5 192.168.122.135;
}

---

MaaS with an external DHCP server (EdgeMax)
https://portegi.es/blog/maas-1
bootfile-name bootx64.efi
bootfile-server 192.168.4.118
subnet-parameters "filename "bootx64.efi";"
tftp-server-name 192.168.4.118

based on /var/lib/maas/dhcpd.conf you get...

#
# Bootloaders
#
if option arch = 00:00 {
    # pxe
    filename "pxelinux.0";
} elsif option arch = 00:07 {
    # uefi_amd64
    filename "bootx64.efi";
} elsif option arch = 00:09 {
    # uefi_amd64
    filename "bootx64.efi";
} elsif option arch = 00:0B {
    # uefi_arm64
    filename "grubaa64.efi";
} elsif option arch = 00:0C {
    # open-firmware_ppc64el
    filename "bootppc64.bin";
} elsif option arch = 00:0E {
    # powernv
    filename "pxelinux.0";
    option path-prefix "ppc64el/";
} else {
    # pxe
    filename "pxelinux.0";
}

Although this site references 'grubx64.efi' - https://discourse.maas.io/t/arm-and-uefi-clients-dont-get-boot-from-maas/7831

MAAS Preesed

/etc/maas/preseeds/generic
/etc/maas/preseeds/preseed-master

ref:

Additional Configuration — MAAS 1.6 documentation
http://web.archive.org/web/20140705024900/http://maas.ubuntu.com/docs/configure.html

MAAS Windows

Creating a MAAS Image Builder Server (Windows Server 2022 example) — Crying Cloud
https://www.cryingcloud.com/blog/2022/10/19/create-azure-stack-hci-images-for-use-with-maas
MAAS | How to customise images
https://maas.io/docs/customising-images-for-specific-needs

2024.01.20

Redudnant NFS

Ubuntu 22 LTS

Create a Highly Available NFS Service with Gluster and Oracle Linux
https://docs.oracle.com/en/learn/ol-ha-nfs/index.html
apt remove nfs-kernel-server
apt update
apt install -y corosync glusterfs-cli glusterfs-server nfs-ganesha-gluster pacemaker pcs pcp-zeroconf fence-agents

Create an XFS filesystem:

sudo mkfs.xfs -f -i size=512 -L gluster-000 /dev/sdb

Create Mountpoint:

sudo mkdir -p /data/gfs
echo 'LABEL=gluster-000 /data/gfs xfs defaults  0 0' | sudo tee -a /etc/fstab > /dev/null
sudo mount /data/gfs

Start Gluster Service (on all nodes):

sudo systemctl enable --now glusterd

Add nodes to Cluster (from any node in the pool, or initial node of 1):

sudo gluster peer probe [node2]
sudo gluster peer probe [nodeX...]

If you need to remove a node:

sudo gluster detach [node]

Get Glsuter Status: (check from each node, and make sure all nodes are communicating)

gluster pool list
gluster peer status

Create a Gluster shared volume: (from any node)

sudo gluster volume create sharedvol replica 3 node{1,2,3}:/data/gfs/brick

Create 2 way replicated distributed volume:

sudo gluster volume create [MYGFS] replica 2 node{1,2,3,4,5,6}:/data/gfs/brick
sudo gluster volume create mygfs replica 2 lmt-store-0{2,3,4,5,6,7}.ess.lab:/data/gfs/brick

NOTE: Replica 2 volumes are prone to split-brain. Use Arbiter or Replica 3 to avoid this. See:

http://docs.gluster.org/en/latest/Administrator-Guide/Split-brain-and-ways-to-deal-with-it/
sudo gluster volume create mygfs replica 3 lmt-store-0{2,3,4,5,6,7}.ess.lab:/data/gfs/brick

To reduce storage requirements you can use a Arbiter for the 3rd: [1]

# Creating a replicated volume with an arbiter
sudo gluster volume create myvolume replica 3 arbiter 1 node{1,2,3}:/data/glusterfs/myvolume/mybrick/brick
# Creating a distributed replicated volume with one brick on six nodes with an arbiter
sudo gluster volume create myvolume replica 3 arbiter 1 node{1..6}:/data/glusterfs/myvolume/mybrick/brick


Different distribution and repliation styles [1]

Four Node Distributed Replicated Volume with a Two-way Replication: [2]

gluster volume create test-volume replica 2 transport tcp server1:/exp1/brick server2:/exp2/brick server3:/exp3/brick server4:/exp4/brick

Six Node Distributed Replicated Volume with a Two-way Replication: [3]

gluster volume create test-volume replica 2 transport tcp server1:/exp1/brick server2:/exp2/brick server3:/exp3/brick server4:/exp4/brick server5:/exp5/brick server6:/exp6/brick

Get volume info:

gluster volume info

If you wish to enable NFS (not recommended, use NFS-Ganesha instead): [2]

WARNING: Gluster NFS is being deprecated in favor of NFS-Ganesha
gluster volume set [VOLNAME] nfs.disable off
# to set NFS ACLs:
gluster volume set [VOLNAME] nfs.acl on

Enable volume (this will change "Status: Created" to "Status: Started"): (from any node)

gluster volume start [VOLUMENAME]

Get Volume Status:

gluster volume status

---

Setting Up Volumes - Gluster Docs - Volume Types (Distributed / Replicated / Disperesed)
https://docs.gluster.org/en/main/Administrator-Guide/Setting-Up-Volumes/#creating-distributed-replicated-volumes

Volume Types

Volumes of the following types can be created in your storage environment:
  • Distributed - Distributed volumes distribute files across the bricks in the volume. You can use distributed volumes where the requirement is to scale storage and the redundancy is either not important or is provided by other hardware/software layers.
  • Replicated – Replicated volumes replicate files across bricks in the volume. You can use replicated volumes in environments where high-availability and high-reliability are critical.
  • Distributed Replicated - Distributed replicated volumes distribute files across replicated bricks in the volume. You can use distributed replicated volumes in environments where the requirement is to scale storage and high-reliability is critical. Distributed replicated volumes also offer improved read performance in most environments.
  • Dispersed - Dispersed volumes are based on erasure codes, providing space-efficient protection against disk or server failures. It stores an encoded fragment of the original file to each brick in a way that only a subset of the fragments is needed to recover the original file. The number of bricks that can be missing without losing access to data is configured by the administrator on volume creation time.
  • Distributed Dispersed - Distributed dispersed volumes distribute files across dispersed subvolumes. This has the same advantages of distribute replicate volumes, but using disperse to store the data into the bricks.

---

NFS-Ganesha

/etc/ganesha/ganesha.conf :

EXPORT{
    Export_Id = 1 ;       # Unique identifier for each EXPORT (share)
    Path = "/sharedvol";  # Export path of our NFS share

    FSAL {
        name = GLUSTER;          # Backing type is Gluster
        hostname = "localhost";  # Hostname of Gluster server
        volume = "sharedvol";    # The name of our Gluster volume
    }

    Access_type = RW;          # Export access permissions
    Squash = No_root_squash;   # Control NFS root squashing
    Disable_ACL = FALSE;       # Enable NFSv4 ACLs
    Pseudo = "/sharedvol";     # NFSv4 pseudo path for our NFS share
    Protocols = "3","4" ;      # NFS protocols supported
    Transports = "UDP","TCP" ; # Transport protocols supported
    SecType = "sys";           # NFS Security flavors supported
}

systemctl status nfs-ganesha

systemctl restart nfs-ganesha

---

Mount directly:

sudo apt-get install glusterfs-client

mount -t glusterfs nodes[x]:/mygfs /mnt

Allow from all machines, or specify IPs comman seperated:

sudo gluster volume set volume1 auth.allow *

---

Many many more exmaples:

Oracle® Linux Gluster Storage for Oracle Linux User's Guide - Chapter 4 Creating and Managing Volumes
https://docs.oracle.com/en/operating-systems/oracle-linux/gluster-storage/gluster-using.html#4.3.1-Using-the-Volume-Status-Command

keywords