Differences

This shows you the differences between two versions of the page.

--- ceph:extending_cluster_bootstrap [2019/07/23 06:53] – [Variables used in this documentation] dodger
+++ ceph:extending_cluster_bootstrap [Unknown date] (current) – removed - external edit (Unknown date) 127.0.0.1
@@ Line 1: / Line 1: @@
-====== Extending the cluster: bootstrap vm's ======
-^  Documentation  ^|
-^Name:| Extending the cluster: bootstrap vm's |
-^Description:| How to add more nodes to a running cluster (the beginning) |
-^Modification date :|19/07/2019|
-^Owner:|dodger@ciberterminal.net|
-^Notify changes to:|Owner |
-^Tags:|ceph, object storage |
-====== Variables used in this documentation ======
-^ Name ^ Description ^ Sample ^
-| ''${THESERVER}'' | Variable used as salt target, it can be a mask of serves (see sample) | <code bash>export THESERVER="pro-mon-00[56]*"</code> |
-| ''${NEWSERVERS}'' | Variable used for ''clonewars'' target and ''ceph-deploy'' | <code bash>export NEWSERVERS="pro-mon-005 pro-mon-006"</code> |
-| ''${VMNAMESTART}'' | Variable used to perform a regex in ''salt'' execution, it will match the environment (''pro'', ''pre'' ...) | <code bash>export VMNAMESTART="pro"</code> |
-====== Instructions ======
-===== SALT PART =====
-<WRAP center round info 60%>
-SALT part
-</WRAP>
-===== Deploy the new VM's for new nodes =====
-Use clonewars with the following ops:
-<code bash>
-bash CloneWars.sh -c ${NUTANIXCLUSTER} -h ${THESERVER} -i ${THEIPADDRESS}  -d 50GB -m 20 -O -r 4096 -v 2 -o 2
-</code>
-===== Run salt basic states =====
-  - Connect to salt-master
-  - Run the following ''sls''
-<code bash>
-salt "${THESERVER}" state.apply
-salt "${THESERVER}" state.apply nsupdate
-</code>
-=== Install yum-plugin-priorities =====
-In all the servers:
-<code bash>
-salt "${THESERVER}" pkg.install yum-plugin-priorities
-</code>
-===== Install ceph-deploy  =====
-In the adm:
-<code bash>
-salt "${THESERVER}" pkg.install ceph-deploy
-</code>
-===== Add ceph user  =====
-In all the servers:
-<code bash>
-salt "${THESERVER}" user.add ceph 1002
-</code>
-Check:
-<code bash>
-salt "${THESERVER}" user.info ceph
-</code>
-===== Add ceph user to sudoers  =====
-In all the servers:
-<code bash>
-salt "${THESERVER}" file.write /etc/sudoers.d/ceph \
-"ceph ALL = (root) NOPASSWD:ALL"
-</code>
-Check:
-<code bash>
-salt "${THESERVER}" cmd.run 'cat /etc/sudoers.d/ceph'
-salt "${THESERVER}" cmd.run "sudo whoami" runas=ceph
-</code>
-===== Generate ssh keys =====
-All the servers:
-<code bash>
-salt "${THESERVER}" cmd.run \
-    "ssh-keygen -q -N '' -f /home/ceph/.ssh/id_rsa" \
-    runas=ceph
-</code>
-===== Populate ssh keys =====
-Allow self node to ssh itself:
-<code bash>
-salt "${THESERVER}" cmd.run "cp /home/ceph/.ssh/id_rsa.pub /home/ceph/.ssh/authorized_keys"
-</code>
-Get pub keys, from ''${NEWSERVERS}'' servers:
-<code bash>
-salt "${THESERVER}" cmd.run "cat /home/ceph/.ssh/id_rsa.pub" |egrep -v "^${VMNAMESTART}" | sed 's/^[[:space:]]\{1,5\}//g' > auth_keys_oss.txt
-</code>
-Get the pub keys from all the cluster nodes (''${THESERVER}'' **Must** match all the nodes in the cluster):
-<code bash>
-salt "${THESERVER}" cmd.run "cat /home/ceph/.ssh/id_rsa.pub" |egrep -v "^${VMNAMESTART}" | sed 's/^[[:space:]]\{1,5\}//g' > all_cluster_nodes.txt
-</code>
-\\
-Populate the pub keys from all cluster to ''${NEWSERVERS}'' (''${THESERVER}'' **Must** match only ''${NEWSERVERS}'' the nodes in the cluster):
-<code bash>
-while read LINE ; do salt "${THESERVER}" file.append /home/ceph/.ssh/authorized_keys "${LINE}" ; done < all_cluster_nodes.txt
-</code>
-\\
-Populate the keys from ''${NEWSERVERS}'' to the rest of the cluster (''${THESERVER}'' **Must** match all the nodes in the cluster: yes, you'll duplicate some keys, but it does not matter):
-<code bash>
-while read LINE ; do salt "${THESERVER}" file.append /home/ceph/.ssh/authorized_keys "${LINE}" ; done < auth_keys_oss.txt
-</code>
-\\
-===== Ceph admin node PART =====
-<WRAP center round info 60%>
-Ceph admin node PART
-</WRAP>
-===== Upload ceph.repo =====
-Copy ''ceph.repo'' from the admin node to the new nodes:
-<code bash>
-for i in ${NEWSERVERS} ; do scp /etc/yum.repos.d/ceph.repo ${i}:/home/ceph/ ; ssh ${i} "sudo mv /home/ceph/ceph.repo /etc/yum.repos.d/" ; done
-for i in ${NEWSERVERS} ; do ssh ${i} "sudo chown root. /etc/yum.repos.d/ceph.repo" ; done
-for i in ${NEWSERVERS} ; do ssh ${i} "ls -l /etc/yum.repos.d/" ; done
-</code>
-===== Install ceph =====
-<code bash>
-ceph-deploy install ${NEWSERVERS}
-</code>
-====== DONE ======