[关闭]
@zhangyy 2018-05-24T23:09:19.000000Z 字数 1534 阅读 151

hdp 2.6.5 增加数据节点

大数据平台构建


  • 一: 新增节点的数据系统初始
  • 二: 增加数据节点的步骤

一:新增节点的数据系统初始

1.1 系统主机名:

  1. 系统:RHEL7.5x64
  2. cat /etc/hosts
  3. 172.17.100.21 ZY-001.flyfish
  4. 172.17.100.22 ZY-002.flyfish
  5. 172.17.100.23 ZY-003.flyfish
  6. 172.17.100.24 ZY-004.flyfish
  7. ZY-004.flyfish 作为增加节点

image_1ce92nmp8ifib6kjrf1jjk1ih09.png-95.6kB

1.2 新增节点关闭防火墙与selinux

  1. yum install -y firewall* iptable*
  2. (1) 关闭firewalld
  3. systemctl stop firewalld.service
  4. systemctl disable firewalld.service
  5. firewall-cmd --state
  6. (2) 关闭iptables
  7. iptables -F
  8. systemctl stop iptables.service
  9. service iptables save
  10. systemctl disable iptables.service
  11. (3) 禁用 selinux
  12. sed -i '/SELINUX/s/enforcing/disabled/' /etc/selinux/config
  13. setenforce 0
  14. getenforce 0
  15. sestatus
  16. 重启机器
  17. reboot

image_1ce92og43dc61f1l1cfctcs1a38m.png-91.1kB

1.3 无密钥登录

  1. root用户无密钥认证
  2. ssh-keygen ---一直敲回车到最后
  3. cat id_rsa.pub >> authorized_keys
  4. 将所有的公钥导入authorized_keys 分发到 所有的 机器的.ssh/ 下面
  5. 然后测试
  6. ---
  7. ssh zy-004.flyfish

image_1ce92ub511soa13fvhmt207s4013.png-270kB

image_1ce92v1gq19pm5sk1hso181q1quk1g.png-201.3kB

image_1ce92vhe7at41gvu1vcin8lm91t.png-78.4kB

1.4 ZY-004.flyfish时间同步 ZY-001.flyfish

  1. login:
  2. ZY-002.flyfish
  3. scp /etc/chrony.conf ZY-004.flyfish:/etc/
  4. login:
  5. ZY-004.flyfish
  6. service chronyd stop
  7. service chronyd start
  8. chkconfig chronyd on
  9. chronyc sources -v

image_1ce933r041kne8ieisc1hsnq0o2a.png-115kB

1.png-83.7kB

2.png-104.7kB

1.5 句柄数更改

  1. login:
  2. ZY-001.flyfish
  3. scp /etc/security/limits.conf zy-004.flyfish:/etc/security/

image_1ce93kvr817sp1a1u1c7q15dkjm4c.png-56.2kB

1.6 同步yum源

  1. cd /etc/yum.repos.d/
  2. scp ambari.repo hdp.gpl.repo hdp.repo ZY-004.flyfish:/etc/yum.repos.d/
  3. login:
  4. ZY-004.flyfish
  5. mount /dev/cdrom /media/
  6. yum makecache

image_1ce94bn4amqkuan1k2u9t3je6t.png-114.1kB

image_1ce95ckpi1u3s7mfodt1ddgj428u.png-162.1kB

1.7 安装 jdk

  1. login:
  2. ZY-001.flyfish
  3. scp jdk-8u162-linux-x64.tar.gz ZY-004.flyfish:/root
  4. scp /etc/profile ZY-004.flyfish:/etc/
  5. login:
  6. ZY-004.flyfish
  7. tar -zxvf jdk-8u162-linux-x64.tar.gz -C /training/
  8. cd /training
  9. ln -s jdk1.8.0_162/ jdk
  10. source /etc/profile
  11. java -version

image_1ce940mam1i1fh0abqvpsahik59.png-158.9kB

1.8 : 关于补丁包

  1. libtirpc-0.2.4-0.10.el7.x86_64.rpm
  2. libtirpc-devel-0.2.4-0.10.el7.x86_64.rpm
  3. ---
  4. scp libtirpc-* ZY-004.flyfish:/root
  5. login
  6. ZY-004.flyfish
  7. rpm -ivh libtirpc-*

image_1ce95mg811sr91gvcg6d6vthka9b.png-123.3kB

二: 增加数据节点的步骤

image_1ce943d0j1ram1sa54av1cpi1tlg5m.png-285.5kB

image_1ce94402u1dv81p2k138t5dl1u4o63.png-267.6kB

image_1ce945s83j5311j4sjr1tuijh86g.png-331.2kB

image_1ce94caiknu2129b4q01qpt1hs07a.png-350.8kB

image_1ce95p97p1qvh17ce1hvc1o9d13639o.png-307.8kB

image_1ce94e1de15kb1km3kd216co19e484.png-234.4kB

image_1ce94eic5nlt1gcj1ft7vrg1na78h.png-318.1kB

image_1ce961ng211gamc51ug5apk391a5.png-277kB

image_1ce97j6dt1ui4sscco215l5basai.png-306.4kB

image_1ce97jo5kfk4c9e1hnm5d91eqqav.png-277.2kB

image_1ce97nmrc51u1fs11mrcis53c4bc.png-309.6kB

添加新批注
在作者公开此批注前,只有你和作者可见。
回复批注