站長資訊網(wǎng)1、準(zhǔn)備工作
1.1 環(huán)境
CentOS7、jdk8、mysql5.7、Python2.7、CDH61.2文件下載
1.2.1 cloudmanger地址
https://archive.cloudera.com/cm6/6.0.0/RedHat7/yum/RPMS/x86_64/ cloudera-manager-agent-6.0.0-530873.el7.x86_64.rpm
cloudera-manager-daemons-6.0.0-530873.el7.x86_64.rpm
cloudera-manager-server-6.0.0-530873.el7.x86_64.rpm
1.2.2 資源下載地址
https://archive.cloudera.com/cdh6/6.0.0/parcels/
CDH-6.0.0-1.cdh6.0.0.p0.537114-el7.parcel
CDH-6.0.0-1.cdh6.0.0.p0.537114-el7.parcel.sha256
manifest.json
2、開始安裝
2.1 服務(wù)器配置
2.1.1 修改HOST和主機(jī)名
vim /etc/hosts修改host，例如
198.168.12.1 cdh1
192.168.12.2 cdh2
192.168.12.3 cdh3
不能有大寫字母和下劃線
vim /etc/hostname修改主機(jī)名,修改完后三臺(tái)機(jī)器分別執(zhí)行hostname ***(當(dāng)前節(jié)點(diǎn)的主機(jī)名)
2.1.2 配置免密登錄
ssh-keygen -t rsa -P ” -f ~/.ssh/id_rsa b、ssh-copy-id 每臺(tái)服務(wù)器地址
2.1.3 關(guān)閉防火墻
臨時(shí)關(guān)閉 systemctl stop firewalld
禁止開機(jī)啟動(dòng) systemctl disable firewalld
2.1.4 安裝jdk，配置環(huán)境變量
這個(gè)大家都會(huì)，如果不會(huì)可以參考這個(gè)教程
http://m.0106606.com/Linux/2018-11/155296.htm
2.1.5 其他依賴
每臺(tái)服務(wù)器yum安裝依賴包：redhat-lsb、portmap、httpd、mod_ssl、openssl-devel、python-psycopg2、MySQL-python、chkconfig、python、chkconfig、bind-utils、libxslt、zlib、sqlite、cyrus-sasl-plain、cyrus-sasl-gssapi、fuse、fuse-libs
2.2 Mysql5.7安裝(在主節(jié)點(diǎn)安裝)
2.2.1 安裝
wget -i -c http://dev.mysql.com/get/mysql57-community-release-el7-10.noarch.rpm
yum -y install mysql57-community-release-el7-10.noarch.rpm
yum -y install mysql-community-server
啟動(dòng) systemctl start mysqld.service
查看運(yùn)行狀態(tài) systemctl status mysqld.service
查看初始密碼 grep “password” /var/log/mysqld.log
登錄后修改密碼（盡量復(fù)雜一點(diǎn)，太簡單了驗(yàn)證不通過，也可以查看如何關(guān)閉mysql校驗(yàn)規(guī)則） ALTER USER ‘root’@’localhost’ IDENTIFIED BY ‘new password’;
卸載yum源防止自動(dòng)更新 yum -y remove mysql57-community-release-el7-10.noarch
安裝MySQL-shared-compat或MySQL-shared軟件包(這是Cloudera Manager Agent軟件包安裝所必需的)yum install MySQL-shared-advanced
2.2.2 創(chuàng)建CDH相關(guān)數(shù)據(jù)庫
create database scm default character set utf8 default collate utf8_general_ci;
grant all on scm.* to ‘scm’@’%’ identified by ‘password’;
create database amon default character set utf8 default collate utf8_general_ci;
grant all on amon.* to ‘amon’@’%’ identified by ‘password’;
create database rman default character set utf8 default collate utf8_general_ci;
grant all on rman.* to ‘rman’@’%’ identified by ‘password’;
create database hue default character set utf8 default collate utf8_general_ci;
grant all on hue.* to ‘hue’@’%’ identified by ‘password’;
create database metastore default character set utf8 default collate utf8_general_ci;
grant all on metastore.* to ‘hive’@’%’ identified by ‘password’;
create database sentry default character set utf8 default collate utf8_general_ci;
grant all on sentry.* to ‘sentry’@’%’ identified by ‘password’;
create database nav default character set utf8 default collate utf8_general_ci;
grant all on nav.* to ‘nav’@’%’ identified by ‘password’;
create database oozie default character set utf8 default collate utf8_general_ci;
grant all on oozie.* to ‘oozie’@’%’ identified by ‘password’;
2.3 CDH安裝
mkdir /opt/cloudera-manager
將cloudera-manager-agent-6.0.0-530873.el7.x86_64.rpm、cloudera-manager-daemons-6.0.0-530873.el7.x86_64.rpm 、cloudera-manager-server-6.0.0-530873.el7.x86_64.rpm
復(fù)制到/opt/cloudera-manager文件夾中
按 daemons、server、agent順序解壓
修改文件/etc/cloudera-scm-agent/config.ini中serverhost指定server節(jié)點(diǎn)
下載mysql-connector-java-5.1.47.jar包并復(fù)制為/usr/share/java/mysql-connector-java.jar
在主節(jié)點(diǎn)執(zhí)行
/opt/cloudera/cm/schema/scmpreparedatabase.sh mysql -h 主節(jié)點(diǎn)ip –scm-host 主節(jié)點(diǎn)ip scm scm
mkdir -p /opt/cloudera/parcel-repo
將CDH-6.0.0-1.cdh6.0.0.p0.537114-el7.parcel、CDH-6.0.0-1.cdh6.0.0.p0.537114-el7.parcel.sha256、manifest.json復(fù)制到/opt/cloudera/parcel-repo
將CDH-6.0.0-1.cdh6.0.0.p0.537114-el7.parcel.sha256 重命名為 CDH-6.0.0-1.cdh6.0.0.p0.537114-el7.parcel.sha
在manifest.json文件中，找到對(duì)應(yīng)版本的秘鑰，復(fù)制到CDH-6.0.0-1.cdh6.0.0.p0.537114-el7.parcel.sha文件中。
11.啟動(dòng)systemctl start cloudera-scm-agent、systemctl start cloudera-scm-server
2.4 集群配置
2.4.1 禁用透明大頁面壓縮
echo never > /sys/kernel/mm/transparent_hugepage/defrag
echo never > /sys/kernel/mm/transparent_hugepage/enabled
2.4.1 分配組件
訪問http://192.168.1.1:7180開始配置集群組件
因?yàn)槭窍劝惭b集群后編寫文檔，沒有截圖就沒有詳細(xì)些。
