hue

hue

1）简介

大数据可视化工具

2）编译

下载地址
编译帮助文档

##解压
$ tar -zxvf hue-3.7.0-cdh5.3.6.tar.gz -C /opt/cdh/
##yum安装相关组件（联网）
$sudo yum install ant asciidoc cyrus-sasl-devel cyrus-sasl-gssapi gcc gcc-c++ krb5-devel libtidy libxml2-devel libxslt-devel openldap-devel python-devel sqlite-devel openssl-devel mysql-devel gmp-devel
##编译
$ cd /opt/cdh/hue-3.7.0-cdh5.3.6
$ make apps
##编译好的hue 
$ cd /opt/cdh/hue-3.7.0-cdh5.3.6/apps

3）安装

配置文件目录：$ cd /opt/cdh/hue-3.7.0-cdh5.3.6/desktop/conf  ---> hue.ini

配置如下（desktop）：

启动：

$ cd /opt/cdh/hue-3.7.0-cdh5.3.6/
$ build/env/bin/supervisor

访问：

http://hadoop.zc.com:8888/

4）集成hdfs

配置文档HDFS

##hdfs-site.xml
<property>
  <name>dfs.webhdfs.enabled</name>
  <value>true</value>
</property>
##core-site.xml
<property>
  <name>hadoop.proxyuser.hue.hosts</name>
  <value>*</value>
</property>
<property>
  <name>hadoop.proxyuser.hue.groups</name>
  <value>*</value>
</property>
##集群之外访问：httpfs-site.xml
<property>
  <name>httpfs.proxyuser.hue.hosts</name>
  <value>*</value>
</property>
<property>
  <name>httpfs.proxyuser.hue.groups</name>
  <value>*</value>
</property>

配置文档hue.ini

fs_defaultfs=hdfs://hadoop.zc.com:8020
# Default port is 14000 for HttpFs.
webhdfs_url=http://hadoop.zc.com:50070/webhdfs/v1
# Directory of the Hadoop configuration
hadoop_conf_dir=/opt/cdh/hadoop-2.5.0-cdh5.3.6/etc/hadoop
# Directory of the Hadoop home
hadoop_hdfs_home=/opt/cdh/hadoop-2.5.0-cdh5.3.6/
# Directory of the Hadoop bin
hadoop_bin=/opt/cdh/hadoop-2.5.0-cdh5.3.6/bin

6）集成yarn

需要启动 hiveserver2
$ nohup hiveserver2 &

配置文档hue.ini

# Enter the host on which you are running the ResourceManager
resourcemanager_host=hadoop.zc.com
# The port where the ResourceManager IPC listens on
resourcemanager_port=8032
# Whether to submit jobs to this cluster
submit_to=True
# URL of the ResourceManager API
resourcemanager_api_url=http://hadoop.zc.com:8088
# URL of the ProxyServer API
proxy_api_url=http://hadoop.zc.com:8088
# URL of the HistoryServer API
history_server_api_url=http://hadoop.zc.com:19888

7）集成hive

配置文档hue.ini

注意：本地metastore不用配置。不是本地需要配置：https://cwiki.apache.org/confluence/display/Hive/AdminManual+MetastoreAdmin#AdminManualMetastoreAdmin-Local/EmbeddedMetastoreDatabase(Derby)

# If Kerberos security is enabled, use fully-qualified domain name (FQDN).
hive_server_host=hadoop.zc.com
# Port where HiveServer2 Thrift server runs on.
hive_server_port=10000
# Hive configuration directory, where hive-site.xml is located
hive_conf_dir=/opt/cdh/hive-0.13.1-cdh5.3.6/conf
# Timeout in seconds for thrift calls to Hive service
server_conn_timeout=120

5）集成RDBMS

在此输入正文