Thank you for registering for the Hortonworks Data Platform. Hortonworks Data Platform is designed to be installed by IT operations personnel using Linux-friendly installation tooling. For HDP v1.0, the following instructions should help you to prepare your cluster and get started:
Preparing your cluster for the install
- Select your target hosts and disable SELINUX, firewalls, and other security measures. Make sure each host can reach the Internet via HTTP, HTTPS, and FTP. (For local YUM installs, please read the detailed HMC User Guide)
- Prepare passwordless SSH (via authorized_keys) for root user on all target install hosts
- Create a text file with newline separated host entries (one per target host). Make sure to use fully-qualified domain names for each host. Make sure the DNS for each node works on all other nodes (both forward and reverse lookups). If you are not a DNS administrator, consider building up a consistent /etc/hosts file for all target nodes, listing all other nodes in the cluster by a fully-qualified domain name. NOTE: Without fully-qualified domain names, the install may or may not work but Hadoop will not run jobs properly after installation.
- Make sure the rpms listed below are either not installed or, if installed, are exactly these versions.
- Ruby 1.8.5-24.el5
- Puppet 2.7.9-2
- Ruby Rack 1.1.0-2.el5
- Passenger 3.0.12-1.el5.centos
- Nagios 3.0.12-1.el5.centos
- Nagios plug-ins 1.4.15-2.el5
- Nagios Common 2.12-10.el5
- MySQL v. 5.*
Installing the software via public repositories (REPO)
- Install the following public repos using rpm (just paste the command into your shell as root):
- rpm -Uvh http://public-repo-1.hortonworks.com/HDP-1.0.0.12/repos/centos5/hdp-release-1.0.0.12-1.el5.noarch.rpm (to install the HDP release repo)
- rpm -Uvh http://public-repo-1.hortonworks.com/HDP-1.0.0.12/repos/centos5/epel-release-5-4.noarch.rpm (to install the epel repo if not already installed)
- Run the following 2 YUM commands
- yum install php-pecl-json (this will install php prerequisites that HMC needs on the management host)
- yum install hmc (this will install HMC onto this host directly)
Starting HMC and installing HDP from HMC
- Lastly, start up HMC and install the rest of HDP.
- Service hmc start
- Point your browser at http://target_host_name/hmc/html/index.php
For more information
Please read the HMC User Guide if any of these instructions are unclear or if you would like alternative installation options. The User Guide will answer most questions you might have. If not, there are some additional resources at your disposal including the following:
- Online Documentation
- Knowledgebase
- Community Forums
- Apache Hadoop Training Courses (public, private and online courses)
- Expert Technical Support
相关推荐
本文档用于 Hadoop-Hdp的生产、测试环境部署。已成功部署超过20个节点的生产集群。支持HA高可用。
它提供了一套完整的工具和组件,包括Hadoop分布式文件系统(HDFS)、YARN资源管理器、MapReduce计算框架、Hive数据仓库、HBase分布式数据库等。HDP还支持其他开源工具和技术,如Apache Spark、Apache Kafka、Apache ...
本文档详细描述了ambari-server的安装以及如何使用ambari安装HDP版本的大数据集群包括Hadoop,hbase,hive,spark等所有大数据组件的安装
内容包括ambari-2.7.4.0-centos7.tar.gz,HDP-3.1.4.0-centos7-rpm.tar.gz,链接失效或者部署过程中遇到任何问题可以私信我,同时列举了几条之前项目环境部署过程中遇到过的问题及解决办法,有爱好大数据领域的同学...
目录:Hidataplus->hdp3.1.0 说明:里面还有ubutntu18和centos7两个版本的 按需使用
基于Kubernetes平台部署Hadoop实践.docx
集成了hadoop3.2.4,hive3.1.3, spark3.2.1,kyuubi,ozone等组件,完全基于Apache版本使用Ambari2.7.6进行集成,支持centos系的国产操作系统,例如红旗等。同时支持x86和aarch64两种cpu架构,满足国产化改造的需要...
hadoop HDP docker镜像部署
通过ambari搭建hdp2.6版本的集群,该集群继承ranger实现权限管理
单节点/集群部署分步指南 Hadoop 版本:3.2.0 Docker 有用的命令 启动一个 Docker 容器 docker start -i < container-name > # e.g Start a container (already created, see: 'List Docker containers') 进入 ...
3.3 部署Hadoop集群 3.4 部署HBase 3.5 部署Hive + Tez 3.6 部署Spark 3.7 部署Kafka 3.8 部署Oozie 3.9 部署Ranger 3.10 部署Sqoop 3.11 部署 DataX 3.12 部署Azkaban 3.13 部署Presto 3.14 部署Elasticsearch 3.15...
ambari安装部署-自己亲自部署测试可用,合适初步搭建参考
VERSION=`hdp-select status hadoop-client | sed 's/hadoop-client - \([0-9]\.[0-9]\).*/\1/'` sudo git clone ...
请注意,所有内容都是围绕 Hortonworks 数据平台 (HDP) 构建/测试的,但应转换为与开源 Apache 组件兼容的任何发行版,因为 HDP 是直接基于它们构建的。开始这始于 Hortonworks 运营研讨会。 您可以在以下位置找到...
利用ansible 自动 安装Hadoop 集群
Centos7.2安装Ambari2.4.2+HDP2.5.3搭建Hadoop集群 http://public-repo-1.hortonworks.com/ambari/centos7/2.x/updates/2.4.2.0/ambari-2.4.2.0-centos7.tar.gz
1、apache-hive-2.3.5-bin.tar.gz 2、hadoop-2.7.3.tar.gz 3、jdk-8u162-linux-x64.tar.gz 4、mysql-connector-java-5.1.24.tar.gz 5、sqoop-1.4.6.bin__hadoop-2.0.4-alpha.tar.gz
手把手视频详细讲解项目开发全过程,需要的小伙伴自行百度网盘下载,链接见附件,永久有效。 课程简介 从零学习HDP集群环境的安装和配置,通过一步步的实操和讲解带领学生掌握...3、通过HDP管理控制台安装部署集群组件
根据市场上目前比较流行的几款Hadoop产品综合分析,从部署的便捷性、功能、性能及成本等方面综合考量,推荐使用CDH与HDP。然后再根据我们具体的使用场景来进行选择,如果我们追求功能全面与部署案例参考推荐使用CDH...
当前,仅Hortonworks HDP 1.3已经过测试。 将来可能会增加对Apache Hadoop和Cloudera CDH发行版以及Hadoop YARN的支持。 该模板使用配置服务器。 它部署了一个盐大师,以及许多盐小兵。 一小部分将是Hadoop主节点。...