Geenplum是一款基于postgresql开发的mpp数据库，适合于数据仓库数据存储，是对hadoop无法有效处理结构化数据的一个很好的补充。五年前曾经使用过greenplum，那时的版本还是3.6，现在已经更新到4.3.5了，有消息称今年将开源。和以前的相比，安装方式也有了一些小变化，简记如下，如要更详细的说明，还是得看官方文档。
一、测试环境
CentOS 6.5 8台虚机
Greenplum 4.3.5
二、环境准备
1.修改系统参数编辑 /etc/sysctl.conf ，以下是最小配置 kernel.shmmax = 500000000kernel.shmmni = 4096kernel.shmall = 4000000000kernel.sem = 250 512000 100 2048kernel.sysrq = 1kernel.core_uses_pid = 1kernel.msgmnb = 65536kernel.msgmax = 65536kernel.msgmni = 2048net.ipv4.tcp_syncookies = 1net.ipv4.ip_forward = 0net.ipv4.conf.default.accept_source_route = 0net.ipv4.tcp_tw_recycle = 1net.ipv4.tcp_max_syn_backlog = 4096net.ipv4.conf.all.arp_filter = 1net.ipv4.ip_local_port_range = 1025 65535net.core.netdev_max_backlog = 10000net.core.rmem_max = 2097152net.core.wmem_max = 2097152vm.overcommit_memory = 2 2.修改文件打开数等限制编辑/etc/security/limits.conf* soft nofile 65536* hard nofile 65536* soft nproc 131072* hard nproc 131072编辑/etc/security/limits.d/90-nproc.conf* soft nofile 65536* hard nofile 65536* soft nproc 131072* hard nproc 1310723.修改scheduler编辑scheduler，原先默认是cfqecho deadline > /sys/block/vda/queue/scheduler[root@bigdata03 ~]# more /sys/block/vda/queue/scheduler noop anticipatory [deadline] cfq 4.编辑/boot/grub/grub.conf新增 elevator=deadline[root @bigdata03 ~]# more /boot/grub/grub.conf...elevator=deadline crashkernel=auto ...5.编辑设备块大小[root@bigdata03 ~]# /sbin/blockdev --setra 16384 /dev/vda[root@bigdata03 ~]# /sbin/blockdev --getra /dev/vda163846.配置hosts文件编辑/etc/hosts，添加，选中203作为master，其他为segment,偷懒没改，直接加了层别名172.30.13.203 bigdata03.rdchz mdw 172.30.13.204 bigdata04.rdchz sdw1172.30.13.205 bigdata05.rdchz sdw2172.30.13.206 bigdata06.rdchz sdw3172.30.13.207 bigdata07.rdchz sdw4172.30.13.208 bigdata08.rdchz sdw5172.30.13.209 bigdata09.rdchz sdw6172.30.13.210 bigdata10.rdchz sdw77.分别创建各数据节点文件(一个含master，一个不含)[root@bigdata03 ~]# more /tmp/hostfile_exkeys mdwsdw1sdw2sdw3sdw4sdw5sdw6sdw7[root@bigdata03 data]# more /tmp/hostfile_segments sdw1sdw2sdw3sdw4sdw5sdw6sdw7
三、集群安装
1.软件下载，上传、解压缩下载地址：https://network.pivotal.io/products/pivotal-gpdbunzip greenplum-db-4.3.5.2-build-1-RHEL5-x86_64.zip/bin/bash greenplum-db-4.3.5.2-build-1-RHEL5-x86_64.bin输入yes同意aggrement输入安装路径，比如/usr/local/gpmaster最后安装完后，结果是这样的：[root@bigdata03 gpmaster]# lltotal 284drwxr-xr-x 3 gpadmin gpadmin 4096 Jun 24 12:29 bindrwxr-xr-x 2 gpadmin goadmin 4096 Jun 24 12:09 demodrwxr-xr-x 5 gpadmin gpadmin 4096 Jun 24 12:09 docsdrwxr-xr-x 2 gpadmin gpadmin 4096 Jun 24 12:09 etcdrwxr-xr-x 3 gpadmin gpadmin 4096 Jun 24 12:09 ext-rw-r--r-- 1 gpadmin gpadmin 43025 Jun 24 12:29 GPDB-LICENSE.txt-rw-r--r-- 1 gpadmin gpadmin 664 Jul 28 14:51 greenplum_path.shdrwxr-xr-x 6 gpadmin gpadmin 4096 Jun 24 12:09 includedrwxr-xr-x 9 gpadmin gpadmin 12288 Jun 24 12:09 lib-rw-r--r-- 1 gpadmin gpadmin 193083 Jun 24 12:29 LICENSE.thirdpartydrwxr-xr-x 2 gpadmin gpadmin 4096 Jun 24 12:29 sbindrwxr-xr-x 3 gpadmin gpadmin 4096 Jun 24 11:57 share2.建立master与各节点的信任关系[root@bigdata03 ~]# source /usr/local/greenplum-db/greenplum_path.sh[root@bigdata03 ~]# gpssh-exkeys -f /tmp/hostfile_exkeys [STEP 1 of 5] create local ID and authorize on local host[STEP 2 of 5] keyscan all hosts and update known_hosts file[STEP 3 of 5] authorize current user on remote hosts ... send to sdw1 *** *** Enter password for sdw1: ... send to sdw2 ... send to sdw3 ... send to sdw4 ... send to sdw5 ... send to sdw6 ... send to sdw7[STEP 4 of 5] determine common authentication file content[STEP 5 of 5] copy authentication files to all remote hosts ... finished key exchange with sdw1 ... finished key exchange with sdw2 ... finished key exchange with sdw3 ... finished key exchange with sdw4 ... finished key exchange with sdw5 ... finished key exchange with sdw6 ... finished key exchange with sdw7[INFO] completed successfully实质就是master与各个节点创建了个ssh的信任关系，信任的key存放在/root/.ssh/authorized_keys里--测试是否无需密码登陆，ok[root@bigdata03 ~]# ssh root@172.30.13.204Last login: Wed Jul 29 08:45:58 2015 from 172.30.11.31[root@bigdata04 ~]# exitlogoutConnection to 172.30.13.204 closed.[root@bigdata03 ~]#[root@bigdata03 ~]# ssh root@sdw7Last login: Wed Jul 29 08:49:20 2015 from 172.30.11.31[root@bigdata10 ~]# exitlogoutConnection to sdw7 closed.[root@bigdata03 ~]#3.安装各个节点准备首先把包传送到各个节点上，并解压缩以及创建用户，组等[root@bigdata03 ~]# gpseginstall -f /tmp/hostfile_exkeys -u gpadmin -p 12345620150729:09:20:20:029326 gpseginstall:bigdata03:root-[INFO]:-Installation Info:link_name greenplum-dbbinary_path /usr/local/gpmasterbinary_dir_location /usr/localbinary_dir_name gpmaster20150729:09:20:20:029326 gpseginstall:bigdata03:root-[INFO]:-check cluster password access20150729:09:20:22:029326 gpseginstall:bigdata03:root-[INFO]:-de-duplicate hostnames20150729:09:20:22:029326 gpseginstall:bigdata03:root-[INFO]:-master hostname: bigdata03.rdchz20150729:09:20:23:029326 gpseginstall:bigdata03:root-[INFO]:-check for user gpadmin on cluster20150729:09:20:24:029326 gpseginstall:bigdata03:root-[INFO]:-add user gpadmin on master20150729:09:20:24:029326 gpseginstall:bigdata03:root-[INFO]:-add user gpadmin on cluster20150729:09:20:24:029326 gpseginstall:bigdata03:root-[INFO]:-chown -R gpadmin:gpadmin /usr/local/greenplum-db20150729:09:20:24:029326 gpseginstall:bigdata03:root-[INFO]:-chown -R gpadmin:gpadmin /usr/local/gpmaster20150729:09:20:25:029326 gpseginstall:bigdata03:root-[INFO]:-rm -f /usr/local/gpmaster.tar; rm -f /usr/local/gpmaster.tar.gz20150729:09:20:25:029326 gpseginstall:bigdata03:root-[INFO]:-cd /usr/local; tar cf gpmaster.tar gpmaster20150729:09:20:27:029326 gpseginstall:bigdata03:root-[INFO]:-gzip /usr/local/gpmaster.tar20150729:09:20:54:029326 gpseginstall:bigdata03:root-[INFO]:-remote command: mkdir -p /usr/local20150729:09:20:55:029326 gpseginstall:bigdata03:root-[INFO]:-remote command: rm -rf /usr/local/gpmaster20150729:09:20:56:029326 gpseginstall:bigdata03:root-[INFO]:-scp software to remote location20150729:09:21:00:029326 gpseginstall:bigdata03:root-[INFO]:-remote command: gzip -f -d /usr/local/gpmaster.tar.gz20150729:09:21:06:029326 gpseginstall:bigdata03:root-[INFO]:-md5 check on remote location20150729:09:21:09:029326 gpseginstall:bigdata03:root-[INFO]:-remote command: cd /usr/local; tar xf gpmaster.tar20150729:09:21:11:029326 gpseginstall:bigdata03:root-[INFO]:-remote command: rm -f /usr/local/gpmaster.tar20150729:09:21:12:029326 gpseginstall:bigdata03:root-[INFO]:-remote command: cd /usr/local; rm -f greenplum-db; ln -fs gpmaster greenplum-db20150729:09:21:13:029326 gpseginstall:bigdata03:root-[INFO]:-remote command: chown -R gpadmin:gpadmin /usr/local/greenplum-db20150729:09:21:14:029326 gpseginstall:bigdata03:root-[INFO]:-remote command: chown -R gpadmin:gpadmin /usr/local/gpmaster20150729:09:21:15:029326 gpseginstall:bigdata03:root-[INFO]:-rm -f /usr/local/gpmaster.tar.gz20150729:09:21:15:029326 gpseginstall:bigdata03:root-[INFO]:-Changing system passwords ...20150729:09:21:17:029326 gpseginstall:bigdata03:root-[INFO]:-exchange ssh keys for user root20150729:09:21:22:029326 gpseginstall:bigdata03:root-[INFO]:-exchange ssh keys for user gpadmin20150729:09:21:30:029326 gpseginstall:bigdata03:root-[INFO]:-/usr/local/greenplum-db/./sbin/gpfixuserlimts -f /etc/security/limits.conf -u gpadmin20150729:09:21:30:029326 gpseginstall:bigdata03:root-[INFO]:-remote command: . /usr/local/greenplum-db/./greenplum_path.sh; /usr/local/greenplum-db/./sbin/gpfixuserlimts -f /etc/security/limits.conf -u gpadmin20150729:09:21:31:029326 gpseginstall:bigdata03:root-[INFO]:-version string on master: gpssh version 4.3.5.2 build 120150729:09:21:31:029326 gpseginstall:bigdata03:root-[INFO]:-remote command: . /usr/local/greenplum-db/./greenplum_path.sh; /usr/local/greenplum-db/./bin/gpssh --version20150729:09:21:32:029326 gpseginstall:bigdata03:root-[INFO]:-remote command: . /usr/local/gpmaster/greenplum_path.sh; /usr/local/gpmaster/bin/gpssh --version20150729:09:21:38:029326 gpseginstall:bigdata03:root-[INFO]:-SUCCESS -- Requested commands completed[root@bigdata03 ~]# --或者用gp自带的工具包测试能否无密码登陆已经安装包是否已经被解压到各节点上面，正常情况下会显示出各个节点的gphome信息[root@bigdata03 ~]# gpssh -f hostfile_exkeys -e ls -l $GPHOME4.创建各个节点的数据文件夹，并授权，保证数据文件夹是干净的[root@bigdata03 data]# gpssh -f /tmp/hostfile_segments -e 'mkdir -p /data/primary'[sdw4] mkdir -p /data/primary[sdw3] mkdir -p /data/primary[sdw5] mkdir -p /data/primary[sdw1] mkdir -p /data/primary[sdw6] mkdir -p /data/primary[sdw2] mkdir -p /data/primary[sdw7] mkdir -p /data/primary[root@bigdata03 data]# gpssh -f /tmp/hostfile_segments -e 'chown gpadmin /data/primary'[sdw4] chown gpadmin /data/primary[sdw3] chown gpadmin /data/primary[sdw5] chown gpadmin /data/primary[sdw1] chown gpadmin /data/primary[sdw6] chown gpadmin /data/primary[sdw2] chown gpadmin /data/primary[sdw7] chown gpadmin /data/primary
【注意：这里只是在segs上创建了数据文件夹，需要在master上也要创建文件夹并授权mkdir -p /data/masterchown gpadmin /data/master】
5.时钟同步[root@bigdata03 ~]# vi /etc/ntp.confserver 172.30.11.8【在每个节点上都要安装ntp服务：yum install ntp service ntpd startchkconfig ntpd on】
各个节点上的时钟以master为准，如04节点，需要改在第一行[root@bigdata04 ~]# vi /etc/ntp.confserver mdw[root@bigdata03 ~]# gpssh -f /tmp/hostfile_exkeys -v -e 'ntpd'[Reset ...][INFO] login sdw4[INFO] login sdw3[INFO] login mdw[INFO] login sdw5[INFO] login sdw1[INFO] login sdw6[INFO] login sdw2[INFO] login sdw7[sdw4] ntpd[sdw3] ntpd[ mdw] ntpd[sdw5] ntpd[sdw1] ntpd[sdw6] ntpd[sdw2] ntpd[sdw7] ntpd[INFO] completed successfully[Cleanup...][root@bigdata03 ~]#6.检查参数设置检查参数设置，正常情况是这样的[root@bigdata03 ~]# gpcheck -f /tmp/hostfile_exkeys -m mdw -s sdw120150729:11:18:20:001805 gpcheck:bigdata03:root-[INFO]:-dedupe hostnames20150729:11:18:20:001805 gpcheck:bigdata03:root-[INFO]:-Detected platform: Generic Linux Cluster20150729:11:18:20:001805 gpcheck:bigdata03:root-[INFO]:-generate data on servers20150729:11:18:20:001805 gpcheck:bigdata03:root-[INFO]:-copy data files from servers20150729:11:18:21:001805 gpcheck:bigdata03:root-[INFO]:-delete remote tmp files20150729:11:18:21:001805 gpcheck:bigdata03:root-[INFO]:-Using gpcheck config file: /usr/local/greenplum-db/./etc/gpcheck.cnf20150729:11:18:21:001805 gpcheck:bigdata03:root-[INFO]:-GPCHECK_NORMAL20150729:11:18:21:001805 gpcheck:bigdata03:root-[INFO]:-gpcheck completing...[root@bigdata03 ~]# 【[ERROR]:-GPCHECK_ERROR host(GPMaster): on device (sr0) IO scheduler 'cfq' does not match expected value 'deadline'-[ERROR]:-GPCHECK_ERROR host(GPMaster): on device (/dev/sda1) blockdev readahead value '256' does not match expected value '16384'等等错误可以根据具体要求修改：# /sbin/blockdev --getra /dev/sda256# /sbin/blockdev --getra /dev/sda1256# /sbin/blockdev --setra 16385 /dev/sda# /sbin/blockdev --setra 16385 /dev/sda1# /sbin/blockdev --setra 16385 /dev/sda2# service ntpd start# chkconfig ntpd on# echo deadline > /sys/block/sda/queue/scheduler# echo deadline > /sys/block/sr0/queue/scheduler还可以参见：Greenplum数据库扩容实务（上）-准备工作 在CentOS6.5x86_64下安装配置GreenPlum】
7.检查网络千兆的交换机，只能用千兆的网卡，网络吞吐一般[root@bigdata03 ~]# gpcheckperf -f /tmp/hostfile_segments -r n -d /tmp >test.out[root@bigdata03 ~]# more test.out /usr/local/greenplum-db/./bin/gpcheckperf -f /tmp/hostfile_segments -r n -d /tmp--------------------- NETPERF TEST-------------------====================== RESULT====================Netperf bisection bandwidth testsdw1 -> sdw2 = 845.140000sdw2 -> sdw1 = 762.840000sdw3 -> sdw4 = 932.170000sdw4 -> sdw3 = 1021.450000sdw5 -> sdw6 = 701.030000sdw6 -> sdw5 = 806.280000sdw7 -> sdw1 = 927.360000sdw1 -> sdw7 = 1097.420000Summary:sum = 7093.69 MB/secmin = 701.03 MB/secmax = 1097.42 MB/secavg = 886.71 MB/secmedian = 927.36 MB/sec[Warning] connection between sdw1 and sdw2 is no good[Warning] connection between sdw2 and sdw1 is no good[Warning] connection between sdw3 and sdw4 is no good[Warning] connection between sdw5 and sdw6 is no good[Warning] connection between sdw6 and sdw5 is no good[Warning] connection between sdw7 and sdw1 is no good[root@bigdata03 ~]#8.检查io可以选其中几个节点测试，它会创建几个大文件来测试[root@bigdata03 .ssh]# more /tmp/hostfile_2 sdw1sdw2sdw3[root@bigdata03 ~]# gpcheckperf -f /tmp/hostfile_2 -r ds -D -d /data/primary/ -d /data/primary/ -d /data/primary//usr/local/greenplum-db/./bin/gpcheckperf -f /tmp/hostfile_2 -r ds -D -d /data/primary/ -d /data/primary/ -d /data/primary/---------------------- DISK WRITE TEST------------------------------------------ DISK READ TEST------------------------------------------ STREAM TEST--------------------====================== RESULT==================== disk write avg time (sec): 1573.83 disk write tot bytes: 379920384000 disk write tot bandwidth (MB/s): 233.53 disk write min bandwidth (MB/s): 65.47 [sdw2] disk write max bandwidth (MB/s): 86.37 [sdw1] -- per host bandwidth -- disk write bandwidth (MB/s): 86.37 [sdw1] disk write bandwidth (MB/s): 65.47 [sdw2] disk write bandwidth (MB/s): 81.69 [sdw3] disk read avg time (sec): 17.75 disk read tot bytes: 379920384000 disk read tot bandwidth (MB/s): 20440.61 disk read min bandwidth (MB/s): 6588.84 [sdw2] disk read max bandwidth (MB/s): 7142.13 [sdw3] -- per host bandwidth -- disk read bandwidth (MB/s): 6709.64 [sdw1] disk read bandwidth (MB/s): 6588.84 [sdw2] disk read bandwidth (MB/s): 7142.13 [sdw3] stream tot bandwidth (MB/s): 12247.97 stream min bandwidth (MB/s): 3392.68 [sdw3] stream max bandwidth (MB/s): 5069.60 [sdw2] -- per host bandwidth -- stream bandwidth (MB/s): 3785.69 [sdw1] stream bandwidth (MB/s): 5069.60 [sdw2] stream bandwidth (MB/s): 3392.68 [sdw3]
四、集群初始化
【初始化之前每个接待你都要装ed：yum install ed;否则会报错初始化不成功】做了那么多的铺垫准备后，进入真正的安装环节在master上以gpadmin用户登陆[root@bigdata03 ~]# su - gpadmin[gpadmin@bigdata03 ~]$ source /usr/local/gpmaster/greenplum_path.sh[gpadmin@bigdata03 ~]$ mkdir gpconfigs[gpadmin@bigdata03 ~]$ cp $GPHOME/docs/cli_help/gpconfigs/gpinitsystem_config /home/gpadmin/gpconfigs/gpinitsystem_config配置gpinitsystem_config文件，每个segment上1个数据文件夹，因为只有1块网卡，没有配置镜像declare -a DATA_DIRECTORY=(/data/primary)MASTER_PORT=1949CHECK_POINT_SEGMENTS=64ENCODING=UTF8【配置gpinitsystem_config文件时，因为我的hosts主机名不是mdw：MASTER_HOSTNAME=hadoop2；如果初始化失败需要删除/data/master /data/primary里面的所有文件】
初始化[gpadmin@bigdata03 gpconfigs]$ gpinitsystem -c gpconfigs/gpinitsystem_config -h /tmp/hostfile_segments20150729:15:41:27:030870 gpinitsystem:bigdata03:gpadmin-[INFO]:-Checking configuration parameters, please wait...20150729:15:41:27:gpinitsystem:bigdata03:gpadmin-[FATAL]:-Configuration file gpconfigs/gpinitsystem_config does not exist. Script Exiting![gpadmin@bigdata03 gpconfigs]$ cd ..[gpadmin@bigdata03 ~]$ gpinitsystem -c gpconfigs/gpinitsystem_config -h /tmp/hostfile_segments20150730:16:52:55:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-Checking configuration parameters, please wait...20150730:16:52:55:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-Reading Greenplum configuration file gpconfigs/gpinitsystem_config20150730:16:52:55:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-Locale has not been set in gpconfigs/gpinitsystem_config, will set to default value20150730:16:52:55:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-Locale set to en_US.utf820150730:16:52:55:031413 gpinitsystem:bigdata03:gpadmin-[WARN]:-Master hostname mdw does not match hostname output20150730:16:52:55:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-Checking to see if mdw can be resolved on this host20150730:16:52:56:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-Can resolve mdw to this host20150730:16:52:56:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-No DATABASE_NAME set, will exit following template1 updates20150730:16:52:56:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-MASTER_MAX_CONNECT not set, will set to default value 25020150730:16:52:56:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-Checking configuration parameters, Completed20150730:16:52:56:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-Commencing multi-home checks, please wait..........20150730:16:52:58:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-Configuring build for standard array20150730:16:52:58:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-Commencing multi-home checks, Completed20150730:16:52:58:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-Building primary segment instance array, please wait..........20150730:16:53:03:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-Checking Master host20150730:16:53:03:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-Checking new segment hosts, please wait..........20150730:16:53:19:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-Checking new segment hosts, Completed20150730:16:53:19:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-Greenplum Database Creation Parameters20150730:16:53:19:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:---------------------------------------20150730:16:53:19:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-Master Configuration20150730:16:53:19:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:---------------------------------------20150730:16:53:19:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-Master instance name = EMC Greenplum DW20150730:16:53:19:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-Master hostname = mdw20150730:16:53:19:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-Master port = 194920150730:16:53:19:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-Master instance dir = /data/master/gpseg-120150730:16:53:19:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-Master LOCALE = en_US.utf820150730:16:53:19:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-Greenplum segment prefix = gpseg20150730:16:53:19:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-Master Database = 20150730:16:53:19:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-Master connections = 25020150730:16:53:19:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-Master buffers = 128000kB20150730:16:53:19:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-Segment connections = 75020150730:16:53:19:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-Segment buffers = 128000kB20150730:16:53:19:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-Checkpoint segments = 6420150730:16:53:19:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-Encoding = UTF820150730:16:53:19:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-Postgres param file = Off20150730:16:53:19:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-Initdb to be used = /usr/local/greenplum-db/bin/initdb20150730:16:53:19:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-GP_LIBRARY_PATH is = /usr/local/greenplum-db/lib20150730:16:53:20:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-Ulimit check = Passed20150730:16:53:20:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-Array host connect type = Single hostname per node20150730:16:53:20:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-Master IP address [1] = ::120150730:16:53:20:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-Master IP address [2] = 172.30.13.20320150730:16:53:20:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-Master IP address [3] = fe80::5054:ff:fec7:b4f520150730:16:53:20:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-Standby Master = Not Configured20150730:16:53:20:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-Primary segment # = 120150730:16:53:20:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-Total Database segments = 720150730:16:53:20:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-Trusted shell = ssh20150730:16:53:20:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-Number segment hosts = 720150730:16:53:20:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-Mirroring config = OFF20150730:16:53:20:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:----------------------------------------20150730:16:53:20:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-Greenplum Primary Segment Configuration20150730:16:53:20:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:----------------------------------------20150730:16:53:20:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-sdw1 /data/primary/gpseg0 40000 2 020150730:16:53:20:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-sdw2 /data/primary/gpseg1 40000 3 120150730:16:53:20:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-sdw3 /data/primary/gpseg2 40000 4 220150730:16:53:20:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-sdw4 /data/primary/gpseg3 40000 5 320150730:16:53:20:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-sdw5 /data/primary/gpseg4 40000 6 420150730:16:53:20:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-sdw6 /data/primary/gpseg5 40000 7 520150730:16:53:20:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-sdw7 /data/primary/gpseg6 40000 8 6Continue with Greenplum creation Yy/Nn>y20150730:16:53:29:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-Building the Master instance database, please wait...20150730:16:54:21:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-Starting the Master in admin mode20150730:16:54:32:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-Commencing parallel build of primary segment instances20150730:16:54:32:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-Spawning parallel processes batch [1], please wait..........20150730:16:54:32:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-Waiting for parallel processes batch [1], please wait...................................................................................................................20150730:16:56:25:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:------------------------------------------------20150730:16:56:25:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-Parallel process exit status20150730:16:56:26:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:------------------------------------------------20150730:16:56:26:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-Total processes marked as completed = 720150730:16:56:26:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-Total processes marked as killed = 020150730:16:56:26:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-Total processes marked as failed = 020150730:16:56:26:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:------------------------------------------------20150730:16:56:26:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-Deleting distributed backout files20150730:16:56:26:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-Removing back out file20150730:16:56:26:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-No errors generated from parallel processes20150730:16:56:26:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-Restarting the Greenplum instance in production mode20150730:16:56:26:022809 gpstop:bigdata03:gpadmin-[INFO]:-Starting gpstop with args: -a -i -m -d /data/master/gpseg-120150730:16:56:26:022809 gpstop:bigdata03:gpadmin-[INFO]:-Gathering information and validating the environment...20150730:16:56:26:022809 gpstop:bigdata03:gpadmin-[INFO]:-Obtaining Greenplum Master catalog information20150730:16:56:26:022809 gpstop:bigdata03:gpadmin-[INFO]:-Obtaining Segment details from master...20150730:16:56:26:022809 gpstop:bigdata03:gpadmin-[INFO]:-Greenplum Version: 'postgres (Greenplum Database) 4.3.5.2 build 1'20150730:16:56:27:022809 gpstop:bigdata03:gpadmin-[INFO]:-There are 0 connections to the database20150730:16:56:27:022809 gpstop:bigdata03:gpadmin-[INFO]:-Commencing Master instance shutdown with mode='immediate'20150730:16:56:27:022809 gpstop:bigdata03:gpadmin-[INFO]:-Master host=bigdata03.rdchz20150730:16:56:27:022809 gpstop:bigdata03:gpadmin-[INFO]:-Commencing Master instance shutdown with mode=immediate20150730:16:56:27:022809 gpstop:bigdata03:gpadmin-[INFO]:-Master segment instance directory=/data/master/gpseg-120150730:16:56:28:022809 gpstop:bigdata03:gpadmin-[INFO]:-Attempting forceful termination of any leftover master process20150730:16:56:28:022809 gpstop:bigdata03:gpadmin-[INFO]:-Terminating processes for segment /data/master/gpseg-120150730:16:56:28:022899 gpstart:bigdata03:gpadmin-[INFO]:-Starting gpstart with args: -a -d /data/master/gpseg-120150730:16:56:28:022899 gpstart:bigdata03:gpadmin-[INFO]:-Gathering information and validating the environment...20150730:16:56:28:022899 gpstart:bigdata03:gpadmin-[INFO]:-Greenplum Binary Version: 'postgres (Greenplum Database) 4.3.5.2 build 1'20150730:16:56:28:022899 gpstart:bigdata03:gpadmin-[INFO]:-Greenplum Catalog Version: '201310150'20150730:16:56:28:022899 gpstart:bigdata03:gpadmin-[INFO]:-Starting Master instance in admin mode20150730:16:56:29:022899 gpstart:bigdata03:gpadmin-[INFO]:-Obtaining Greenplum Master catalog information20150730:16:56:29:022899 gpstart:bigdata03:gpadmin-[INFO]:-Obtaining Segment details from master...20150730:16:56:29:022899 gpstart:bigdata03:gpadmin-[INFO]:-Setting new master era20150730:16:56:29:022899 gpstart:bigdata03:gpadmin-[INFO]:-Master Started...20150730:16:56:29:022899 gpstart:bigdata03:gpadmin-[INFO]:-Shutting down master20150730:16:56:31:022899 gpstart:bigdata03:gpadmin-[INFO]:-Commencing parallel segment instance startup, please wait...... 20150730:16:56:34:022899 gpstart:bigdata03:gpadmin-[INFO]:-Process results...20150730:16:56:34:022899 gpstart:bigdata03:gpadmin-[INFO]:-----------------------------------------------------20150730:16:56:34:022899 gpstart:bigdata03:gpadmin-[INFO]:- Successful segment starts = 720150730:16:56:34:022899 gpstart:bigdata03:gpadmin-[INFO]:- Failed segment starts = 020150730:16:56:34:022899 gpstart:bigdata03:gpadmin-[INFO]:- Skipped segment starts (segments are marked down in configuration) = 020150730:16:56:34:022899 gpstart:bigdata03:gpadmin-[INFO]:-----------------------------------------------------20150730:16:56:34:022899 gpstart:bigdata03:gpadmin-[INFO]:-20150730:16:56:34:022899 gpstart:bigdata03:gpadmin-[INFO]:-Successfully started 7 of 7 segment instances 20150730:16:56:34:022899 gpstart:bigdata03:gpadmin-[INFO]:-----------------------------------------------------20150730:16:56:34:022899 gpstart:bigdata03:gpadmin-[INFO]:-Starting Master instance bigdata03.rdchz directory /data/master/gpseg-1 20150730:16:56:35:022899 gpstart:bigdata03:gpadmin-[INFO]:-Command pg_ctl reports Master bigdata03.rdchz instance active20150730:16:56:35:022899 gpstart:bigdata03:gpadmin-[INFO]:-No standby master configured. skipping...20150730:16:56:35:022899 gpstart:bigdata03:gpadmin-[INFO]:-Database successfully started20150730:16:56:35:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-Completed restart of Greenplum instance in production mode20150730:16:56:35:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-Loading gp_toolkit...20150730:16:56:38:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-Scanning utility log file for any warning messages20150730:16:56:39:031413 gpinitsystem:bigdata03:gpadmin-[WARN]:-*******************************************************20150730:16:56:39:031413 gpinitsystem:bigdata03:gpadmin-[WARN]:-Scan of log file indicates that some warnings or errors20150730:16:56:39:031413 gpinitsystem:bigdata03:gpadmin-[WARN]:-were generated during the array creation20150730:16:56:39:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-Please review contents of log file20150730:16:56:39:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-/home/gpadmin/gpAdminLogs/gpinitsystem_20150730.log20150730:16:56:39:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-To determine level of criticality20150730:16:56:39:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-These messages could be from a previous run of the utility20150730:16:56:39:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-that was called today!20150730:16:56:39:031413 gpinitsystem:bigdata03:gpadmin-[WARN]:-*******************************************************20150730:16:56:39:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-Greenplum Database instance successfully created20150730:16:56:39:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-------------------------------------------------------20150730:16:56:39:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-To complete the environment configuration, please 20150730:16:56:39:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-update gpadmin .bashrc file with the following20150730:16:56:39:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-1. Ensure that the greenplum_path.sh file is sourced20150730:16:56:39:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-2. Add "export MASTER_DATA_DIRECTORY=/data/master/gpseg-1"20150730:16:56:39:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:- to access the Greenplum scripts for this instance:20150730:16:56:39:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:- or, use -d /data/master/gpseg-1 option for the Greenplum scripts20150730:16:56:39:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:- Example gpstate -d /data/master/gpseg-120150730:16:56:39:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-Script log file = /home/gpadmin/gpAdminLogs/gpinitsystem_20150730.log20150730:16:56:39:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-To remove instance, run gpdeletesystem utility20150730:16:56:39:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-To initialize a Standby Master Segment for this Greenplum instance20150730:16:56:39:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-Review options for gpinitstandby20150730:16:56:39:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-------------------------------------------------------20150730:16:56:39:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-The Master /data/master/gpseg-1/pg_hba.conf post gpinitsystem20150730:16:56:39:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-has been configured to allow all hosts within this new20150730:16:56:39:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-array to intercommunicate. Any hosts external to this20150730:16:56:39:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-new array must be explicitly added to this file20150730:16:56:39:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-Refer to the Greenplum Admin support guide which is20150730:16:56:39:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-located in the /usr/local/greenplum-db/docs directory20150730:16:56:40:031413 gpinitsystem:bigdata03:gpadmin-[INFO]:-------------------------------------------------------[gpadmin@bigdata03 ~]$连接[gpadmin@bigdata03 ~]$ psql -p 1949 -d postgrespsql (8.2.15)Type "help" for help.postgres=# \l List of databases Name | Owner | Encoding | Access privileges -----------+---------+----------+--------------------- postgres | gpadmin | UTF8 | template0 | gpadmin | UTF8 | =c/gpadmin : gpadmin=CTc/gpadmin template1 | gpadmin | UTF8 | =c/gpadmin : gpadmin=CTc/gpadmin(3 rows)postgres=# \q[gpadmin@bigdata03 ~]$
查看安装完以后的状态gpstate -s会提示你需要配置master_data_directory的状态20130318:16:42:46:031279 gpstate:local_master:gpadmin-[INFO]:-Starting gpstate with args: -s20130318:16:42:46:031279 gpstate:local_master:gpadmin-[CRITICAL]:-gpstate failed. (Reason='Environment Variable MASTER_DATA_DIRECTORY not set!') exiting...增加master的环境变量vi .bash_profilesource /usr/local/greenplum-db/greenplum_path.shexport MASTER_DATA_DIRECTORY=/data/master/gpseg-1export PGPORT=5432export PGUSER=gpadminexport PGDATABASE=EMC Greenplum DW拷贝$ scp .bashrc standby_hostname:`pwd`
关闭与启动关闭与启动[gpadmin@bigdata03 ~]$ gpstart[gpadmin@bigdata03 ~]$ gpstop -M fast
联系客服
