使用Phoenix 匯出csv檔案，使用table方式
阿新 • • 發佈：2019-02-07
[[email protected] testSh]# vi example1.pig
REGISTER /opt/phoenix-4.8.2-HBase-1.2/phoenix-4.8.2-HBase-1.2-client.jar;
rows = load 'hbase://table/sp_address_orc' USING org.apache.phoenix.pig.PhoenixHBaseLoader('hadoop1:2181,hadoop2:2181,hadoop3:2181');
STORE rows INTO 'sp_address_orc.csv' USING PigStorage(',');
[[email protected] testSh]# pig -x local example1.pig
SLF4J: Class path contains multiple SLF4J bindings.SLF4J: Found binding in [jar:file:/opt/hadoop-2.6.4/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/opt/hbase-1.2.1/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
17/04/08 00:58:09 INFO pig.ExecTypeProvider: Trying ExecType : LOCAL
17/04/08 00:58:09 INFO pig.ExecTypeProvider: Picked LOCAL as the ExecType
2017-04-08 00:58:09,440 [main] INFO org.apache.pig.Main - Apache Pig version 0.16.0 (r1746530) compiled Jun 01 2016, 23:10:49
2017-04-08 00:58:09,440 [main] INFO org.apache.pig.Main - Logging error messages to: /opt/testSh/pig_1491638289439.log
2017-04-08 00:58:09,459 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - user.name is deprecated. Instead, use mapreduce.job.user.name
2017-04-08 00:58:10,133 [main] INFO org.apache.pig.impl.util.Utils - Default bootup file /root/.pigbootup not found
2017-04-08 00:58:10,548 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2017-04-08 00:58:10,551 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - fs.default.name is deprecated. Instead, use fs.defaultFS
2017-04-08 00:58:10,559 [main] INFO org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - Connecting to hadoop file system at: file:///
2017-04-08 00:58:10,638 [main] INFO org.apache.pig.PigServer - Pig Script ID for the session: PIG-example1.pig-d68c63ab-f883-436c-a298-67501c139ff0
2017-04-08 00:58:10,638 [main] WARN org.apache.pig.PigServer - ATS is disabled since yarn.timeline-service.enabled set to false
2017-04-08 00:58:10,952 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - fs.default.name is deprecated. Instead, use fs.defaultFS
2017-04-08 00:58:11,622 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - fs.default.name is deprecated. Instead, use fs.defaultFS
2017-04-08 00:58:12,495 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - fs.default.name is deprecated. Instead, use fs.defaultFS
2017-04-08 00:58:12,501 [main] INFO org.apache.phoenix.jdbc.PhoenixEmbeddedDriver$ConnectionInfo - Trying to connect to a secure cluster as 2181 with keytab /hbase
2017-04-08 00:58:12,506 [main] INFO org.apache.phoenix.jdbc.PhoenixEmbeddedDriver$ConnectionInfo - Successful login to secure cluster
2017-04-08 00:58:12,668 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - fs.default.name is deprecated. Instead, use fs.defaultFS
2017-04-08 00:58:12,747 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - fs.default.name is deprecated. Instead, use fs.defaultFS
2017-04-08 00:58:13,221 [main] INFO org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper - Process identifier=hconnection-0x4b42f44a connecting to ZooKeeper ensemble=hadoop1:2181,hadoop2:2181,hadoop3:2181
2017-04-08 00:58:13,235 [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:zookeeper.version=3.4.6-1569965, built on 02/20/2014 09:09 GMT
2017-04-08 00:58:13,235 [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:host.name=hadoop1
2017-04-08 00:58:13,236 [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:java.version=1.7.0_76
2017-04-08 00:58:13,236 [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:java.vendor=Oracle Corporation
2017-04-08 00:58:13,236 [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:java.home=/opt/jdk1.7/jre
2017-04-08 00:58:13,236 [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:java.class.path=/opt/hadoop-2.6.4/etc/hadoop:/opt/hadoop-2.6.4/share/hadoop/common/lib/jsch-0.1.42.jar:/opt/hadoop-2.6.4/share/hadoop/common/lib/jersey-json-1.9.jar:/opt/hadoop-2.6.4/share/hadoop/common/lib/junit-4.11.jar:/opt/hadoop-2.6.4/share/hadoop/common/lib/commons-digester-1.8.jar:/opt/hadoop-2.6.4/share/hadoop/common/lib/jsp-api-2.1.jar:/opt/hadoop-2.6.4/share/hadoop/common/lib/avro-1.7.4.jar:/opt/hadoop-2.6.4/share/hadoop/common/lib/netty-3.6.2.Final.jar:/opt/hadoop-2.6.4/share/hadoop/common/lib/activation-1.1.jar:/opt/hadoop-2.6.4/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar:/opt/hadoop-2.6.4/share/hadoop/common/lib/xmlenc-0.52.jar:/opt/hadoop-2.6.4/share/hadoop/common/lib/commons-el-1.0.jar:/opt/hadoop-2.6.4/share/hadoop/common/lib/java-xmlbuilder-0.4.jar:/opt/hadoop-2.6.4/share/hadoop/common/lib/curator-client-2.6.0.jar:/opt/hadoop-2.6.4/share/hadoop/common/lib/commons-net-3.1.jar:/opt/hadoop-2.6.4/share/hadoop/common/lib/hadoop-annotations-2.6.4.jar:/opt/hadoop-2.6.4/share/hadoop/common/lib/commons-httpclient-3.1.jar:/opt/hadoop-2.6.4/share/hadoop/common/lib/hadoop-auth-2.6.4.jar:/opt/hadoop-2.6.4/share/hadoop/common/lib/commons-lang-2.6.jar:/opt/hadoop-2.6.4/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar:/opt/hadoop-2.6.4/share/hadoop/common/lib/commons-codec-1.4.jar:/opt/hadoop-2.6.4/share/hadoop/common/lib/commons-logging-1.1.3.jar:/opt/hadoop-2.6.4/share/hadoop/common/lib/jaxb-api-2.2.2.jar:/opt/hadoop-2.6.4/share/hadoop/common/lib/slf4j-api-1.7.5.jar:/opt/hadoop-2.6.4/share/hadoop/common/lib/api-asn1-api-1.0.0-M20.jar:/opt/hadoop-2.6.4/share/hadoop/common/lib/jetty-util-6.1.26.jar:/opt/hadoop-2.6.4/share/hadoop/common/lib/curator-recipes-2.6.0.jar:/opt/hadoop-2.6.4/share/hadoop/common/lib/protobuf-java-2.5.0.jar:/opt/hadoop-2.6.4/share/hadoop/common/lib/commons-collections-3.2.2.jar:/opt/hadoop-2.6.4/share/hadoop/common/lib/curator-framework-2.6.0.jar:/opt/hadoop-2.6.4/share/hadoop/common/lib/zookeeper-3.4.6.jar:/opt/hadoop-2.6.4/share/hadoop/common/lib/servlet-api-2.5.jar:/opt/hadoop-2.6.4/share/hadoop/common/lib/jasper-compiler-5.5.23.jar:/opt/hadoop-2.6.4/share/hadoop/common/lib/gson-2.2.4.jar:/opt/hadoop-2.6.4/share/hadoop/common/lib/api-util-1.0.0-M20.jar:/opt/hadoop-2.6.4/share/hadoop/common/lib/httpcore-4.2.5.jar:/opt/hadoop-2.6.4/share/hadoop/common/lib/guava-11.0.2.jar:/opt/hadoop-2.6.4/share/hadoop/common/lib/jackson-core-asl-1.9.13.jar:/opt/hadoop-2.6.4/share/hadoop/common/lib/jettison-1.1.jar:/opt/hadoop-2.6.4/share/hadoop/common/lib/httpclient-4.2.5.jar:/opt/hadoop-2.6.4/share/hadoop/common/lib/asm-3.2.jar:/opt/hadoop-2.6.4/share/hadoop/common/lib/jersey-server-1.9.jar:/opt/hadoop-2.6.4/share/hadoop/common/lib/jetty-6.1.26.jar:/opt/hadoop-2.6.4/share/hadoop/common/lib/hamcrest-core-1.3.jar:/opt/hadoop-2.6.4/share/hadoop/common/lib/jsr305-1.3.9.jar:/opt/hadoop-2.6.4/share/hadoop/common/lib/commons-io-2.4.jar:/opt/hadoop-2.6.4/share/hadoop/common/lib/commons-compress-1.4.1.jar:/opt/hadoop-2.6.4/share/hadoop/common/lib/mockito-all-1.8.5.jar:/opt/hadoop-2.6.4/share/hadoop/common/lib/jackson-mapper-asl-1.9.13.jar:/opt/hadoop-2.6.4/share/hadoop/common/lib/commons-beanutils-core-1.8.0.jar:/opt/hadoop-2.6.4/share/hadoop/common/lib/commons-cli-1.2.jar:/opt/hadoop-2.6.4/share/hadoop/common/lib/htrace-core-3.0.4.jar:/opt/hadoop-2.6.4/share/hadoop/common/lib/xz-1.0.jar:/opt/hadoop-2.6.4/share/hadoop/common/lib/commons-math3-3.1.1.jar:/opt/hadoop-2.6.4/share/hadoop/common/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/opt/hadoop-2.6.4/share/hadoop/common/lib/commons-beanutils-1.7.0.jar:/opt/hadoop-2.6.4/share/hadoop/common/lib/jersey-core-1.9.jar:/opt/hadoop-2.6.4/share/hadoop/common/lib/apacheds-i18n-2.0.0-M15.jar:/opt/hadoop-2.6.4/share/hadoop/common/lib/paranamer-2.3.jar:/opt/hadoop-2.6.4/share/hadoop/common/lib/log4j-1.2.17.jar:/opt/hadoop-2.6.4/share/hadoop/common/lib/jasper-runtime-5.5.23.jar:/opt/hadoop-2.6.4/share/hadoop/common/lib/snappy-java-1.0.4.1.jar:/opt/hadoop-2.6.4/share/hadoop/common/lib/jackson-xc-1.9.13.jar:/opt/hadoop-2.6.4/share/hadoop/common/lib/commons-configuration-1.6.jar:/opt/hadoop-2.6.4/share/hadoop/common/lib/jets3t-0.9.0.jar:/opt/hadoop-2.6.4/share/hadoop/common/lib/jackson-jaxrs-1.9.13.jar:/opt/hadoop-2.6.4/share/hadoop/common/lib/stax-api-1.0-2.jar:/opt/hadoop-2.6.4/share/hadoop/common/hadoop-common-2.6.4-tests.jar:/opt/hadoop-2.6.4/share/hadoop/common/hadoop-nfs-2.6.4.jar:/opt/hadoop-2.6.4/share/hadoop/common/hadoop-common-2.6.4.jar:/opt/hadoop-2.6.4/share/hadoop/hdfs:/opt/hadoop-2.6.4/share/hadoop/hdfs/lib/jsp-api-2.1.jar:/opt/hadoop-2.6.4/share/hadoop/hdfs/lib/netty-3.6.2.Final.jar:/opt/hadoop-2.6.4/share/hadoop/hdfs/lib/xmlenc-0.52.jar:/opt/hadoop-2.6.4/share/hadoop/hdfs/lib/commons-daemon-1.0.13.jar:/opt/hadoop-2.6.4/share/hadoop/hdfs/lib/commons-el-1.0.jar:/opt/hadoop-2.6.4/share/hadoop/hdfs/lib/commons-lang-2.6.jar:/opt/hadoop-2.6.4/share/hadoop/hdfs/lib/commons-codec-1.4.jar:/opt/hadoop-2.6.4/share/hadoop/hdfs/lib/commons-logging-1.1.3.jar:/opt/hadoop-2.6.4/share/hadoop/hdfs/lib/jetty-util-6.1.26.jar:/opt/hadoop-2.6.4/share/hadoop/hdfs/lib/protobuf-java-2.5.0.jar:/opt/hadoop-2.6.4/share/hadoop/hdfs/lib/servlet-api-2.5.jar:/opt/hadoop-2.6.4/share/hadoop/hdfs/lib/guava-11.0.2.jar:/opt/hadoop-2.6.4/share/hadoop/hdfs/lib/jackson-core-asl-1.9.13.jar:/opt/hadoop-2.6.4/share/hadoop/hdfs/lib/xml-apis-1.3.04.jar:/opt/hadoop-2.6.4/share/hadoop/hdfs/lib/xercesImpl-2.9.1.jar:/opt/hadoop-2.6.4/share/hadoop/hdfs/lib/asm-3.2.jar:/opt/hadoop-2.6.4/share/hadoop/hdfs/lib/jersey-server-1.9.jar:/opt/hadoop-2.6.4/share/hadoop/hdfs/lib/jetty-6.1.26.jar:/opt/hadoop-2.6.4/share/hadoop/hdfs/lib/jsr305-1.3.9.jar:/opt/hadoop-2.6.4/share/hadoop/hdfs/lib/commons-io-2.4.jar:/opt/hadoop-2.6.4/share/hadoop/hdfs/lib/jackson-mapper-asl-1.9.13.jar:/opt/hadoop-2.6.4/share/hadoop/hdfs/lib/commons-cli-1.2.jar:/opt/hadoop-2.6.4/share/hadoop/hdfs/lib/htrace-core-3.0.4.jar:/opt/hadoop-2.6.4/share/hadoop/hdfs/lib/jersey-core-1.9.jar:/opt/hadoop-2.6.4/share/hadoop/hdfs/lib/log4j-1.2.17.jar:/opt/hadoop-2.6.4/share/hadoop/hdfs/lib/jasper-runtime-5.5.23.jar:/opt/hadoop-2.6.4/share/hadoop/hdfs/hadoop-hdfs-2.6.4-tests.jar:/opt/hadoop-2.6.4/share/hadoop/hdfs/hadoop-hdfs-nfs-2.6.4.jar:/opt/hadoop-2.6.4/share/hadoop/hdfs/hadoop-hdfs-2.6.4.jar:/opt/hadoop-2.6.4/share/hadoop/yarn/lib/jersey-json-1.9.jar:/opt/hadoop-2.6.4/share/hadoop/yarn/lib/netty-3.6.2.Final.jar:/opt/hadoop-2.6.4/share/hadoop/yarn/lib/activation-1.1.jar:/opt/hadoop-2.6.4/share/hadoop/yarn/lib/javax.inject-1.jar:/opt/hadoop-2.6.4/share/hadoop/yarn/lib/jaxb-impl-2.2.3-1.jar:/opt/hadoop-2.6.4/share/hadoop/yarn/lib/commons-httpclient-3.1.jar:/opt/hadoop-2.6.4/share/hadoop/yarn/lib/aopalliance-1.0.jar:/opt/hadoop-2.6.4/share/hadoop/yarn/lib/commons-lang-2.6.jar:/opt/hadoop-2.6.4/share/hadoop/yarn/lib/commons-codec-1.4.jar:/opt/hadoop-2.6.4/share/hadoop/yarn/lib/commons-logging-1.1.3.jar:/opt/hadoop-2.6.4/share/hadoop/yarn/lib/jaxb-api-2.2.2.jar:/opt/hadoop-2.6.4/share/hadoop/yarn/lib/jetty-util-6.1.26.jar:/opt/hadoop-2.6.4/share/hadoop/yarn/lib/protobuf-java-2.5.0.jar:/opt/hadoop-2.6.4/share/hadoop/yarn/lib/commons-collections-3.2.2.jar:/opt/hadoop-2.6.4/share/hadoop/yarn/lib/jersey-client-1.9.jar:/opt/hadoop-2.6.4/share/hadoop/yarn/lib/zookeeper-3.4.6.jar:/opt/hadoop-2.6.4/share/hadoop/yarn/lib/leveldbjni-all-1.8.jar:/opt/hadoop-2.6.4/share/hadoop/yarn/lib/servlet-api-2.5.jar:/opt/hadoop-2.6.4/share/hadoop/yarn/lib/guava-11.0.2.jar:/opt/hadoop-2.6.4/share/hadoop/yarn/lib/jackson-core-asl-1.9.13.jar:/opt/hadoop-2.6.4/share/hadoop/yarn/lib/jettison-1.1.jar:/opt/hadoop-2.6.4/share/hadoop/yarn/lib/asm-3.2.jar:/opt/hadoop-2.6.4/share/hadoop/yarn/lib/jersey-server-1.9.jar:/opt/hadoop-2.6.4/share/hadoop/yarn/lib/guice-3.0.jar:/opt/hadoop-2.6.4/share/hadoop/yarn/lib/jetty-6.1.26.jar:/opt/hadoop-2.6.4/share/hadoop/yarn/lib/jline-2.12.jar:/opt/hadoop-2.6.4/share/hadoop/yarn/lib/jsr305-1.3.9.jar:/opt/hadoop-2.6.4/share/hadoop/yarn/lib/commons-io-2.4.jar:/opt/hadoop-2.6.4/share/hadoop/yarn/lib/commons-compress-1.4.1.jar:/opt/hadoop-2.6.4/share/hadoop/yarn/lib/jackson-mapper-asl-1.9.13.jar:/opt/hadoop-2.6.4/share/hadoop/yarn/lib/commons-cli-1.2.jar:/opt/hadoop-2.6.4/share/hadoop/yarn/lib/xz-1.0.jar:/opt/hadoop-2.6.4/share/hadoop/yarn/lib/guice-servlet-3.0.jar:/opt/hadoop-2.6.4/share/hadoop/yarn/lib/jersey-guice-1.9.jar:/opt/hadoop-2.6.4/share/hadoop/yarn/lib/jersey-core-1.9.jar:/opt/hadoop-2.6.4/share/hadoop/yarn/lib/log4j-1.2.17.jar:/opt/hadoop-2.6.4/share/hadoop/yarn/lib/jackson-xc-1.9.13.jar:/opt/hadoop-2.6.4/share/hadoop/yarn/lib/jackson-jaxrs-1.9.13.jar:/opt/hadoop-2.6.4/share/hadoop/yarn/lib/stax-api-1.0-2.jar:/opt/hadoop-2.6.4/share/hadoop/yarn/hadoop-yarn-registry-2.6.4.jar:/opt/hadoop-2.6.4/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.6.4.jar:/opt/hadoop-2.6.4/share/hadoop/yarn/hadoop-yarn-common-2.6.4.jar:/opt/hadoop-2.6.4/share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-2.6.4.jar:/opt/hadoop-2.6.4/share/hadoop/yarn/hadoop-yarn-client-2.6.4.jar:/opt/hadoop-2.6.4/share/hadoop/yarn/hadoop-yarn-server-tests-2.6.4.jar:/opt/hadoop-2.6.4/share/hadoop/yarn/hadoop-yarn-api-2.6.4.jar:/opt/hadoop-2.6.4/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.6.4.jar:/opt/hadoop-2.6.4/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.6.4.jar:/opt/hadoop-2.6.4/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.6.4.jar:/opt/hadoop-2.6.4/share/hadoop/yarn/hadoop-yarn-server-common-2.6.4.jar:/opt/hadoop-2.6.4/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.6.4.jar:/opt/hadoop-2.6.4/share/hadoop/mapreduce/lib/junit-4.11.jar:/opt/hadoop-2.6.4/share/hadoop/mapreduce/lib/avro-1.7.4.jar:/opt/hadoop-2.6.4/share/hadoop/mapreduce/lib/netty-3.6.2.Final.jar:/opt/hadoop-2.6.4/share/hadoop/mapreduce/lib/javax.inject-1.jar:/opt/hadoop-2.6.4/share/hadoop/mapreduce/lib/hadoop-annotations-2.6.4.jar:/opt/hadoop-2.6.4/share/hadoop/mapreduce/lib/aopalliance-1.0.jar:/opt/hadoop-2.6.4/share/hadoop/mapreduce/lib/protobuf-java-2.5.0.jar:/opt/hadoop-2.6.4/share/hadoop/mapreduce/lib/leveldbjni-all-1.8.jar:/opt/hadoop-2.6.4/share/hadoop/mapreduce/lib/jackson-core-asl-1.9.13.jar:/opt/hadoop-2.6.4/share/hadoop/mapreduce/lib/asm-3.2.jar:/opt/hadoop-2.6.4/share/hadoop/mapreduce/lib/jersey-server-1.9.jar:/opt/hadoop-2.6.4/share/hadoop/mapreduce/lib/guice-3.0.jar:/opt/hadoop-2.6.4/share/hadoop/mapreduce/lib/hamcrest-core-1.3.jar:/opt/hadoop-2.6.4/share/hadoop/mapreduce/lib/commons-io-2.4.jar:/opt/hadoop-2.6.4/share/hadoop/mapreduce/lib/commons-compress-1.4.1.jar:/opt/hadoop-2.6.4/share/hadoop/mapreduce/lib/jackson-mapper-asl-1.9.13.jar:/opt/hadoop-2.6.4/share/hadoop/mapreduce/lib/xz-1.0.jar:/opt/hadoop-2.6.4/share/hadoop/mapreduce/lib/guice-servlet-3.0.jar:/opt/hadoop-2.6.4/share/hadoop/mapreduce/lib/jersey-guice-1.9.jar:/opt/hadoop-2.6.4/share/hadoop/mapreduce/lib/jersey-core-1.9.jar:/opt/hadoop-2.6.4/share/hadoop/mapreduce/lib/paranamer-2.3.jar:/opt/hadoop-2.6.4/share/hadoop/mapreduce/lib/log4j-1.2.17.jar:/opt/hadoop-2.6.4/share/hadoop/mapreduce/lib/snappy-java-1.0.4.1.jar:/opt/hadoop-2.6.4/share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.6.4.jar:/opt/hadoop-2.6.4/share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.6.4.jar:/opt/hadoop-2.6.4/share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.6.4.jar:/opt/hadoop-2.6.4/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.6.4.jar:/opt/hadoop-2.6.4/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-2.6.4.jar:/opt/hadoop-2.6.4/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.6.4.jar:/opt/hadoop-2.6.4/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-2.6.4.jar:/opt/hadoop-2.6.4/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-2.6.4.jar:/opt/hadoop-2.6.4/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.6.4-tests.jar:/opt/hbase-1.2.1/conf:/opt/pig-0.16.0/conf:/opt/jdk1.7/lib/tools.jar:/opt/hadoop-2.6.4:/opt/pig-0.16.0/lib/accumulo-core-1.5.0.jar:/opt/pig-0.16.0/lib/accumulo-fate-1.5.0.jar:/opt/pig-0.16.0/lib/accumulo-server-1.5.0.jar:/opt/pig-0.16.0/lib/accumulo-start-1.5.0.jar:/opt/pig-0.16.0/lib/accumulo-trace-1.5.0.jar:/opt/pig-0.16.0/lib/antlr-runtime-3.4.jar:/opt/pig-0.16.0/lib/asm-3.3.1.jar:/opt/pig-0.16.0/lib/automaton-1.11-8.jar:/opt/pig-0.16.0/lib/avro-1.7.5.jar:/opt/pig-0.16.0/lib/avro-tools-1.7.5-nodeps.jar:/opt/pig-0.16.0/lib/groovy-all-2.4.5.jar:/opt/pig-0.16.0/lib/guava-11.0.jar:/opt/pig-0.16.0/lib/hive-common-1.2.1.jar:/opt/pig-0.16.0/lib/hive-exec-1.2.1-core.jar:/opt/pig-0.16.0/lib/hive-serde-1.2.1.jar:/opt/pig-0.16.0/lib/hive-shims-common-1.2.1.jar:/opt/pig-0.16.0/lib/httpdlog-inputformat-2.4.jar:/opt/pig-0.16.0/lib/httpdlog-parser-2.4.jar:/opt/pig-0.16.0/lib/httpdlog-pigloader-2.4.jar:/opt/pig-0.16.0/lib/ivy-2.2.0.jar:/opt/pig-0.16.0/lib/jackson-core-asl-1.9.13.jar:/opt/pig-0.16.0/lib/jackson-mapper-asl-1.9.13.jar:/opt/pig-0.16.0/lib/jansi-1.9.jar:/opt/pig-0.16.0/lib/jline-1.0.jar:/opt/pig-0.16.0/lib/joda-time-2.9.3.jar:/opt/pig-0.16.0/lib/jruby-complete-1.6.7.jar:/opt/pig-0.16.0/lib/js-1.7R2.jar:/opt/pig-0.16.0/lib/json-simple-1.1.jar:/opt/pig-0.16.0/lib/jython-standalone-2.7.0.jar:/opt/pig-0.16.0/lib/kryo-2.22.jar:/opt/pig-0.16.0/lib/parser-core-2.4.jar:/opt/pig-0.16.0/lib/piggybank.jar:/opt/pig-0.16.0/lib/protobuf-java-2.5.0.jar:/opt/pig-0.16.0/lib/snappy-java-1.1.0.1.jar:/opt/pig-0.16.0/lib/ST4-4.0.4.jar:/opt/pig-0.16.0/lib/trevni-avro-1.7.5.jar:/opt/pig-0.16.0/lib/trevni-core-1.7.5.jar:/opt/pig-0.16.0/lib/zookeeper-3.4.5.jar:/opt/hbase-1.2.1/lib/activation-1.1.jar:/opt/hbase-1.2.1/lib/antisamy-1.4.3.jar:/opt/hbase-1.2.1/lib/aopalliance-1.0.jar:/opt/hbase-1.2.1/lib/apacheds-i18n-2.0.0-M15.jar:/opt/hbase-1.2.1/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/opt/hbase-1.2.1/lib/api-asn1-api-1.0.0-M20.jar:/opt/hbase-1.2.1/lib/api-util-1.0.0-M20.jar:/opt/hbase-1.2.1/lib/asm-3.1.jar:/opt/hbase-1.2.1/lib/avro-1.7.4.jar:/opt/hbase-1.2.1/lib/batik-css-1.7.jar:/opt/hbase-1.2.1/lib/batik-ext-1.7.jar:/opt/hbase-1.2.1/lib/batik-util-1.7.jar:/opt/hbase-1.2.1/lib/bsh-core-2.0b4.jar:/opt/hbase-1.2.1/lib/commons-beanutils-1.7.0.jar:/opt/hbase-1.2.1/lib/commons-beanutils-core-1.7.0.jar:/opt/hbase-1.2.1/lib/commons-cli-1.2.jar:/opt/hbase-1.2.1/lib/commons-codec-1.9.jar:/opt/hbase-1.2.1/lib/commons-collections-3.2.2.jar:/opt/hbase-1.2.1/lib/commons-compress-1.4.1.jar:/opt/hbase-1.2.1/lib/commons-configuration-1.6.jar:/opt/hbase-1.2.1/lib/commons-daemon-1.0.13.jar:/opt/hbase-1.2.1/lib/commons-digester-1.8.jar:/opt/hbase-1.2.1/lib/commons-el-1.0.jar:/opt/hbase-1.2.1/lib/commons-fileupload-1.2.jar:/opt/hbase-1.2.1/lib/commons-httpclient-3.1.jar:/opt/hbase-1.2.1/lib/commons-io-2.4.jar:/opt/hbase-1.2.1/lib/commons-lang-2.6.jar:/opt/hbase-1.2.1/lib/commons-logging-1.2.jar:/opt/hbase-1.2.1/lib/commons-math-2.2.jar:/opt/hbase-1.2.1/lib/commons-math3-3.1.1.jar:/opt/hbase-1.2.1/lib/commons-net-3.1.jar:/opt/hbase-1.2.1/lib/disruptor-3.3.0.jar:/opt/hbase-1.2.1/lib/esapi-2.1.0.jar:/opt/hbase-1.2.1/lib/findbugs-annotations-1.3.9-1.jar:/opt/hbase-1.2.1/lib/guava-12.0.1.jar:/opt/hbase-1.2.1/lib/guice-3.0.jar:/opt/hbase-1.2.1/lib/guice-servlet-3.0.jar:/opt/hbase-1.2.1/lib/hadoop-annotations-2.5.1.jar:/opt/hbase-1.2.1/lib/hadoop-auth-2.5.1.jar:/opt/hbase-1.2.1/lib/hadoop-client-2.5.1.jar:/opt/hbase-1.2.1/lib/hadoop-common-2.5.1.jar:/opt/hbase-1.2.1/lib/hadoop-hdfs-2.5.1.jar:/opt/hbase-1.2.1/lib/hadoop-mapreduce-client-app-2.5.1.jar:/opt/hbase-1.2.1/lib/hadoop-mapreduce-client-common-2.5.1.jar:/opt/hbase-1.2.1/lib/hadoop-mapreduce-client-core-2.5.1.jar:/opt/hbase-1.2.1/lib/hadoop-mapreduce-client-jobclient-2.5.1.jar:/opt/hbase-1.2.1/lib/hadoop-mapreduce-client-shuffle-2.5.1.jar:/opt/hbase-1.2.1/lib/hadoop-yarn-api-2.5.1.jar:/opt/hbase-1.2.1/lib/hadoop-yarn-client-2.5.1.jar:/opt/hbase-1.2.1/lib/hadoop-yarn-common-2.5.1.jar:/opt/hbase-1.2.1/lib/hadoop-yarn-server-common-2.5.1.jar:/opt/hbase-1.2.1/lib/hbase-annotations-1.2.1.jar:/opt/hbase-1.2.1/lib/hbase-annotations-1.2.1-tests.jar:/opt/hbase-1.2.1/lib/hbase-client-1.2.1.jar:/opt/hbase-1.2.1/lib/hbase-common-1.2.1.jar:/opt/hbase-1.2.1/lib/hbase-common-1.2.1-tests.jar:/opt/hbase-1.2.1/lib/hbase-examples-1.2.1.jar:/opt/hbase-1.2.1/lib/hbase-external-blockcache-1.2.1.jar:/opt/hbase-1.2.1/lib/hbase-hadoop2-compat-1.2.1.jar:/opt/hbase-1.2.1/lib/hbase-hadoop-compat-1.2.1.jar:/opt/hbase-1.2.1/lib/hbase-it-1.2.1.jar:/opt/hbase-1.2.1/lib/hbase-it-1.2.1-tests.jar:/opt/hbase-1.2.1/lib/hbase-prefix-tree-1.2.1.jar:/opt/hbase-1.2.1/lib/hbase-procedure-1.2.1.jar:/opt/hbase-1.2.1/lib/hbase-protocol-1.2.1.jar:/opt/hbase-1.2.1/lib/hbase-resource-bundle-1.2.1.jar:/opt/hbase-1.2.1/lib/hbase-rest-1.2.1.jar:/opt/hbase-1.2.1/lib/hbase-server-1.2.1.jar:/opt/hbase-1.2.1/lib/hbase-server-1.2.1-tests.jar:/opt/hbase-1.2.1/lib/hbase-shell-1.2.1.jar:/opt/hbase-1.2.1/lib/hbase-thrift-1.2.1.jar:/opt/hbase-1.2.1/lib/htrace-core-3.1.0-incubating.jar:/opt/hbase-1.2.1/lib/httpclient-4.2.5.jar:/opt/hbase-1.2.1/lib/httpcore-4.4.1.jar:/opt/hbase-1.2.1/lib/jackson-core-asl-1.9.13.jar:/opt/hbase-1.2.1/lib/jackson-jaxrs-1.9.13.jar:/opt/hbase-1.2.1/lib/jackson-mapper-asl-1.9.13.jar:/opt/hbase-1.2.1/lib/jackson-xc-1.9.13.jar:/opt/hbase-1.2.1/lib/jamon-runtime-2.4.1.jar:/opt/hbase-1.2.1/lib/jasper-compiler-5.5.23.jar:/opt/hbase-1.2.1/lib/jasper-runtime-5.5.23.jar:/opt/hbase-1.2.1/lib/javax.inject-1.jar:/opt/hbase-1.2.1/lib/java-xmlbuilder-0.4.jar:/opt/hbase-1.2.1/lib/jaxb-api-2.2.2.jar:/opt/hbase-1.2.1/lib/jaxb-impl-2.2.3-1.jar:/opt/hbase-1.2.1/lib/jcodings-1.0.8.jar:/opt/hbase-1.2.1/lib/jersey-client-1.9.jar:/opt/hbase-1.2.1/lib/jersey-core-1.9.jar:/opt/hbase-1.2.1/lib/jersey-guice-1.9.jar:/opt/hbase-1.2.1/lib/jersey-json-1.9.jar:/opt/hbase-1.2.1/lib/jersey-server-1.9.jar:/opt/hbase-1.2.1/lib/jets3t-0.9.0.jar:/opt/hbase-1.2.1/lib/jettison-1.3.3.jar:/opt/hbase-1.2.1/lib/jetty-6.1.26.jar:/opt/hbase-1.2.1/lib/jetty-sslengine-6.1.26.jar:/opt/hbase-1.2.1/lib/jetty-util-6.1.26.jar:/opt/hbase-1.2.1/lib/joni-2.1.2.jar:/opt/hbase-1.2.1/lib/jruby-complete-1.6.8.jar:/opt/hbase-1.2.1/lib/jsch-0.1.42.jar:/opt/hbase-1.2.1/lib/jsp-2.1-6.1.14.jar:/opt/hbase-1.2.1/lib/jsp-api-2.1-6.1.14.jar:/opt/hbase-1.2.1/lib/jsr305-1.3.9.jar:/opt/hbase-1.2.1/lib/junit-4.12.jar:/opt/hbase-1.2.1/lib/leveldbjni-all-1.8.jar:/opt/hbase-1.2.1/lib/libthrift-0.9.3.jar:/opt/hbase-1.2.1/lib/log4j-1.2.17.jar:/opt/hbase-1.2.1/lib/metrics-core-2.2.0.jar:/opt/hbase-1.2.1/lib/nekohtml-1.9.12.jar:/opt/hbase-1.2.1/lib/netty-all-4.0.23.Final.jar:/opt/hbase-1.2.1/lib/paranamer-2.3.jar:/opt/hbase-1.2.1/lib/phoenix-4.8.2-HBase-1.2-server.jar:/opt/hbase-1.2.1/lib/phoenix-core-4.8.2-HBase-1.2.jar:/opt/hbase-1.2.1/lib/protobuf-java-2.5.0.jar:/opt/hbase-1.2.1/lib/servlet-api-2.5-6.1.14.jar:/opt/hbase-1.2.1/lib/servlet-api-2.5.jar:/opt/hbase-1.2.1/lib/slf4j-api-1.7.7.jar:/opt/hbase-1.2.1/lib/slf4j-log4j12-1.7.5.jar:/opt/hbase-1.2.1/lib/snappy-java-1.0.4.1.jar:/opt/hbase-1.2.1/lib/spymemcached-2.11.6.jar:/opt/hbase-1.2.1/lib/xalan-2.7.0.jar:/opt/hbase-1.2.1/lib/xml-apis-1.3.03.jar:/opt/hbase-1.2.1/lib/xml-apis-ext-1.3.04.jar:/opt/hbase-1.2.1/lib/xmlenc-0.52.jar:/opt/hbase-1.2.1/lib/xom-1.2.5.jar:/opt/hbase-1.2.1/lib/xz-1.0.jar:/opt/hbase-1.2.1/lib/zookeeper-3.4.6.jar:/opt/zookeeper-3.4.5/zookeeper-3.4.5.jar:/opt/pig-0.16.0/pig-0.16.0-core-h2.jar:/opt/pig-0.16.0/lib/h2/avro-mapred-1.7.5-hadoop2.jar:/opt/pig-0.16.0/lib/h2/commons-collections4-4.0.jar:/opt/pig-0.16.0/lib/h2/hbase-client-0.98.12-hadoop2.jar:/opt/pig-0.16.0/lib/h2/hbase-common-0.98.12-hadoop2.jar:/opt/pig-0.16.0/lib/h2/hbase-hadoop2-compat-0.98.12-hadoop2.jar:/opt/pig-0.16.0/lib/h2/hbase-hadoop-compat-0.98.12-hadoop2.jar:/opt/pig-0.16.0/lib/h2/hbase-protocol-0.98.12-hadoop2.jar:/opt/pig-0.16.0/lib/h2/hbase-server-0.98.12-hadoop2.jar:/opt/pig-0.16.0/lib/h2/hive-shims-0.23-1.2.1.jar:/opt/pig-0.16.0/lib/h2/tez-api-0.7.0.jar:/opt/pig-0.16.0/lib/h2/tez-common-0.7.0.jar:/opt/pig-0.16.0/lib/h2/tez-dag-0.7.0.jar:/opt/pig-0.16.0/lib/h2/tez-mapreduce-0.7.0.jar:/opt/pig-0.16.0/lib/h2/tez-runtime-internals-0.7.0.jar:/opt/pig-0.16.0/lib/h2/tez-runtime-library-0.7.0.jar:/opt/pig-0.16.0/lib/h2/tez-yarn-timeline-history-with-acls-0.7.0.jar::/opt/hadoop-2.6.4/contrib/capacity-scheduler/*.jar
2017-04-08 00:58:13,249 [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:java.library.path=/opt/hadoop-2.6.4/lib/native
2017-04-08 00:58:13,249 [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:java.io.tmpdir=/tmp
2017-04-08 00:58:13,249 [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:java.compiler=<NA>
2017-04-08 00:58:13,249 [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:os.name=Linux
2017-04-08 00:58:13,249 [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:os.arch=amd64
2017-04-08 00:58:13,249 [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:os.version=2.6.32-642.15.1.el6.x86_64
2017-04-08 00:58:13,249 [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:user.name=root
2017-04-08 00:58:13,249 [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:user.home=/root
2017-04-08 00:58:13,249 [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:user.dir=/opt/testSh
2017-04-08 00:58:13,250 [main] INFO org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=hadoop1:2181,hadoop2:2181,hadoop3:2181 sessionTimeout=90000 watcher=hconnection-0x4b42f44a0x0, quorum=hadoop1:2181,hadoop2:2181,hadoop3:2181, baseZNode=/hbase
2017-04-08 00:58:13,303 [main-SendThread(hadoop2:2181)] INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server hadoop2/192.168.132.138:2181. Will not attempt to authenticate using SASL (unknown error)
2017-04-08 00:58:13,320 [main-SendThread(hadoop2:2181)] INFO org.apache.zookeeper.ClientCnxn - Socket connection established to hadoop2/192.168.132.138:2181, initiating session
2017-04-08 00:58:13,332 [main-SendThread(hadoop2:2181)] INFO org.apache.zookeeper.ClientCnxn - Session establishment complete on server hadoop2/192.168.132.138:2181, sessionid = 0x25b4c8f120f0001, negotiated timeout = 40000
2017-04-08 00:58:13,950 [main] INFO org.apache.phoenix.metrics.Metrics - Initializing metrics system: phoenix
2017-04-08 00:58:13,986 [main] INFO org.apache.hadoop.metrics2.impl.MetricsConfig - loaded properties from hadoop-metrics2.properties
2017-04-08 00:58:14,047 [main] INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl - Scheduled snapshot period at 10 second(s).
2017-04-08 00:58:14,047 [main] INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl - phoenix metrics system started
2017-04-08 00:58:15,783 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - fs.default.name is deprecated. Instead, use fs.defaultFS
2017-04-08 00:58:15,815 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - fs.default.name is deprecated. Instead, use fs.defaultFS
2017-04-08 00:58:15,842 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.textoutputformat.separator is deprecated. Instead, use mapreduce.output.textoutputformat.separator
2017-04-08 00:58:15,882 [main] INFO org.apache.pig.tools.pigstats.ScriptState - Pig features used in the script: UNKNOWN
2017-04-08 00:58:15,941 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - fs.default.name is deprecated. Instead, use fs.defaultFS
2017-04-08 00:58:15,983 [main] INFO org.apache.pig.newplan.logical.optimizer.LogicalPlanOptimizer - {RULES_ENABLED=[AddForEach, ColumnMapKeyPrune, ConstantCalculator, GroupByConstParallelSetter, LimitOptimizer, LoadTypeCastInserter, MergeFilter, MergeForEach, PartitionFilterOptimizer, PredicatePushdownOptimizer, PushDownForEachFlatten, PushUpFilter, SplitFilter, StreamTypeCastInserter]}
2017-04-08 00:58:16,029 [main] INFO org.apache.pig.impl.util.SpillableMemoryManager - Selected heap (Tenured Gen) of size 699072512 to monitor. collectionUsageThreshold = 489350752, usageThreshold = 489350752
2017-04-08 00:58:16,101 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MRCompiler - File concatenation threshold: 100 optimistic? false
2017-04-08 00:58:16,147 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MultiQueryOptimizer - MR plan size before optimization: 1
2017-04-08 00:58:16,147 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MultiQueryOptimizer - MR plan size after optimization: 1
2017-04-08 00:58:16,177 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - fs.default.name is deprecated. Instead, use fs.defaultFS
2017-04-08 00:58:16,220 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - session.id is deprecated. Instead, use dfs.metrics.session-id
2017-04-08 00:58:16,228 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Initializing JVM Metrics with processName=JobTracker, sessionId=
2017-04-08 00:58:16,284 [main] INFO org.apache.pig.tools.pigstats.mapreduce.MRScriptState - Pig script settings are added to the job
2017-04-08 00:58:16,300 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.job.reduce.markreset.buffer.percent is deprecated. Instead, use mapreduce.reduce.markreset.buffer.percent
2017-04-08 00:58:16,300 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler - mapred.job.reduce.markreset.buffer.percent is not set, set to default 0.3
2017-04-08 00:58:16,300 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2017-04-08 00:58:16,408 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler - Setting up single store job
2017-04-08 00:58:16,506 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - 1 map-reduce job(s) waiting for submission.
2017-04-08 00:58:16,511 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.job.tracker.http.address is deprecated. Instead, use mapreduce.jobtracker.http.address
2017-04-08 00:58:16,598 [JobControl] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2017-04-08 00:58:16,619 [JobControl] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.task.id is deprecated. Instead, use mapreduce.task.attempt.id
2017-04-08 00:58:16,623 [JobControl] INFO org.apache.hadoop.conf.Configuration.deprecation - fs.default.name is deprecated. Instead, use fs.defaultFS
2017-04-08 00:58:17,219 [JobControl] WARN org.apache.hadoop.mapreduce.JobResourceUploader - No job jar file set. User classes may not be found. See Job or Job#setJar(String).
2017-04-08 00:58:17,342 [JobControl] INFO org.apache.hadoop.conf.Configuration.deprecation - fs.default.name is deprecated. Instead, use fs.defaultFS
2017-04-08 00:58:17,342 [JobControl] INFO org.apache.phoenix.jdbc.PhoenixEmbeddedDriver$ConnectionInfo - Trying to connect to a secure cluster as 2181 with keytab /hbase
2017-04-08 00:58:17,342 [JobControl] INFO org.apache.phoenix.jdbc.PhoenixEmbeddedDriver$ConnectionInfo - Successful login to secure cluster
2017-04-08 00:58:17,386 [JobControl] INFO org.apache.hadoop.conf.Configuration.deprecation - fs.default.name is deprecated. Instead, use fs.defaultFS
2017-04-08 00:58:17,387 [JobControl] INFO org.apache.phoenix.jdbc.PhoenixEmbeddedDriver$ConnectionInfo - Trying to connect to a secure cluster as 2181 with keytab /hbase
2017-04-08 00:58:17,387 [JobControl] INFO org.apache.phoenix.jdbc.PhoenixEmbeddedDriver$ConnectionInfo - Successful login to secure cluster
2017-04-08 00:58:17,402 [JobControl] INFO org.apache.phoenix.mapreduce.PhoenixInputFormat - Select Statement: SELECT "ID","0"."PLACE_TYPE","0"."PLACE_CODE","0"."PLACE_NAME","0"."UP_PLACE_CODE" FROM SP_ADDRESS
2017-04-08 00:58:17,834 [JobControl] INFO org.apache.hadoop.mapreduce.JobSubmitter - number of splits:1
2017-04-08 00:58:18,187 [JobControl] INFO org.apache.hadoop.mapreduce.JobSubmitter - Submitting tokens for job: job_local1990534472_0001
2017-04-08 00:58:18,261 [JobControl] WARN org.apache.hadoop.conf.Configuration - file:/tmp/hadoop-root/mapred/staging/root1990534472/.staging/job_local1990534472_0001/job.xml:an attempt to override final parameter: mapreduce.framework.name; Ignoring.
2017-04-08 00:58:18,579 [JobControl] INFO org.apache.hadoop.mapreduce.Job - The url to track the job: http://localhost:8080/
2017-04-08 00:58:18,581 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - HadoopJobId: job_local1990534472_0001
2017-04-08 00:58:18,581 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - Processing aliases rows
2017-04-08 00:58:18,581 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - detailed locations: M: rows[2,7] C: R:
2017-04-08 00:58:18,597 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - 0% complete
2017-04-08 00:58:18,597 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - Running jobs are [job_local1990534472_0001]
2017-04-08 00:58:18,597 [Thread-12] INFO org.apache.hadoop.mapred.LocalJobRunner - OutputCommitter set in config null
2017-04-08 00:58:18,668 [Thread-12] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.textoutputformat.separator is deprecated. Instead, use mapreduce.output.textoutputformat.separator
2017-04-08 00:58:18,673 [Thread-12] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.job.reduce.markreset.buffer.percent is deprecated. Instead, use mapreduce.reduce.markreset.buffer.percent
2017-04-08 00:58:18,680 [Thread-12] INFO org.apache.hadoop.conf.Configuration.deprecation - fs.default.name is deprecated. Instead, use fs.defaultFS
2017-04-08 00:58:18,680 [Thread-12] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2017-04-08 00:58:18,699 [Thread-12] INFO org.apache.hadoop.mapred.LocalJobRunner - OutputCommitter is org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigOutputCommitter
2017-04-08 00:58:19,021 [Thread-12] INFO org.apache.hadoop.mapred.LocalJobRunner - Waiting for map tasks
2017-04-08 00:58:19,028 [LocalJobRunner Map Task Executor #0] INFO org.apache.hadoop.mapred.LocalJobRunner - Starting task: attempt_local1990534472_0001_m_000000_0
2017-04-08 00:58:19,282 [LocalJobRunner Map Task Executor #0] INFO org.apache.hadoop.mapred.Task - Using ResourceCalculatorProcessTree : [ ]
2017-04-08 00:58:19,299 [LocalJobRunner Map Task Executor #0] INFO org.apache.hadoop.mapred.MapTask - Processing split: Number of splits :1
Total Length = 0
Input split[0]:
Length = 0
ClassName: org.apache.phoenix.mapreduce.PhoenixInputSplit
Locations:
-----------------------
2017-04-08 00:58:19,391 [LocalJobRunner Map Task Executor #0] INFO org.apache.phoenix.jdbc.PhoenixEmbeddedDriver$ConnectionInfo - Trying to connect to a secure cluster as 2181 with keytab /hbase
2017-04-08 00:58:19,391 [LocalJobRunner Map Task Executor #0] INFO org.apache.phoenix.jdbc.PhoenixEmbeddedDriver$ConnectionInfo - Successful login to secure cluster
2017-04-08 00:58:19,463 [LocalJobRunner Map Task Executor #0] INFO org.apache.phoenix.jdbc.PhoenixEmbeddedDriver$ConnectionInfo - Trying to connect to a secure cluster as 2181 with keytab /hbase
2017-04-08 00:58:19,463 [LocalJobRunner Map Task Executor #0] INFO org.apache.phoenix.jdbc.PhoenixEmbeddedDriver$ConnectionInfo - Successful login to secure cluster
2017-04-08 00:58:19,466 [LocalJobRunner Map Task Executor #0] INFO org.apache.phoenix.mapreduce.PhoenixInputFormat - Select Statement: SELECT "ID","0"."PLACE_TYPE","0"."PLACE_CODE","0"."PLACE_NAME","0"."UP_PLACE_CODE" FROM SP_ADDRESS
2017-04-08 00:58:19,497 [LocalJobRunner Map Task Executor #0] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigRecordReader - Current split being processed
2017-04-08 00:58:19,532 [LocalJobRunner Map Task Executor #0] INFO org.apache.pig.impl.util.SpillableMemoryManager - Selected heap (Tenured Gen) of size 699072512 to monitor. collectionUsageThreshold = 489350752, usageThreshold = 489350752
2017-04-08 00:58:19,533 [LocalJobRunner Map Task Executor #0] WARN org.apache.pig.data.SchemaTupleBackend - SchemaTupleBackend has already been initialized
2017-04-08 00:58:19,535 [LocalJobRunner Map Task Executor #0] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapOnly$Map - Aliases being processed per job phase (AliasName[line,offset]): M: rows[2,7] C: R:
2017-04-08 00:58:19,574 [LocalJobRunner Map Task Executor #0] INFO org.apache.hadoop.mapred.LocalJobRunner -
2017-04-08 00:58:19,574 [LocalJobRunner Map Task Executor #0] INFO org.apache.hadoop.mapred.Task - Task:attempt_local1990534472_0001_m_000000_0 is done. And is in the process of committing
2017-04-08 00:58:19,604 [LocalJobRunner Map Task Executor #0] INFO org.apache.hadoop.mapred.LocalJobRunner -
2017-04-08 00:58:19,604 [LocalJobRunner Map Task Executor #0] INFO org.apache.hadoop.mapred.Task - Task attempt_local1990534472_0001_m_000000_0 is allowed to commit now
2017-04-08 00:58:19,607 [LocalJobRunner Map Task Executor #0] INFO org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter - Saved output of task 'attempt_local1990534472_0001_m_000000_0' to file:/opt/testSh/SP_ADDRESS.csv/_temporary/0/task_local1990534472_0001_m_000000
2017-04-08 00:58:19,611 [LocalJobRunner Map Task Executor #0] INFO org.apache.hadoop.mapred.LocalJobRunner - map
2017-04-08 00:58:19,611 [LocalJobRunner Map Task Executor #0] INFO org.apache.hadoop.mapred.Task - Task 'attempt_local1990534472_0001_m_000000_0' done.
2017-04-08 00:58:19,611 [LocalJobRunner Map Task Executor #0] INFO org.apache.hadoop.mapred.LocalJobRunner - Finishing task: attempt_local1990534472_0001_m_000000_0
2017-04-08 00:58:19,615 [Thread-12] INFO org.apache.hadoop.mapred.LocalJobRunner - map task executor complete.
2017-04-08 00:58:19,742 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2017-04-08 00:58:19,750 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2017-04-08 00:58:19,751 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
2017-04-08 00:58:19,751 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
2017-04-08 00:58:19,753 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2017-04-08 00:58:19,776 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - 100% complete
2017-04-08 00:58:19,778 [main] INFO org.apache.pig.tools.pigstats.mapreduce.SimplePigStats - Script Statistics:
HadoopVersion PigVersion UserId StartedAt FinishedAt Features
2.6.4 0.16.0 root 2017-04-08 00:58:16 2017-04-08 00:58:19 UNKNOWN
Success!
Job Stats (time in seconds):
JobId Maps Reduces MaxMapTime MinMapTime AvgMapTime MedianMapTime MaxReduceTime MinReduceTime AvgReduceTime MedianReducetime Alias Feature Outputs
job_local1990534472_0001 1 0 n/a n/a n/a n/a 0 0 0 0 rows MAP_ONLY file:///opt/testSh/SP_ADDRESS.csv,
Input(s):
Successfully read 0 records from: "hbase://table/SP_ADDRESS"
Output(s):
Successfully stored 0 records in: "file:///opt/testSh/SP_ADDRESS.csv"
Counters:
Total records written : 0
Total bytes written : 0
Spillable Memory Manager spill count : 0
Total bags proactively spilled: 0
Total records proactively spilled: 0
Job DAG:
job_local1990534472_0001
2017-04-08 00:58:19,780 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2017-04-08 00:58:19,781 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2017-04-08 00:58:19,782 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2017-04-08 00:58:19,792 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - Success!
2017-04-08 00:58:19,823 [main] INFO org.apache.pig.Main - Pig script completed in 10 seconds and 926 milliseconds (10926 ms)