Phoenix+hbase与protobuf 3.x冲突问题解决（仅供学习交流使用）

        在使用Phoenix访问hbase的过程中Phoenix和hbase客户端相关jar包都涉及到使用protobuf-java，但是Phoenix、hbase只能使用低版本的protobuf-java，如2.x版本，当工程中需要使用更高版本的protobuf-java，如3.x版本时，由于高版本存在代码结构的变动，导致hbase相关功能执行失败，如出现如下报错：

Caused by: java.sql.SQLException: java.lang.NoClassDefFoundError: Could not initialize class org.apache.hadoop.hbase.util.ByteStringer
	at org.apache.phoenix.query.ConnectionQueryServicesImpl.metaDataCoprocessorExec(ConnectionQueryServicesImpl.java:1797) ~[phoenix-core-5.1.2.jar:5.1.2]
	at org.apache.phoenix.query.ConnectionQueryServicesImpl.metaDataCoprocessorExec(ConnectionQueryServicesImpl.java:1758) ~[phoenix-core-5.1.2.jar:5.1.2]
	at org.apache.phoenix.query.ConnectionQueryServicesImpl.createTable(ConnectionQueryServicesImpl.java:1973) ~[phoenix-core-5.1.2.jar:5.1.2]
	at org.apache.phoenix.schema.MetaDataClient.createTableInternal(MetaDataClient.java:3074) ~[phoenix-core-5.1.2.jar:5.1.2]
	at org.apache.phoenix.schema.MetaDataClient.createTable(MetaDataClient.java:1105) ~[phoenix-core-5.1.2.jar:5.1.2]
	at org.apache.phoenix.compile.CreateTableCompiler$CreateTableMutationPlan.execute(CreateTableCompiler.java:420) ~[phoenix-core-5.1.2.jar:5.1.2]
	at org.apache.phoenix.jdbc.PhoenixStatement$2.call(PhoenixStatement.java:441) ~[phoenix-core-5.1.2.jar:5.1.2]
	at org.apache.phoenix.jdbc.PhoenixStatement$2.call(PhoenixStatement.java:423) ~[phoenix-core-5.1.2.jar:5.1.2]
	at org.apache.phoenix.call.CallRunner.run(CallRunner.java:53) ~[phoenix-core-5.1.2.jar:5.1.2]
	at org.apache.phoenix.jdbc.PhoenixStatement.executeMutation(PhoenixStatement.java:422) ~[phoenix-core-5.1.2.jar:5.1.2]
	at org.apache.phoenix.jdbc.PhoenixStatement.executeMutation(PhoenixStatement.java:410) ~[phoenix-core-5.1.2.jar:5.1.2]
	at org.apache.phoenix.jdbc.PhoenixStatement.executeUpdate(PhoenixStatement.java:1967) ~[phoenix-core-5.1.2.jar:5.1.2]
	at org.apache.phoenix.query.ConnectionQueryServicesImpl$12.call(ConnectionQueryServicesImpl.java:3267) ~[phoenix-core-5.1.2.jar:5.1.2]
	at org.apache.phoenix.query.ConnectionQueryServicesImpl$12.call(ConnectionQueryServicesImpl.java:3230) ~[phoenix-core-5.1.2.jar:5.1.2]
	at org.apache.phoenix.util.PhoenixContextExecutor.call(PhoenixContextExecutor.java:76) ~[phoenix-core-5.1.2.jar:5.1.2]
	at org.apache.phoenix.query.ConnectionQueryServicesImpl.init(ConnectionQueryServicesImpl.java:3230) ~[phoenix-core-5.1.2.jar:5.1.2]
	at org.apache.phoenix.jdbc.PhoenixDriver.getConnectionQueryServices(PhoenixDriver.java:255) ~[phoenix-core-5.1.2.jar:5.1.2]
	at org.apache.phoenix.jdbc.PhoenixEmbeddedDriver.createConnection(PhoenixEmbeddedDriver.java:144) ~[phoenix-core-5.1.2.jar:5.1.2]
	at org.apache.phoenix.jdbc.PhoenixDriver.connect(PhoenixDriver.java:221) ~[phoenix-core-5.1.2.jar:5.1.2]
	at java.sql.DriverManager.getConnection(DriverManager.java:664) ~[?:1.8.0_151]
	at java.sql.DriverManager.getConnection(DriverManager.java:208) ~[?:1.8.0_151]
	... 111 more
Caused by: java.lang.NoClassDefFoundError: Could not initialize class org.apache.hadoop.hbase.util.ByteStringer
	at org.apache.hadoop.hbase.protobuf.ProtobufUtil.getMutationBuilderAndSetCommonFields(ProtobufUtil.java:1168) ~[hbase-client-2.4.14.jar:2.4.14]
	at org.apache.hadoop.hbase.protobuf.ProtobufUtil.toMutation(ProtobufUtil.java:1091) ~[hbase-client-2.4.14.jar:2.4.14]
	at org.apache.hadoop.hbase.protobuf.ProtobufUtil.toMutation(ProtobufUtil.java:1081) ~[hbase-client-2.4.14.jar:2.4.14]
	at org.apache.hadoop.hbase.protobuf.ProtobufUtil.toMutation(ProtobufUtil.java:1073) ~[hbase-client-2.4.14.jar:2.4.14]
	at org.apache.phoenix.protobuf.ProtobufUtil.toProto(ProtobufUtil.java:147) ~[phoenix-core-5.1.2.jar:5.1.2]
	at org.apache.phoenix.query.ConnectionQueryServicesImpl$6.call(ConnectionQueryServicesImpl.java:1982) ~[phoenix-core-5.1.2.jar:5.1.2]
	at org.apache.phoenix.query.ConnectionQueryServicesImpl$6.call(ConnectionQueryServicesImpl.java:1974) ~[phoenix-core-5.1.2.jar:5.1.2]
	at org.apache.hadoop.hbase.client.HTable$11.call(HTable.java:1003) ~[hbase-client-2.4.14.jar:2.4.14]
	at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[?:1.8.0_151]
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_151]
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_151]
	... 1 more

报错原因是protobuf-java不同版本的代码变动：

这类问题可以使用maven插件maven-shade-plugin来解决，该插件主要有两个功能：

1、打包依赖，将工程中的所有依赖打包到一个jar包中；

2、重命名package路径。

借助第二个功能，可以在打包时将所有使用protobuf-java功能的类，把原来引入的com.google.protobuf包路径修改为一个新的路径，如：com.google.shaded.protobuf，同时，将protobuf-java所有类打到项目包中的com.google.shaded.protobuf包路径下。

借此就可以考虑重新编译打包phoenix代码（主要是phoenix-core），将phoenix、hbase以及重新命名包路径的protobuf-java都打到phoenix-core包中，同时该包中所有使用protobuf-java功能的类都会使用新的包路径。

配置方法：

这里以phoenix 5.1.2版本为例，修改phoenix源码中phoenix-core模块的pom.xml，在其中增加以下构建插件：

      <plugin>
        <groupId>org.apache.maven.plugins</groupId>
        <artifactId>maven-shade-plugin</artifactId>
        <version>3.2.4</version>
        <executions>
          <execution>
            <phase>package</phase>
            <goals>
              <goal>shade</goal>
            </goals>
            <configuration>
              <artifactSet>
                <excludes>
                  <exclude>org.apache.hadoop:hadoop-common</exclude>
                  <exclude>org.apache.hadoop:hadoop-annotations</exclude>
                  <exclude>org.checkerframework:checker-qual</exclude>
                  <exclude>com.google.j2objc:j2objc-annotations</exclude>
                  <exclude>org.codehaus.mojo:animal-sniffer-annotations</exclude>
                  <exclude>commons-cli:commons-cli</exclude>
                  <exclude>org.apache.httpcomponents:httpclient</exclude>
                  <exclude>org.apache.httpcomponents:httpcore</exclude>
                  <exclude>commons-net:commons-net</exclude>
                  <exclude>javax.servlet:javax.servlet-api</exclude>
                  <exclude>org.eclipse.jetty:jetty-server</exclude>
                  <exclude>org.eclipse.jetty:jetty-http</exclude>
                  <exclude>org.eclipse.jetty:jetty-io</exclude>
                  <exclude>org.eclipse.jetty:jetty-util</exclude>
                  <exclude>org.eclipse.jetty:jetty-servlet</exclude>
                  <exclude>org.eclipse.jetty:jetty-security</exclude>
                  <exclude>org.eclipse.jetty:jetty-webapp</exclude>
                  <exclude>org.eclipse.jetty:jetty-xml</exclude>
                  <exclude>javax.servlet.jsp:jsp-api</exclude>
                  <exclude>com.sun.jersey:jersey-core</exclude>
                  <exclude>javax.ws.rs:jsr311-api</exclude>
                  <exclude>com.sun.jersey:jersey-servlet</exclude>
                  <exclude>com.sun.jersey:jersey-json</exclude>
                  <exclude>org.codehaus.jettison:jettison</exclude>
                  <exclude>com.sun.xml.bind:jaxb-impl</exclude>
                  <exclude>org.codehaus.jackson:jackson-core-asl</exclude>
                  <exclude>org.codehaus.jackson:jackson-mapper-asl</exclude>
                  <exclude>org.codehaus.jackson:jackson-jaxrs</exclude>
                  <exclude>org.codehaus.jackson:jackson-xc</exclude>
                  <exclude>com.sun.jersey:jersey-server</exclude>
                  <exclude>org.apache.avro:avro</exclude>
                  <exclude>com.thoughtworks.paranamer:paranamer</exclude>
                  <exclude>org.xerial.snappy:snappy-java</exclude>
                  <exclude>com.google.re2j:re2j</exclude>
                  <exclude>com.google.code.gson:gson</exclude>
                  <exclude>com.jcraft:jsch</exclude>
                  <exclude>org.apache.kerby:kerb-simplekdc</exclude>
                  <exclude>org.apache.kerby:kerb-client</exclude>
                  <exclude>org.apache.kerby:kerby-config</exclude>
                  <exclude>org.apache.kerby:kerb-core</exclude>
                  <exclude>org.apache.kerby:kerby-pkix</exclude>
                  <exclude>org.apache.kerby:kerby-asn1</exclude>
                  <exclude>org.apache.kerby:kerby-util</exclude>
                  <exclude>org.apache.kerby:kerb-common</exclude>
                  <exclude>org.apache.kerby:kerb-crypto</exclude>
                  <exclude>org.apache.kerby:kerb-util</exclude>
                  <exclude>org.apache.kerby:token-provider</exclude>
                  <exclude>org.apache.kerby:kerb-admin</exclude>
                  <exclude>org.apache.kerby:kerb-server</exclude>
                  <exclude>org.apache.kerby:kerb-identity</exclude>
                  <exclude>org.apache.kerby:kerby-xdr</exclude>
                  <exclude>org.codehaus.woodstox:stax2-api</exclude>
                  <exclude>com.fasterxml.woodstox:woodstox-core</exclude>
                  <exclude>org.apache.hadoop:hadoop-auth</exclude>
                  <exclude>com.nimbusds:nimbus-jose-jwt</exclude>
                  <exclude>org.apache.hadoop:hadoop-yarn-api</exclude>
                  <exclude>javax.xml.bind:jaxb-api</exclude>
                  <exclude>org.apache.hadoop:hadoop-mapreduce-client-core</exclude>
                  <exclude>org.apache.hadoop:hadoop-yarn-client</exclude>
                  <exclude>org.apache.hadoop:hadoop-yarn-common</exclude>
                  <exclude>com.sun.jersey:jersey-client</exclude>
                  <exclude>com.sun.jersey.contribs:jersey-guice</exclude>
                  <exclude>com.fasterxml.jackson.module:jackson-module-jaxb-annotations</exclude>
                  <exclude>com.fasterxml.jackson.jaxrs:jackson-jaxrs-json-provider</exclude>
                  <exclude>com.fasterxml.jackson.jaxrs:jackson-jaxrs-base</exclude>
                  <exclude>com.google.inject.extensions:guice-servlet</exclude>
                  <exclude>org.apache.hadoop:hadoop-hdfs-client</exclude>
                  <exclude>com.squareup.okhttp:okhttp</exclude>
                  <exclude>com.squareup.okio:okio</exclude>
                  <exclude>org.eclipse.jetty:jetty-util-ajax</exclude>
                  <exclude>commons-daemon:commons-daemon</exclude>
                  <exclude>org.fusesource.leveldbjni:leveldbjni-all</exclude>
                  <exclude>org.apache.htrace:htrace-core4</exclude>
                  <exclude>org.apache.yetus:audience-annotations</exclude>
                  <exclude>io.dropwizard.metrics:metrics-core</exclude>
                  <exclude>org.apache.hadoop:hadoop-hdfs</exclude>
                  <exclude>jakarta.ws.rs:jakarta.ws.rs-api</exclude>
                  <exclude>jakarta.annotation:jakarta.annotation-api</exclude>
                  <exclude>jakarta.validation:jakarta.validation-api</exclude>
                  <exclude>org.glassfish.hk2.external:jakarta.inject</exclude>
                  <exclude>org.javassist:javassist</exclude>
                  <exclude>javax.ws.rs:javax.ws.rs-api</exclude>
                  <exclude>org.glassfish.web:javax.servlet.jsp</exclude>
                  <exclude>org.glassfish:javax.el</exclude>
                  <exclude>javax.servlet.jsp:javax.servlet.jsp-api</exclude>
                  <exclude>com.github.ben-manes.caffeine:caffeine</exclude>
                  <exclude>org.jamon:jamon-runtime</exclude>
                  <exclude>org.apache.hadoop:hadoop-distcp</exclude>
                  <exclude>javax.activation:javax.activation-api</exclude>
                  <exclude>com.google.errorprone:error_prone_annotations</exclude>
                  <exclude>org.apache.hadoop:hadoop-client</exclude>
                  <exclude>com.beust:jcommander</exclude>
                  <exclude>org.antlr:antlr-runtime</exclude>
                  <exclude>com.google.inject:guice</exclude>
                  <exclude>javax.inject:javax.inject</exclude>
                  <exclude>aopalliance:aopalliance</exclude>
                  <exclude>joda-time:joda-time</exclude>
                  <exclude>com.github.stephenc.findbugs:findbugs-annotations</exclude>
                  <exclude>com.github.stephenc.jcip:jcip-annotations</exclude>
                  <exclude>org.iq80.snappy:snappy</exclude>
                  <exclude>com.fasterxml.jackson.core:jackson-core</exclude>
                  <exclude>com.fasterxml.jackson.core:jackson-databind</exclude>
                  <exclude>com.fasterxml.jackson.core:jackson-annotations</exclude>
                  <exclude>org.apache.htrace:htrace-core</exclude>
                  <exclude>commons-codec:commons-codec</exclude>
                  <exclude>commons-io:commons-io</exclude>
                  <exclude>com.clearspring.analytics:stream</exclude>
                  <exclude>it.unimi.dsi:fastutil</exclude>
                  <exclude>com.salesforce.i18n:i18n-util</exclude>
                  <exclude>com.ibm.icu:icu4j</exclude>
                  <exclude>com.ibm.icu:icu4j-localespi</exclude>
                  <exclude>com.ibm.icu:icu4j-charset</exclude>
                  <exclude>org.apache.thrift:libthrift</exclude>
                  <exclude>org.jruby.joni:joni</exclude>
                  <exclude>org.jruby.jcodings:jcodings</exclude>
                  <exclude>org.apache.tephra:tephra-api</exclude>
                  <exclude>org.apache.tephra:tephra-core-shaded</exclude>
                  <exclude>com.google.inject.extensions:guice-assistedinject</exclude>
                  <exclude>org.ow2.asm:asm-all</exclude>
                  <exclude>org.apache.omid:*</exclude>
                  <exclude>org.yaml:*</exclude>
                  <exclude>org.yaml.snakeyaml:*</exclude>
                  <exclude>com.codahale.metrics:*</exclude>
                  <exclude>commons-beanutils:*</exclude>
                  <exclude>commons-collections:*</exclude>
                  <exclude>commons-configuration:*</exclude>
                  <exclude>commons-lang:*</exclude>
                  <exclude>commons-logging:*</exclude>
                  <exclude>com.lmax:*</exclude>
                  <exclude>org.jboss.netty:*</exclude>
                  <exclude>org.apache.curator:*</exclude>
                  <exclude>org.apache.zookeeper:*</exclude>
                  <exclude>org.jline:*</exclude>
                  <exclude>io.netty:*</exclude>
                  <exclude>com.google.guava:*</exclude>
                  <exclude>org.apache.phoenix.thirdparty:phoenix-shaded-guava</exclude>
                  <exclude>com.google.code.findbugs:*</exclude>
                  <exclude>org.apache.commons:*</exclude>
                  <exclude>org.slf4j:*</exclude>
                  <exclude>jline:*</exclude>
                  <exclude>junit:junit</exclude>
                  <exclude>jmock:*</exclude>
                  <exclude>*:xml-apis</exclude>
                  <exclude>org.apache.maven:lib:tests</exclude>
                  <exclude>log4j:log4j:jar:</exclude>
                </excludes>
              </artifactSet>

              <filters>
<!--                <filter>-->
<!--                  <artifact>org.yaml:snakeyaml</artifact>-->
<!--                  <excludes>-->
<!--                    <exclude>**/*.class</exclude> &lt;!&ndash; 排除所有类 &ndash;&gt;-->
<!--                  </excludes>-->
<!--                </filter>-->
                <filter>
                  <artifact>*:*</artifact>
                  <excludes>
                    <exclude>META-INF/*.SF</exclude>
                    <exclude>META-INF/*.DSA</exclude>
                    <exclude>META-INF/*.RSA</exclude>
                  </excludes>
                </filter>
              </filters>
              <relocations>
                <relocation>
                  <pattern>com.google.protobuf</pattern>
                  <shadedPattern>com.google.shaded.protobuf</shadedPattern>
                </relocation>
              </relocations>
            </configuration>
          </execution>
        </executions>
      </plugin>

关键是其中的relocation配置：

<relocation>
    <pattern>com.google.protobuf</pattern>
    <shadedPattern>com.google.shaded.protobuf</shadedPattern>
</relocation>

这里会将pattern指定的包路径修改为shadedPattern指定的路径。

其次是可以做一些排除依赖包的操作，如上所示的exclude配置项，这样可以在输出包中只包含想要的依赖。