Fayson的github: https://github.com/fayson/cdhproject
推荐关注微信公众号:“Hadoop实操”,ID:gh_c4c535955d0f
1 异常重现
1.在Hive中准备一张表,一共5个字段,采用文本存储。
2.准备数据并导入到该Hive表中,注意我们准备的数据第四个字段即s4的值特别长,约有5000多个字符。
2018-12-11 14:53:41|0401b8658016b33d9b4d1971e8cd22d2|CCD.MRRISK-COMMON_PAY.pay|"{""positionProperty"":{""altitude"":"""",""latitude"":"""",""province"":""上海"",""country"":""中国"",""longitude"":"""",""city"":""上海""},""deviceExtProperty"":{""appVersion"":""6.0.8"",""isRoot"":""false"",""appName"":""com.cmbchina.ccd.pluto.cmbActivity.debug"",""channel"":""unknown"",""isVirtual"":""false""},""deviceBasicProperty"":{""cpuSerial"":""0000000000000000"",""fingerprint"":""vivo/PD1603/PD1603:5.1.1/LMY47V/compiler10071102:user/release-keys"",""brand"":""vivo"",""widthPixels"":""1080"",""osVersion"":""5.1.1"",""heightPixels"":""1920"",""manufacturer"":""vivo"",""cpuABI"":""armeabi-v7a"",""density"":""3.0"",""os"":""android"",""model"":""vivo X7Plus""},""hotSpotProperty"":{""ssid"":""\""CMB-CCD\"""",""bssid"":""00:35:1a:2b:d1:de""},""message"":{""pushProvider"":""getui"",""deviceToken"":""7fe0b44a5b3fc8a31149b33700801f1a""},""networkProperty"":{""clientIP"":""99.48.192.10"",""networkType"":""4""},""deviceUniq