Invalid BSON field name xx 问题解决

最新推荐文章于 2023-05-10 17:34:15 发布

功夫猫熊yeah

最新推荐文章于 2023-05-10 17:34:15 发布

阅读量6.2k

点赞数 5

分类专栏：大数据

本文链接：https://blog.csdn.net/weixin_39031707/article/details/103622135

版权

大数据专栏收录该内容

16 篇文章 0 订阅

订阅专栏

先贴一段报错 java.lang.IllegalArgumentException: Invalid BSON field name creaImpcntat org.bson.AbstractBsonWriter.writeName(AbstractBsonWriter.java:494)at org.bson.codecs.DocumentCodec.writeMap(DocumentCodec.java:188)at org.bson.codecs.DocumentCodec.encode(DocumentCodec.java:131)at org.bson.codecs.DocumentCodec.encode(DocumentCodec.java:45)at org.bson.codecs.BsonDocumentWrapperCodec.encode(BsonDocumentWrapperCodec.java:63)at org.bson.codecs.BsonDocumentWrapperCodec.encode(BsonDocumentWrapperCodec.java:29)at com.mongodb.connection.UpdateCommandMessage.writeTheWrites(UpdateCommandMessage.java:84)at com.mongodb.connection.UpdateCommandMessage.writeTheWrites(UpdateCommandMessage.java:42)at com.mongodb.connection.BaseWriteCommandMessage.encodeMessageBodyWithMetadata(BaseWriteCommandMessage.java:129)at com.mongodb.connection.RequestMessage.encodeWithMetadata(RequestMessage.java:160)at com.mongodb.connection.WriteCommandProtocol.sendMessage(WriteCommandProtocol.java:212)at com.mongodb.connection.WriteCommandProtocol.execute(WriteCommandProtocol.java:101)at com.mongodb.connection.UpdateCommandProtocol.execute(UpdateCommandProtocol.java:64)at com.mongodb.connection.UpdateCommandProtocol.execute(UpdateCommandProtocol.java:37)at com.mongodb.connection.DefaultServer $D e f a u l t S e r v e r P r o t o c o l E x e c u t o r . e x e c u t e (D e f a u l t S e r v e r . j a v a : 159) a t c o m . m o n g o d b . c o n n e c t i o n . D e f a u l t S e r v e r C o n n e c t i o n . e x e c u t e P r o t o c o l (D e f a u l t S e r v e r C o n n e c t i o n . j a v a : 286) a t c o m . m o n g o d b . c o n n e c t i o n . D e f a u l t S e r v e r C o n n e c t i o n . u p d a t e C o m m a n d (D e f a u l t S e r v e r C o n n e c t i o n . j a v a : 140) a t c o m . m o n g o d b . o p e r a t i o n . M i x e d B u l k W r i t e O p e r a t i o n$ Run $3 . e x e c u t e W r i t e C o m m a n d P r o t o c o l (M i x e d B u l k W r i t e O p e r a t i o n . j a v a : 480) a t c o m . m o n g o d b . o p e r a t i o n . M i x e d B u l k W r i t e O p e r a t i o n$ Run $R u n E x e c u t o r . e x e c u t e (M i x e d B u l k W r i t e O p e r a t i o n . j a v a : 646) a t c o m . m o n g o d b . o p e r a t i o n . M i x e d B u l k W r i t e O p e r a t i o n$ Run.execute(MixedBulkWriteOperation.java:399)at com.mongodb.operation.MixedBulkWriteOperation$1.call(MixedBulkWriteOperation.java:179)at com.mongodb.operation.MixedBulkWriteOperation$1.call(MixedBulkWriteOperation.java:168)at com.mongodb.operation.OperationHelper.withConnectionSource(OperationHelper.java:230)at com.mongodb.operation.OperationHelper.withConnection(OperationHelper.java:221)at com.mongodb.operation.MixedBulkWriteOperation.execute(MixedBulkWriteOperation.java:168)at com.mongodb.operation.MixedBulkWriteOperation.execute(MixedBulkWriteOperation.java:74)at com.mongodb.Mongo.execute(Mongo.java:781)at com.mongodb.Mongo $2.execute(Mongo.java:764)at com.mongodb.MongoCollectionImpl.executeSingleWriteRequest(MongoCollectionImpl.java:515)at com.mongodb.MongoCollectionImpl.update(MongoCollectionImpl.java:508)at com.mongodb.MongoCollectionImpl.updateOne(MongoCollectionImpl.java:355)at com.mongodb.MongoCollectionImpl.updateOne(MongoCollectionImpl.java:350)at com.yeahmobi.bigdata.analysis.dsp.dw.GateWayWinAndImpressStatics_Ali$ $a n o n f u n$ writeToMongo $1$ $a n o n f u n$ apply $1.apply(GateWayWinAndImpressStatics_Ali.scala:301)at com.yeahmobi.bigdata.analysis.dsp.dw.GateWayWinAndImpressStatics_Ali$ $a n o n f u n$ writeToMongo $1$ $a n o n f u n$ apply $1.apply(GateWayWinAndImpressStatics_Ali.scala:301)at com.mongodb.spark.MongoConnector$ $a n o n f u n$ withCollectionDo $1 . a p p l y (M o n g o C o n n e c t o r . s c a l a : 186) a t c o m . m o n g o d b . s p a r k . M o n g o C o n n e c t o r$ $a n o n f u n$ withCollectionDo $1 . a p p l y (M o n g o C o n n e c t o r . s c a l a : 184) a t c o m . m o n g o d b . s p a r k . M o n g o C o n n e c t o r$ $a n o n f u n$ withDatabaseDo $1 . a p p l y (M o n g o C o n n e c t o r . s c a l a : 171) a t c o m . m o n g o d b . s p a r k . M o n g o C o n n e c t o r$ $a n o n f u n$ withDatabaseDo $1.apply(MongoConnector.scala:171)at com.mongodb.spark.MongoConnector.withMongoClientDo(MongoConnector.scala:154)at com.mongodb.spark.MongoConnector.withDatabaseDo(MongoConnector.scala:171)at com.mongodb.spark.MongoConnector.withCollectionDo(MongoConnector.scala:184)at com.yeahmobi.bigdata.analysis.dsp.dw.GateWayWinAndImpressStatics_Ali$ $a n o n f u n$ writeToMongo $1.apply(GateWayWinAndImpressStatics_Ali.scala:300)at com.yeahmobi.bigdata.analysis.dsp.dw.GateWayWinAndImpressStatics_Ali$ $a n o n f u n$ writeToMongo$1.apply(GateWayWinAndImpressStatics_Ali.scala:279)

造成这个原因是用mongoClinet updateone时候没有加$set
代码如下:

val dateFormat=new SimpleDateFormat("yyyyMMdd")
val ttlTime: Date = dateFormat.parse(updateDate)
  finalDf.rdd.repartition(100).foreach(itm => {
  var bsons = new util.ArrayList[Bson]()

bsons.add(Filters.eq("app",itm(0)))
bsons.add(Filters.eq("day",itm(1)))
bsons.add(Filters.eq("hour",itm(2)))
bsons.add(Filters.eq("adx",itm(3)))
bsons.add(Filters.eq("os",itm(4)))
bsons.add(Filters.eq("osv",itm(5)))
bsons.add(Filters.eq("impType",itm(6)))
bsons.add(Filters.eq("country",itm(7)))
bsons.add(Filters.eq("updateDate",updateDate))

 val InsertOne = new Document("app", itm(0)).append("day", itm(1)).append("hour", itm(2)).append("adx", itm(3))
  .append("os", itm(4)).append("osv", itm(5)).append("impType",itm(6)).append("country", itm(7)).append("ttlTime",ttlTime)
 mongoConn.withCollectionDo(new WriteConfig(databaseName,
  ResultCol, Option(MongoConn)), { col: MongoCollection[Document] => col.updateOne(Filters.and(bsons),InsertOne) })

错误主要在:

 mongoConn.withCollectionDo(new WriteConfig(databaseName,
  ResultCol, Option(MongoConn)), { col: MongoCollection[Document] => col.updateOne(Filters.and(bsons),InsertOne) })

修改后给InsertOne加上$set修改后的代码为

mongoConn.withCollectionDo(new WriteConfig(databaseName,
 ResultCol, Option(MongoConn)), { col: MongoCollection[Document] => col.updateOne(Filters.and(bsons),new Document("$set",updateOne),new UpdateOptions().upsert(true)) })

错误解决!

功夫猫熊yeah

关注

5
点赞
踩
0

收藏

觉得还不错? 一键收藏
2
评论
Invalid BSON field name xx 问题解决

先贴一段报错 java.lang.IllegalArgumentException: Invalid BSON field name creaImpcntat org.bson.AbstractBsonWriter.writeName(AbstractBsonWriter.java:494)at org.bson.codecs.DocumentCodec.writeMap(DocumentCode...
复制链接

扫一扫