python -- map / lambda usage

  • 参考代码的时候遇到 map() & lambda 的结合 感觉有点困惑 特此记录下来问题
            testPredict = y_test_predicted.reshape(4, )
            #If x>1.0 --> x=1.0; If x<0.0 --> x=0.0
            testPredict = map(lambda x: np.where(x > 1.0, 1.0, np.where(x >= 0.0, x, 0.0)), testPredict)
            predictData.append(testPredict)
            np.savetxt(predictData_filename, predictData, delimiter=',')

1. map()

  • map(fun,[arg]+)函数最少有两个参数,第一参数为一个函数名,第二个参数是对应的这个函数的参数(一般为一个或多个list)。
>>> s = [1,2,3]
>>> def fun(x):
...   return x + 1
...
>>> list(map(fun,s))
[2, 3, 4]
  • 多参数问题
>>> def fun(x,y,z):
...   return x*y*z
...
>>> list(map(fun,s,s,s))
[1, 8, 27]

lambda:func

  • 类似于一种匿名函数,通常是在需要一个函数,但是又不想费神去命名一个函数的场合下使用。
>>> s = [1,2,3]
>>> map(lambda x:x+1,s)
[2, 3, 4]
>>> list(map(lambda x:x+1 , s))
[2, 3, 4]
  • 0
    点赞
  • 0
    收藏
    觉得还不错? 一键收藏
  • 0
    评论
org.apache.spark.api.python.PythonException: Traceback (most recent call last): File "/Users/zzs/PycharmProjects/pythonProject/venv/lib/python3.10/site-packages/pyspark/python/lib/pyspark.zip/pyspark/worker.py", line 830, in main process() File "/Users/zzs/PycharmProjects/pythonProject/venv/lib/python3.10/site-packages/pyspark/python/lib/pyspark.zip/pyspark/worker.py", line 820, in process out_iter = func(split_index, iterator) File "/Users/zzs/PycharmProjects/pythonProject/venv/lib/python3.10/site-packages/pyspark/rdd.py", line 5405, in pipeline_func return func(split, prev_func(split, iterator)) File "/Users/zzs/PycharmProjects/pythonProject/venv/lib/python3.10/site-packages/pyspark/rdd.py", line 5405, in pipeline_func return func(split, prev_func(split, iterator)) File "/Users/zzs/PycharmProjects/pythonProject/venv/lib/python3.10/site-packages/pyspark/rdd.py", line 828, in func return f(iterator) File "/Users/zzs/PycharmProjects/pythonProject/venv/lib/python3.10/site-packages/pyspark/rdd.py", line 3964, in combineLocally merger.mergeValues(iterator) File "/Users/zzs/PycharmProjects/pythonProject/venv/lib/python3.10/site-packages/pyspark/python/lib/pyspark.zip/pyspark/shuffle.py", line 256, in mergeValues for k, v in iterator: File "/Users/zzs/PycharmProjects/pythonProject/venv/lib/python3.10/site-packages/pyspark/python/lib/pyspark.zip/pyspark/util.py", line 81, in wrapper return f(*args, **kwargs) File "/Users/zzs/PycharmProjects/pythonProject/pyspark项目练习/项目练习2.py", line 7, in <lambda> json_str_file = file_rdd.flatMap(lambda x: x.spilt("|")) AttributeError: 'str' object has no attribute 'spilt' at org.apache.spark.api.python.BasePythonRunner$ReaderIterator.handlePythonException(PythonRunner.scala:561) at org.apache.spark.api.python.PythonRunner$$anon$3.read(PythonRunner.scala:767) at org.apache.spark.api.python.PythonRunner$$anon$3.read(PythonRunner.scala:749) at org.apache.spark.api.python.BasePythonRun
07-20

“相关推荐”对你有帮助么?

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值