- 博客(4)
- 收藏
- 关注
RSS订阅原创 Spark Shuffle过程报错org.apache.spark.shuffle.MetadataFetchFailedException
具体错误提示：Most recent failure reason: **org.apache.spark.shuffle.MetadataFetchFailedException: Missing an output location for shuffle 18** at org.apache.spark.MapOutputTracker$$anonfun$convertMapStatuses$2.apply(MapOutputTracker.scala:882) at org.apache.spar
2021-08-27 09:52:02
893
原创 airflow schedule start time
start_date = datetime(2019, 02, 11)default_args = {‘owner’: ‘xxx’,‘start_date’: start_date,}dag = DAG(dag_id=‘Loreal_Load’,default_args=default_args,schedule_interval=‘0 3 * * *’)The importan...
2019-02-12 16:43:42
809
原创 linux后台执行命令，以确保终端断掉程序不会断。
nohup command &exitThen the terminal will close.If you want to find this process and kill it due to some emergency, try "ps -aux|grep part_of_your_command " to find the PID, then “kill -9 PID” ...
2019-01-23 18:46:09
1595
原创 Linux里，shell脚本连接sftp
from subprocess import calldef main():cmd5 = “”“sftp -oIdentityfile=…openssh targetAddress <<EOTput filenameexitEOT”""call(cmd5,shell=True)if name == ‘main’:main()注意：EOT： end of text。...
2019-01-17 13:44:58
8321
空空如也
空空如也
TA创建的收藏夹 TA关注的收藏夹
TA关注的人