nutch linux虚拟机,我如何在Linux内核上运行nutch?

我想在

linux内核上运行nutch,我已经以root用户身份运行了,

我已经设置了所有环境变量和nutch文件设置.

我创建了一个url.txt文件,其中包含要抓取的网址,

当我试图使用以下命令运行nutch时,bin/nutch crawl urls -dir pra

它会产生以下异常.

crawl started in: pra

rootUrlDir = urls

threads = 10

depth = 5

Injector: starting

Injector: crawlDb: pra/crawldb

Injector: urlDir: urls

Injector: Converting injected urls to crawl db entries.

Exception in thread "main" java.io.IOException: Failed to get the current user's information.

at org.apache.hadoop.mapred.JobClient.getUGI(JobClient.java:717)

at org.apache.hadoop.mapred.JobClient.configureCommandLineOptions(JobClient.java:592)

at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:788)

at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1142)

at org.apache.nutch.crawl.Injector.inject(Injector.java:160)

at org.apache.nutch.crawl.Crawl.main(Crawl.java:113)

Caused by: javax.security.auth.login.LoginException: Login Failed: Cannot run program "whoami": java.io.IOException: error=12,Cannot allocate memory

at org.apache.hadoop.security.UnixUserGroupInformation.login(UnixUserGroupInformation.java:250)

at org.apache.hadoop.security.UnixUserGroupInformation.login(UnixUserGroupInformation.java:275)

at org.apache.hadoop.mapred.JobClient.getUGI(JobClient.java:715)

... 5 more

服务器有足够的空间来运行任何java应用程序.我附加了静态..

total used free

Mem: 524320 194632 329688

-/+ buffers/cache: 194632 329688

Swap: 2475680 0 2475680

Total: 3000000 194632 2805368

是否有足够的存储空间用于nutch?

请有人帮助我,我是linux内核和nutch的新手.

提前致谢.

  • 0
    点赞
  • 0
    收藏
    觉得还不错? 一键收藏
  • 0
    评论
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值