【Nutch基础教程之七】Nutch的2种运行模式：local及deploy

最新推荐文章于 2024-04-30 09:53:39 发布
最新推荐文章于 2024-04-30 09:53:39 发布
阅读量172 收藏 1
点赞数
文章标签： 大数据 java runtime
原文链接：http://www.cnblogs.com/eaglegeek/p/4557845.html
版权

在对nutch源代码运行ant runtime后，会创建一个runtime的目录，在runtime目录下有deploy和local 2个目录。

[jediael@jediael runtime]$ ls

deploy  local

这2个目录分别代表nutch的2种运行方式：部署模式及本地模式。



1、nutch.sh中关于2种运行方式的执行

if $local; then
 # fix for the external Xerces lib issue with SAXParserFactory
 NUTCH_OPTS="-Djavax.xml.parsers.DocumentBuilderFactory=com.sun.org.apache.xerces.internal.jaxp.DocumentBuilderFactoryImpl $NUTCH_OPTS"
 EXEC_CALL="$JAVA $JAVA_HEAP_MAX $NUTCH_OPTS -classpath $CLASSPATH"
else
 # check that hadoop can be found on the path
 if [ $(which hadoop | wc -l ) -eq 0 ]; then
    echo "Can't find Hadoop executable. Add HADOOP_HOME/bin to the path or run in local mode."
    exit -1;
 fi
 # distributed mode
 EXEC_CALL="hadoop jar $NUTCH_JOB"
fi

# run it
exec $EXEC_CALL $CLASS "$@“

2、在deploy目录下执行命令即为deploy模式，local目录下执行命令即为local模式。


以下以inject为例，示范2种运行模式。

一、本地模式

1、基本用法：

$ bin/nutch inject 
Usage: InjectorJob <url_dir> [-crawlId <id>]

用法一：未指定id 

liaoliuqingdeMacBook-Air:local liaoliuqing$ bin/nutch inject urls
InjectorJob: starting at 2014-12-20 22:32:01
InjectorJob: Injecting urlDir: urls
InjectorJob: Using class org.apache.gora.hbase.store.HBaseStore as the Gora storage class.
InjectorJob: total number of urls rejected by filters: 0
InjectorJob: total number of urls injected after normalization and filtering: 1

Injector: finished at 2014-12-20 22:32:15, elapsed: 00:00:14

用法二：指定id

$ bin/nutch inject urls -crawlId 2
InjectorJob: starting at 2014-12-20 22:34:01
InjectorJob: Injecting urlDir: urls
InjectorJob: Using class org.apache.gora.hbase.store.HBaseStore as the Gora storage class.
InjectorJob: total number of urls rejected by filters: 0
InjectorJob: total number of urls injected after normalization and filtering: 1

Injector: finished at 2014-12-20 22:34:15, elapsed: 00:00:14

2、数据库中的数据变化

上述命令将在hbase数据库中新建一个表，表名为${id}_webpage，若未指定id，则表名为webpage.

然后将urls目录中的文件内容写入表中，作为爬虫种子。

hbase(main):003:0> scan 'webpage'
ROW                   COLUMN+CELL                                               
 com.163.www:http/    column=f:fi, timestamp=1419085934952, value=\x00'\x8D\x00 
 com.163.www:http/    column=f:ts, timestamp=1419085934952, value=\x00\x00\x01Jh
                      \x1C\xBC7                                                 
 com.163.www:http/    column=mk:_injmrk_, timestamp=1419085934952, value=y      
 com.163.www:http/    column=mk:dist, timestamp=1419085934952, value=0          
 com.163.www:http/    column=mtdt:_csh_, timestamp=1419085934952, value=?\x80\x0
                      0\x00                                                     
 com.163.www:http/    column=s:s, timestamp=1419085934952, value=?\x80\x00\x00  
1 row(s) in 0.6140 seconds

当再次执行inject命令时，会增加新的url进入表中。


3、其它运行脚本

where COMMAND is one of:
 inject         inject new urls into the database
 hostinject     creates or updates an existing host table from a text file
 generate       generate new batches to fetch from crawl db
 fetch          fetch URLs marked during generate
 parse          parse URLs marked during fetch
 updatedb       update web table after parsing
 updatehostdb   update host table after parsing
 readdb         read/dump records from page database
 readhostdb     display entries from the hostDB
 elasticindex   run the elasticsearch indexer
 solrindex      run the solr indexer on parsed batches
 solrdedup      remove duplicates from solr
 parsechecker   check the parser for a given url
 indexchecker   check the indexing filters for a given url
 plugin         load a plugin and run one of its classes main()
 nutchserver    run a (local) Nutch server on a user defined port
 junit          runs the given JUnit test
 or
 CLASSNAME      run the class named CLASSNAME
Most commands print help when invoked w/o parameters.

可以逐步运行一个完整抓取流程中的各个步骤，形成一个整体的流程。

当使用crawl命令进行抓取任务时，其基本流程步骤如下：

（1）InjectorJob

开始第一个迭代

（2）GeneratorJob

（3）FetcherJob

（4）ParserJob

（5）DbUpdaterJob

（6）SolrIndexerJob

开始第二个迭代

（2）GeneratorJob

（3）FetcherJob

（4）ParserJob

（5）DbUpdaterJob

（6）SolrIndexerJob

开始第三个迭代

具体每个步骤的执行，请见http://blog.csdn.net/jediael_lu/article/details/38591067


4、nutch封装了一个crawl脚本，将各个关键步骤进行了封装，从而无需逐步运行抓取流程。

[jediael@jediael local]$ bin/crawl 
Missing seedDir : crawl <seedDir> <crawlID> <solrURL> <numberOfRounds>

如： 

[root@jediael44 bin]# ./crawl seed.txt TestCrawl http://localhost:8983/solr 2

二、部署模式

1、使用hadoop命令运行


注意：必须先启动hadoop及hbase。

[jediael@jediael deploy]$ hadoop jar apache-nutch-2.2.1.job org.apache.nutch.crawl.InjectorJob file:///opt/jediael/apache-nutch-2.2.1/runtime/deploy/urls/
14/12/20 23:26:50 INFO crawl.InjectorJob: InjectorJob: starting at 2014-12-20 23:26:50
14/12/20 23:26:50 INFO crawl.InjectorJob: InjectorJob: Injecting urlDir: file:/opt/jediael/apache-nutch-2.2.1/runtime/deploy/urls
14/12/20 23:26:52 INFO zookeeper.ZooKeeper: Client environment:zookeeper.version=3.3.2-1031432, built on 11/05/2010 05:32 GMT
14/12/20 23:26:52 INFO zookeeper.ZooKeeper: Client environment:host.name=jediael
14/12/20 23:26:52 INFO zookeeper.ZooKeeper: Client environment:java.version=1.7.0_51
14/12/20 23:26:52 INFO zookeeper.ZooKeeper: Client environment:java.vendor=Oracle Corporation
14/12/20 23:26:52 INFO zookeeper.ZooKeeper: Client environment:java.home=/usr/java/jdk1.7.0_51/jre
14/12/20 23:26:52 INFO zookeeper.ZooKeeper: Client environment:java.class.path=/opt/jediael/hadoop-1.2.1/libexec/../conf:/usr/java/jdk1.7.0_51/lib/tools.jar:/opt/jediael/hadoop-1.2.1/libexec/..:/opt/jediael/hadoop-1.2.1/libexec/../hadoop-core-1.2.1.jar:/opt/jediael/hadoop-1.2.1/libexec/../lib/asm-3.2.jar:/opt/jediael/hadoop-1.2.1/libexec/../lib/aspectjrt-1.6.11.jar:/opt/jediael/hadoop-1.2.1/libexec/../lib/aspectjtools-1.6.11.jar:/opt/jediael/hadoop-1.2.1/libexec/../lib/commons-beanutils-1.7.0.jar:/opt/jediael/hadoop-1.2.1/libexec/../lib/commons-beanutils-core-1.8.0.jar:/opt/jediael/hadoop-1.2.1/libexec/../lib/commons-cli-1.2.jar:/opt/jediael/hadoop-1.2.1/libexec/../lib/commons-codec-1.4.jar:/opt/jediael/hadoop-1.2.1/libexec/../lib/commons-collections-3.2.1.jar:/opt/jediael/hadoop-1.2.1/libexec/../lib/commons-configuration-1.6.jar:/opt/jediael/hadoop-1.2.1/libexec/../lib/commons-daemon-1.0.1.jar:/opt/jediael/hadoop-1.2.1/libexec/../lib/commons-digester-1.8.jar:/opt/jediael/hadoop-1.2.1/libexec/../lib/commons-el-1.0.jar:/opt/jediael/hadoop-1.2.1/libexec/../lib/commons-httpclient-3.0.1.jar:/opt/jediael/hadoop-1.2.1/libexec/../lib/commons-io-2.1.jar:/opt/jediael/hadoop-1.2.1/libexec/../lib/commons-lang-2.4.jar:/opt/jediael/hadoop-1.2.1/libexec/../lib/commons-logging-1.1.1.jar:/opt/jediael/hadoop-1.2.1/libexec/../lib/commons-logging-api-1.0.4.jar:/opt/jediael/hadoop-1.2.1/libexec/../lib/commons-math-2.1.jar:/opt/jediael/hadoop-1.2.1/libexec/../lib/commons-net-3.1.jar:/opt/jediael/hadoop-1.2.1/libexec/../lib/core-3.1.1.jar:/opt/jediael/hadoop-1.2.1/libexec/../lib/hadoop-capacity-scheduler-1.2.1.jar:/opt/jediael/hadoop-1.2.1/libexec/../lib/hadoop-fairscheduler-1.2.1.jar:/opt/jediael/hadoop-1.2.1/libexec/../lib/hadoop-thriftfs-1.2.1.jar:/opt/jediael/hadoop-1.2.1/libexec/../lib/hsqldb-1.8.0.10.jar:/opt/jediael/hadoop-1.2.1/libexec/../lib/jackson-core-asl-1.8.8.jar:/opt/jediael/hadoop-1.2.1/libexec/../lib/jackson-mapper-asl-1.8.8.jar:/opt/jediael/hadoop-1.2.1/libexec/../lib/jasper-compiler-5.5.12.jar:/opt/jediael/hadoop-1.2.1/libexec/../lib/jasper-runtime-5.5.12.jar:/opt/jediael/hadoop-1.2.1/libexec/../lib/jdeb-0.8.jar:/opt/jediael/hadoop-1.2.1/libexec/../lib/jersey-core-1.8.jar:/opt/jediael/hadoop-1.2.1/libexec/../lib/jersey-json-1.8.jar:/opt/jediael/hadoop-1.2.1/libexec/../lib/jersey-server-1.8.jar:/opt/jediael/hadoop-1.2.1/libexec/../lib/jets3t-0.6.1.jar:/opt/jediael/hadoop-1.2.1/libexec/../lib/jetty-6.1.26.jar:/opt/jediael/hadoop-1.2.1/libexec/../lib/jetty-util-6.1.26.jar:/opt/jediael/hadoop-1.2.1/libexec/../lib/jsch-0.1.42.jar:/opt/jediael/hadoop-1.2.1/libexec/../lib/junit-4.5.jar:/opt/jediael/hadoop-1.2.1/libexec/../lib/kfs-0.2.2.jar:/opt/jediael/hadoop-1.2.1/libexec/../lib/log4j-1.2.15.jar:/opt/jediael/hadoop-1.2.1/libexec/../lib/mockito-all-1.8.5.jar:/opt/jediael/hadoop-1.2.1/libexec/../lib/oro-2.0.8.jar:/opt/jediael/hadoop-1.2.1/libexec/../lib/servlet-api-2.5-20081211.jar:/opt/jediael/hadoop-1.2.1/libexec/../lib/slf4j-api-1.4.3.jar:/opt/jediael/hadoop-1.2.1/libexec/../lib/slf4j-log4j12-1.4.3.jar:/opt/jediael/hadoop-1.2.1/libexec/../lib/xmlenc-0.52.jar:/opt/jediael/hadoop-1.2.1/libexec/../lib/jsp-2.1/jsp-2.1.jar:/opt/jediael/hadoop-1.2.1/libexec/../lib/jsp-2.1/jsp-api-2.1.jar
14/12/20 23:26:52 INFO zookeeper.ZooKeeper: Client environment:java.library.path=/opt/jediael/hadoop-1.2.1/libexec/../lib/native/Linux-amd64-64
14/12/20 23:26:52 INFO zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/tmp
14/12/20 23:26:52 INFO zookeeper.ZooKeeper: Client environment:java.compiler=<NA>
14/12/20 23:26:52 INFO zookeeper.ZooKeeper: Client environment:os.name=Linux
14/12/20 23:26:52 INFO zookeeper.ZooKeeper: Client environment:os.arch=amd64
14/12/20 23:26:52 INFO zookeeper.ZooKeeper: Client environment:os.version=2.6.32-431.17.1.el6.x86_64
14/12/20 23:26:52 INFO zookeeper.ZooKeeper: Client environment:user.name=jediael
14/12/20 23:26:52 INFO zookeeper.ZooKeeper: Client environment:user.home=/home/jediael
14/12/20 23:26:52 INFO zookeeper.ZooKeeper: Client environment:user.dir=/opt/jediael/apache-nutch-2.2.1/runtime/deploy
14/12/20 23:26:52 INFO zookeeper.ZooKeeper: Initiating client connection, connectString=localhost:2181 sessionTimeout=180000 watcher=hconnection
14/12/20 23:26:52 INFO zookeeper.ClientCnxn: Opening socket connection to server localhost/127.0.0.1:2181
14/12/20 23:26:52 INFO zookeeper.ClientCnxn: Socket connection established to localhost/127.0.0.1:2181, initiating session
14/12/20 23:26:52 INFO zookeeper.ClientCnxn: Session establishment complete on server localhost/127.0.0.1:2181, sessionid = 0x14a5c24c9cf0657, negotiated timeout = 40000
14/12/20 23:26:52 INFO crawl.InjectorJob: InjectorJob: Using class org.apache.gora.hbase.store.HBaseStore as the Gora storage class.
14/12/20 23:26:55 INFO input.FileInputFormat: Total input paths to process : 1
14/12/20 23:26:55 INFO util.NativeCodeLoader: Loaded the native-hadoop library
14/12/20 23:26:55 WARN snappy.LoadSnappy: Snappy native library not loaded
14/12/20 23:26:56 INFO mapred.JobClient: Running job: job_201412202325_0002
14/12/20 23:26:57 INFO mapred.JobClient:  map 0% reduce 0%
14/12/20 23:27:15 INFO mapred.JobClient:  map 100% reduce 0%
14/12/20 23:27:17 INFO mapred.JobClient: Job complete: job_201412202325_0002
14/12/20 23:27:18 INFO mapred.JobClient: Counters: 20
14/12/20 23:27:18 INFO mapred.JobClient:   Job Counters 
14/12/20 23:27:18 INFO mapred.JobClient:     SLOTS_MILLIS_MAPS=14058
14/12/20 23:27:18 INFO mapred.JobClient:     Total time spent by all reduces waiting after reserving slots (ms)=0
14/12/20 23:27:18 INFO mapred.JobClient:     Total time spent by all maps waiting after reserving slots (ms)=0
14/12/20 23:27:18 INFO mapred.JobClient:     Rack-local map tasks=1
14/12/20 23:27:18 INFO mapred.JobClient:     Launched map tasks=1
14/12/20 23:27:18 INFO mapred.JobClient:     SLOTS_MILLIS_REDUCES=0
14/12/20 23:27:18 INFO mapred.JobClient:   File Output Format Counters 
14/12/20 23:27:18 INFO mapred.JobClient:     Bytes Written=0
14/12/20 23:27:18 INFO mapred.JobClient:   injector
14/12/20 23:27:18 INFO mapred.JobClient:     urls_injected=3
14/12/20 23:27:18 INFO mapred.JobClient:   FileSystemCounters
14/12/20 23:27:18 INFO mapred.JobClient:     FILE_BYTES_READ=149
14/12/20 23:27:18 INFO mapred.JobClient:     HDFS_BYTES_READ=130
14/12/20 23:27:18 INFO mapred.JobClient:     FILE_BYTES_WRITTEN=78488
14/12/20 23:27:18 INFO mapred.JobClient:   File Input Format Counters 
14/12/20 23:27:18 INFO mapred.JobClient:     Bytes Read=149
14/12/20 23:27:18 INFO mapred.JobClient:   Map-Reduce Framework
14/12/20 23:27:18 INFO mapred.JobClient:     Map input records=6
14/12/20 23:27:18 INFO mapred.JobClient:     Physical memory (bytes) snapshot=106311680
14/12/20 23:27:18 INFO mapred.JobClient:     Spilled Records=0
14/12/20 23:27:18 INFO mapred.JobClient:     CPU time spent (ms)=2420
14/12/20 23:27:18 INFO mapred.JobClient:     Total committed heap usage (bytes)=29753344
14/12/20 23:27:18 INFO mapred.JobClient:     Virtual memory (bytes) snapshot=736796672
14/12/20 23:27:18 INFO mapred.JobClient:     Map output records=3
14/12/20 23:27:18 INFO mapred.JobClient:     SPLIT_RAW_BYTES=130
14/12/20 23:27:18 INFO crawl.InjectorJob: InjectorJob: total number of urls rejected by filters: 0
14/12/20 23:27:18 INFO crawl.InjectorJob: InjectorJob: total number of urls injected after normalization and filtering: 3
14/12/20 23:27:18 INFO crawl.InjectorJob: Injector: finished at 2014-12-20 23:27:18, elapsed: 00:00:27


三、附带使用eclipse运行nutch的方式

此方法本质上是与部署模式一致的。


使用eclipse运行InjectorJob



eclipse输出内容：

InjectorJob: starting at 2014-12-20 23:13:24
InjectorJob: Injecting urlDir: /Users/liaoliuqing/99_Project/2.x/urls
InjectorJob: Using class org.apache.gora.hbase.store.HBaseStore as the Gora storage class.
InjectorJob: total number of urls rejected by filters: 0
InjectorJob: total number of urls injected after normalization and filtering: 1

Injector: finished at 2014-12-20 23:13:27, elapsed: 00:00:02



转载于:https://www.cnblogs.com/eaglegeek/p/4557845.html

weixin_30590285
关注
  • 0
    点赞
  • 踩
  • 1
    收藏
    觉得还不错? 一键收藏
  • 0
    评论
Nutch相关框架视频教程
07-22
资源名称：Nutch相关框架视频教程资源目录：【】Nutch相关框架视频教程1_杨尚川【】Nutch相关框架视频教程2_杨尚川【】Nutch相关框架视频教程3_杨尚川【】Nutch相关框架视频教程4_杨尚川【】Nutch相关框架视频教程5_...
Nutch 0.8笔记--Google式的搜索引擎实现
花钱的年华
08-09 8002
    作者：江南白衣    Nutch是一个基于Lucene，类似Google的完整网络搜索引擎解决方案，基于Hadoop的分布式处理模型保证了系统的性能，类似Eclipse的插件机制保证了系统的可客户化，而且很容易集成到自己的应用之中。    Nutch 0.8 完全使用Hadoop重写了骨干代码，另外很多地方作了合理化修正，非常值得升级。1.Nutch 0.8 的安装与运行n
[Nutch]Hadoop单机伪分布式模式的使用(deploy)
Kandy
05-22 4044
在上一篇博文我们对Nutch进行了hadoop的配置，那么本文就对nutch的deploy模式的使用进行说明。
Nutch源代码学习-解读Nutch-运行,爬行过程
zpvw35zpvw
01-16 135
Nutch源代码学习-解读Nutch-运行,爬行过程 2011年01月30日 　　Nutch源代码学习(5)-解读Nutch-运行,爬行过程 　　2007年04月13日 星期五 16:40 　　Nutch是一个基于Lucene，类似Google的完整网络搜索引擎解决方案，基于Hadoop的分布式处理模型保证了系统的性能，类似Eclipse的插件机制保证了系统的可客户化，而且很容易集成...
Nutch的安装与运行
困难户
12-19 126
Nutch是一个基于Lucene的搜索引擎应用. 一.准备工作 1.下载最新版的nutch-0.9(下载地址:http://lucene.apache.org/nutch/)放到d盘的d: nutch目录下 2.添加环境变量NUTCH_JAVA_HOME=jdk的安装路径 3.nutch需要在unix下跑,如果要装在windows上,需要安装cygwin(下载地址: http://ww...
Nutch相关框架视频教程（20集）
07-22
教程名称：Nutch相关框架视频教程（20集）课程目录：【】Nutch相关框架视频教程01【】Nutch相关框架视频教程02【】Nutch相关框架视频教程03【】Nutch相关框架视频教程04【】Nutch相关框架视频教程05【】Nutch相关...
Nutch入门教程 高清 带书签
09-22
Nutch入门教程 高清 带书签
Nutch相关框架视频教程 讲义 杨尚川
10-24
5、 ant构建之后，生成runtime文件夹，该文件夹下面有deploy和local文件夹，分别代表了nutch的两种运行方式。 6、 nutch和hadoop是通过什么连接起来的？通过nutch脚本。通过hadoop命令把apache-nutch-1.6.job提交给...
Nutch的local和deploy模式
gywtzh0889的专栏
01-10 467
local模式： 1.将hbase安装目录下lib 下面的所有*.jar 复制到nutch/runtime/local/lib下 2. nutch/runtime/local/下先创建urls目录mkdir urls，目录下创建seed.txt touch seed.txt, cd /usr/local/apache-nutch-2.3.1/runtime/local
编译并运行Local模式下的Nutch1.6
majian_1987的专栏
11-29 1281
环境搭建： 1.安装subversion： apt-get install subversion（如果系统里自带的是yum，需要执行yum -y install subversion）； 2.安装ant： apt-get install  ant（如果系统里自带的是yum，同理需要执行yum -y install ant）； 下载nutch1.7： 1.利用svn从服务器上ch
nutch使用
ae5555的专栏
07-03 1001
nutch 1.x (nutch 1.11为例)抓取网页存储到本地bin/crawl urls crawl 2建索引bin/nutch solrindex http://127.0.0.1:8983/solr/ crawl/crawldb -linkdb crawl/linkdb crawl/segments/*nutch 2.x (nutch 2.2.1为例)mysqlmy.ini或my.c
10分钟了解数据质量管理-奥斯汀格里芬 Apache Griffin
搞数据
04-28 1009
Griffin是一个开源的大数据数据质量解决方案，由eBay开源，它支持批处理和流模式两种数据质量检测方式，是一个基于Hadoop和Spark建立的数据质量服务平台 (DQSP)。它提供了一个全面的框架来处理不同的任务，例如定义数据质量模型、执行数据质量测量、自动化数据分析和验证，以及跨多个数据系统的统一数据质量可视化。Griffin于2016年12月进入Apache孵化器，Apache软件基金会2018年12月12日正式宣布Apache Griffin毕业成为Apache顶级项目。
云计算知识点-02
lv785的博客
04-27 1408
DataNode是HDFS文件系统的工作节点，DataNode会按照客户端或者是NameNode的调度来存储和检索数据，并定期向NameNode发送它所存储的数据块列表，DataNode是文件系统中真正存储数据的地方。通过这种虚拟化可以减少服务器的数量，提高服务器的使用效率，可以在一定程度上摆脱物理上的空间限制，实现随时随地随需的自由掌控。Glance(镜像服务组件)，其作用是：提供虚拟机镜像的存储，查询和检索功能，为nova进行服务，依赖于存储服务（存储镜像本身）和数据库服务（存储镜像相关的数据）。
Impala系统架构理解
weixin_64881847的博客
04-26 505
这些执行任务的Impalad实例会根据查询的执行计划，直接在HDFS上读取数据并进行计算。用于跟踪Impala集群中所有Impalad实例的健康状态和位置信息，确保Impala能够了解集群中各个Impalad的状态，从而能够选择合适的Impalad来执行查询任务。这也就意味着一个Impalad进程可能不仅作为协调者分发任务，还可能作为接受者接收并执行来自其他Impalad的任务，这取决于集群的负载和任务的分布。，以便选择最靠近数据所在DataNode的那个节点上的Impalad来执行任务。
25计算机考研院校数据分析 | 电子科技大学
m0_72717598的博客
04-29 563
是国家“985工程”、“211工程”、“世界一流大学和一流学科”重点建设高校，入选“2011计划”、“111计划”、“卓越工程师教育培养计划”、“国家建设高水平大学公派研究生项目”、“中国政府奖学金来华留学生接收院校”，两电一邮成员。题库中抽取题目作答，重点考查程序设计、算法设计与分析、软件工程、计算机组成原理、数据库、计算机网络、编译原理、密码学（该科目限报考083900网络空间安全专业考生）等基础知识情况。101思想政治理论、201英语一、301数学一、820计算机专业基础【22数据结构+操作系统】
中国移动发布国内领先的大云磐石DPU芯片速率达400Gbps
最新发布
csdnsqst0046的博客
04-30 107
后续，磐石DPU芯片将广泛应用于中国移动数据中心建设，以其优越性能，支撑通用计算、智能计算等业务场景使用，为云计算、边缘计算、大数据处理、AI大模型训练等领域提供更加安全、可靠、高效的技术支撑，助力我国大数据、人工智能、算力网络高速发展，推动算力强国战略落地。4月28日，中国移动在其2024算力网络大会上正式发布大云磐石DPU，该芯片带宽达到400Gbps，为国内领先水平，将应用于移动云新一代大云磐石DPU产品，实现关键技术自主可控。据介绍，DPU是一种专注于数据处理的处理器，可实现更高效的数据处理。
sonar启动报错
m0_53166211的博客
04-27 233
sonarqube启动报错
nutch javax.net.ssl.sslexception : could not generate dh keypair
09-06
nutch javax.net.ssl.sslexception : could not generate dh keypair 是一个SSL异常，意味着Nutch无法生成DH密钥对。 TLS（Transport Layer Security）是一种加密协议，用于保护在网络上进行的通信。在TLS握手期间...

“相关推荐”对你有帮助么？

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值