workflow框架 wget 实现http请求

最新推荐文章于 2024-01-21 16:04:43 发布

gdut17

最新推荐文章于 2024-01-21 16:04:43 发布

阅读量691

点赞数

分类专栏： RPC C/C++

本文链接：https://blog.csdn.net/beyond706/article/details/109230571

版权

这篇博客探讨了如何利用wget工具在workflow框架中实现HTTP请求，类似于Go语言中的sync.WaitGroup，通过添加和完成计数来同步多个并发请求，并确保所有任务执行完毕。

摘要由CSDN通过智能技术生成

类似于go的sync.WaitGroup
var wg sync.WaitGroup
wg.Add(num)//启动的协程个数
go func{
defer wg.Done()
…
}
wg.Wait()

/*
  Copyright (c) 2019 Sogou, Inc.

  Licensed under the Apache License, Version 2.0 (the "License");
  you may not use this file except in compliance with the License.
  You may obtain a copy of the License at

	  http://www.apache.org/licenses/LICENSE-2.0

  Unless required by applicable law or agreed to in writing, software
  distributed under the License is distributed on an "AS IS" BASIS,
  WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
  See the License for the specific language governing permissions and
  limitations under the License.

  Author: Xie Han (xiehan@sogou-inc.com;63350856@qq.com)
*/
//g++ -std=c++11 tutorial-01-wget_bak.cc -I/usr/local/include/workflow -lworkflow

#include <netdb.h>
#include <signal.h>
#include <stdlib.h>
#include <stdio.h>
#include <string.h>
#include <string>

#include <assert.h>
#include <sys/time.h>
#include <vector>
#include <iostream>


#include "workflow/HttpMessage.h"
#include "workflow/HttpUtil.h"
#include "workflow/WFTaskFactory.h"
#include "workflow/WFFacilities.h"

#define REDIRECT_MAX    5
#define RETRY_MAX       2

double tick(void)
{
   
    struct timeval t;
    gettimeofday(&t, 0);
    return t.tv_sec + 1E-6 * t.tv_usec;
}


static int task_num = 5;
static WFFacilities::WaitGroup wait_group(task_num);//

void wget_callback(WFHttpTask *task)
{
   
	protocol::HttpRequest *req = task->get_req();
	protocol::HttpResponse *resp = task->get_resp();
	int state = task->get_state();
	int error = task-