淘宝列表页/详情页的php抓取程序 及 调用淘宝API接口获取产品详情数据-淘宝API封装

于 2024-06-18 09:50:26 发布
阅读量652 收藏 7
点赞数 16
分类专栏： 后端PHP开发 后端扩展技术 文章标签： 淘宝API接口调用 淘宝产品详情数据抓取 淘宝API封装 淘宝列表页抓取 淘宝详情页抓取 淘宝抓取php程序
版权声明：本文为博主原创文章，遵循 CC 4.0 BY-SA 版权协议，转载请附上原文出处链接和本声明。
本文链接：https://blog.csdn.net/weixin_47792780/article/details/139730606
版权

     注：本内容发表于publish:February 17, 2016 前后，因此现在迁移博客的时候，可能原来的抓取方法已经不能用了，请先知晓。

一、淘宝列表页php抓取程序

    淘宝列表页php抓取程序，能根据关键词抓取淘宝搜索页的产品数据、类目筛选、以及各种属性筛选等。图片很长，程序代码就不展示出来了。把程序放入PHP环境中，直接访问并带上参数比如?q=衣服，即可向淘宝搜索衣服，并返回页面的数据。PHP的程序下载见本博客中的资源搜索

抓取后的数据结构如下图：

淘宝列表页php抓取程序

二、淘宝详情页的php抓取程序

    以前整的抓取淘宝详情页的程序，现在看了都头大，本想把它都复原一下（原有一套程序可对淘宝产品搜索列表、产品详情、产品评论等各页进行抓取并缓存在REDIS中的系统，但发现搜索的页面程序还能用，详情页面现在抓取反馈301转向，我也没精力再去整理了，另外这个产品页的抓取还采取了cookie登录后抓取。对抓取的结构序列化后再压缩输出，不过现在要再去修复还是要花些精力，我也没什么作用了。共享一下，如果哪位正好需要，用这个进行修改还是可以省下很多力气，我也算做了件好事。

    程序的下载地址请在本博客中的资源搜索，程序源代码如下，比较长。如下：

/*
 *Kermit:
 *Note:淘宝、天猫产品页数据抓取
 *Note:添加登录抓取淘宝
 */

#基本设置
error_reporting(E_ALL);
date_default_timezone_set('PRC');
ini_set('display_errors',1);

#数据抓取类
class TbData
{	
	public $extend_path;			#正则规则的文件目录
	public $autoRedirect=1;			#自动跳转
	public $maxredirect=20;			#最大跳转次数
	public $proxy=false;			#抓取代理
	public $debug=true;				#是否记录抓取日志
	public $logArr;					#抓取日志
	private static $_curlObject = FALSE;
	
	#淘宝登录账号密码
	private $taobao_username='kermit';
	private $taobao_password='*****';
	private $cookie_file='./cookie.txt';
	
	#其它数据
	public $referer='http://item.taobao.com/';
	public $tid;
	public $type='item.taobao.com';
	public $itemParams;
	public $curlUseMulti=true;
	public $postageArea='990000';
	public $RuleXml;
	public $DSGItemRes;
	public $fromCart=false;
	
######------1,基础类方法------#####################################

	#实例化抓取类
	public function __construct($proxy=false)
	{
		$this->extend_path=dirname(__FILE__).'/';
		if($proxy) $this->proxy=$proxy;
	}
	
	#测试展示	
	public function showTest($data,$stop=true)
	{
		header("Content-type:text/html;charset=utf-8");
		print_r('<pre>');print_r($data);print_r('</pre>');
		if($stop) exit;
	}

######------2,模拟登录------#####################################
	
	#模拟登录
	public function autoLogin($code='',$id='')
	{ 
		#获取登录框中的淘宝验证数据
		$text=trim(file_get_contents('https://login.taobao.com/member/login.jhtml'));
		$text=iconv('gbk','utf-8',trim($text));	
		
		#提取要发送的参数
		$rs=preg_match_all('/<input\s*type="hidden"[^>]*name="([^"]*)"[^>]*value="([^"]*)"[^>]*\/>/s',$text,$match);		
		$sdata=array();
		foreach($match[1] as $t=>$skey)
		{
			$sdata[$skey]=$match[2][$t];
		}
		
		#提取URL
		$rs=preg_match('/<form action="\/member([^"]*)"/s',$text,$match);
		$url='https://login.taobao.com/member'.$match[1];
		
		#加入淘宝登录账号
		$sdata['tid']='';
		$sdata['TPL_username']=$this->taobao_username;
		$sdata['TPL_password']=$this->taobao_password;
		$sdata['naviVer']='';
		$sdata['poy']=''; 
		$sdata['TPL_password_2']='';       
		$sdata['oslanguage']='';
		$sdata['sr']='';
		$sdata['osVer']='';
		if($code) $sdata['TPL_checkcode']=$code;

		#组装发送数据
		$char='';
		foreach($sdata as $k=>$v) $char.="{$k}={$v}&";
		$char=rtrim($char,'&');
		
		#执行页面登录、返回需要输入验证码
		$res=$this->vlogin($url,$char);
		
		#提取验证码图片、呈现出提交验证码的表单
		$rs=preg_match('/data-src="([^"]*)"/s',$res,$match);
		if($rs){
			echo "<html><body>
					<form action='http://42.96.199.163/newTbInterFace/TbData.php' method='get' >
						<input type='text' name='code'>&nbsp;
						<input type='hidden' name='id' value='{$id}'>&nbsp;
						<img src='{$match[1]}'>
						<input type='submit'>
					</form>
				  </body></html>";
			exit;
		}
		
		$this->getData(array('id'=>$id));
	}
	
	#执行登录
	public function vlogin($url,$data)
	{
        $curl = curl_init(); 
        curl_setopt($curl, CURLOPT_URL, $url); 
        curl_setopt($curl, CURLOPT_SSL_VERIFYPEER, 0);
        curl_setopt($curl, CURLOPT_SSL_VERIFYHOST, 0);
        curl_setopt($curl, CURLOPT_USERAGENT, 'Mozilla/5.0 (Windows NT 6.1; Win64; x64; rv:25.0) Gecko/20100101 Firefox/25.0');
        curl_setopt($curl, CURLOPT_FOLLOWLOCATION, 1);
        curl_setopt($curl, CURLOPT_REFERER, 'https://login.taobao.com/member/login.jhtml');
        curl_setopt($curl, CURLOPT_POST, 1);
        curl_setopt($curl, CURLOPT_POSTFIELDS, $data);
        curl_setopt($curl, CURLOPT_COOKIEJAR, $this->cookie_file);
        curl_setopt($curl, CURLOPT_COOKIEFILE, $this->cookie_file);
        curl_setopt($curl, CURLOPT_TIMEOUT, 30);
        curl_setopt($curl, CURLOPT_HEADER, 0);
        curl_setopt($curl, CURLOPT_RETURNTRANSFER, 1);
        $tmpInfo = curl_exec($curl);
        if (curl_errno($curl))
		{
            echo 'Errno' . curl_error($curl);exit;
        }
		return $tmpInfo;
    }

######------3,页面抓取------#####################################	
	
	#执行页面数据抓取
	public function getData($params){

		#产品ID参数必须
		if(!$this->tid=$id=$params['id']) return false;
		$this->itemParams=$this->getDSGRules();
		
		#获取第一次抓取详情页的数据
		$ret=$this->getItemPageChar();

		#对抓取的数据进行分析、如存在登录框，则进行账与登录、手动输入验证码后跳转至抓取页面
		if(strpos($ret,'id="J_LoginBox"')!==false)
		{
			#进入登录界面并传递ID值
			$this->autoLogin('',$id);
		}

		#对最终页面进行抓取
		$data = new stdClass();
		$data->data=@iconv('GBK','UTF-8//IGNORE',$ret);
		$ret=NULL;
		$data->url=$this->itemParams->url;	
		$data->isTmall=!(bool)$this->regexMatch('loaded_result_is_fake',$data->data);
        if(($this->type == 'item.taobao.com') && $data->isTmall){
			$this->type='detail.tmall.com';
			$this->referer='http://detail.tmall.com';
            $this->itemParams=$this->getDSGRules();
		}
        $this->DSGItemRes=new stdClass();
        $this->DSGItemRes->html=$data;
		$this->DSGItemRes->item=new stdClass();
		$this->DSGItemRes->item->isTmall=$data->isTmall;     
		if($data->isTmall) $this->parseTmall($data);
		else $this->parseTaobao($data);
		
		#标题重新获取
		$rs=preg_match('/"title":"(.+?)"/s',$this->DSGItemRes->html->data,$match);
		$rs && $this->DSGItemRes->item->title=$match[1];
		
		$this->DSGItemRes->html=NULL;
        function orderSKUs($a, $b){
			$a_val = $a->url;$b_val = $b->url;
			if ($a_val > $b_val) return -1;
			elseif ($a_val == $b_val) return 0;
			else return 1;
        }
        if(isset($this->DSGItemRes->item->props)) {
		    foreach ($this->DSGItemRes->item->props as $prop) {
			    if (isset($prop->childs)) uasort($prop->childs, "orderSKUs");
            }
		}
		#商家页面地区可能不展示，此时从详情页中抓取配送数据
		if(!isset($this->DSGItemRes->rate)) $this->DSGItemRes->rate=new stdClass();
		if(!isset($this->DSGItemRes->rate->diqu) || $this->DSGItemRes->rate->diqu==''){
			$res=preg_match('/location:\'(.*)\',/u',$this->DSGItemRes->item->truePostage,$resstr);
			$this->DSGItemRes->rate->diqu=$res?$resstr[1]:'';
			}		
		return $this->DSGItemRes;
	}
	
	#获取详情页的数据
	public function getItemPageChar()
	{
		#读取系统配置			
		$open_basedir=ini_get('open_basedir');
		$safe_mode=ini_get('safe_mode');
	
		#获取curl资源
		$ch=$this->getCurl($this->itemParams->url,$this->referer);
		
		#加进COOKIES数据
		curl_setopt($ch,CURLOPT_COOKIEJAR, $this->cookie_file); // 存放Cookie信息的文件名称
		curl_setopt($ch,CURLOPT_COOKIEFILE,$this->cookie_file); // 读取上面所储存的Cookie信息

		#执行数据抓取
	    if($this->autoRedirect && (($open_basedir=='') && (in_array($safe_mode, array('0', 'Off'))) || !$safe_mode))
		{
			#自动跳转抓取
			$newurl=$this->itemParams->url;
			echo $newurl;exit;
			curl_setopt($ch, CURLOPT_MAXREDIRS,$this->maxredirect);
			curl_setopt($ch, CURLOPT_FOLLOWLOCATION, true);

		}else{
        	curl_setopt($ch,CURLOPT_FOLLOWLOCATION,FALSE);
			$mr=$this->maxredirect;
			#手动跳转抓取
			if($mr>0)
			{
				  $newurl=curl_getinfo($ch,CURLINFO_EFFECTIVE_URL);
				  $originalUrl=$newurl;
				  $rch = curl_copy_handle($ch);
				  curl_setopt($rch, CURLOPT_HEADER, TRUE);
				  curl_setopt($rch, CURLOPT_NOBODY, TRUE);
				  do{
						curl_setopt($rch,CURLOPT_URL,$newurl);
						
						#抓取时间标记
						$this->debug && $this->logArr[$newurl]['ctime']=microtime(true);
						$header=curl_exec($rch);
						$this->debug && $this->logArr[$newurl]['ctime']=round(microtime(true)-$this->logArr[$newurl]['ctime'],3);
						if(curl_errno($rch)) $code=0;
						else
						{
							  $code = curl_getinfo($rch,CURLINFO_HTTP_CODE);
							  if($code == 301 || $code == 302)
							  {
									preg_match('/Location:(.*?)[\n\r]/i',$header,$matches);
									$url = trim(array_pop($matches));
									if(preg_match('/http[s]*:\/\/.+?(?=\/)/i', $url))
									{
										  $newurl = $url;
									}
									else
									{
										  preg_match('/http[s]*:\/\/.+?(?=\/)/i', $newurl, $m);
										  $newurl = trim(array_pop($m)).$url;
									}
							  }else $code = 0;
						}
						
						
				  }while($code && --$mr);
				  curl_setopt($ch,CURLOPT_URL,$newurl);
			}
	 	}

		#最终页面抓取
		$this->debug && $this->logArr[$newurl.'______curl']['ctime']=microtime(true);
		$ret=curl_exec($ch);
		$this->debug && $this->logArr[$newurl.'______curl']['ctime']=round(microtime(true)-$this->logArr[$newurl.'______curl']['ctime'],3);
		return $ret;
	}
	
	#获取CURL对象
	public function getCurl($path,$referer=''){
		  $ch=curl_init();
		  curl_setopt($ch, CURLOPT_URL,$path);
		  curl_setopt($ch, CURLOPT_REFERER,$referer);
		  curl_setopt($ch, CURLOPT_USERAGENT, 'Mozilla/5.0 (Windows NT 6.1; Win64; x64; rv:25.0) Gecko/20100101 Firefox/25.0');
		  curl_setopt($ch, CURLINFO_HEADER_OUT, TRUE);
		  curl_setopt($ch, CURLOPT_ENCODING, '');
		  curl_setopt($ch, CURLOPT_RETURNTRANSFER,1);
		  curl_setopt($ch, CURLOPT_SSL_VERIFYPEER, false);
		  curl_setopt($ch, CURLOPT_SSL_VERIFYHOST, false);
		  curl_setopt($ch, CURLOPT_TIMEOUT, 60);
		  curl_setopt($ch, CURLOPT_FORBID_REUSE, FALSE);
		  curl_setopt($ch, CURLOPT_NOPROGRESS, TRUE);
		  curl_setopt($ch, CURLOPT_DNS_CACHE_TIMEOUT,3600);
		  curl_setopt($ch, CURLOPT_HTTPHEADER, array("Connection: keep-alive","Keep-Alive: 30")); 
		  if($this->proxy!='') {
			  curl_setopt($ch, CURLOPT_PROXYTYPE,CURLPROXY_HTTP);
			  curl_setopt($ch, CURLOPT_PROXY,$this->proxy);
		  }
		  self::$_curlObject=$ch;
		  return $ch;
   }	
   
   	#加载解析XML正则文件
	public function getDSGRules($queryParams=array(),$xmlfile=true)
	{
		#加载XML文件
		$xml=simplexml_load_string(file_get_contents($this->extend_path.'DSG_rulesList.xml'),NULL,LIBXML_NOCDATA);
		
		#提取当前type的正则规则
		$search=$xml->xpath("/parser_sections/parser_section[name='{$this->type}']");
	    $this->RuleXml=$search[0];
		
		#当前抓取的参数设定
		$result=new stdClass();
		$result->debug=$this->getDSGRule('debug')=='true';
		$result->type=$this->getDSGRule('type');
		$result->url=$this->getDSGRule('base_url').http_build_query(array('id'=>$this->tid)).'#detail';
		return $result;
	}
	
	#提取正则对象中的值
	public function getDSGRule($xpath)
	{
		$xml=$this->RuleXml->xpath($xpath);
		if($xml)
		{
			if (count($xml) > 1 || count($xml[0]) > 1) $res = $xml;
		 	else $res = trim((string) ($xml[0]));
			return $res;
		}
		else return FALSE;
	}
	
	public function regexMatch($ruleXPath,$subject,array &$matches = array(), $flags = 0, $offset = 0) {
		$rule = $this->getDSGRule($ruleXPath);
		ini_set('pcre.backtrack_limit', 4*1024*1024);
		ini_set('pcre.recursion_limit', 1024*1024);
		$res=preg_match($rule,$subject,$matches,$flags,$offset);
		return $res;
	}
	
    public function getHttpDocument($path,$urlPreserved = FALSE, $direct = FALSE,$referer='http://item.taobao.com/') {
		$ch=$this->getCurl($path,$referer);
		$ret=curl_exec($ch);
		$res = new stdClass();
		$res->info = curl_getinfo($ch);
		if ($res->info['http_code'] >= 400) $res->data = FALSE;
		else $res->data = @iconv('GBK', 'UTF-8//IGNORE', $ret);
		$ret=NULL;
		return $res;
   }

   public function getHttpDocumentArray($urls,$direct = FALSE,$referer='http://item.taobao.com/') {
	 	$multi = curl_multi_init();
	  	$channels = array();
	  	 if(!isset($this->logArr['multicullog'][0])) $multi_index=0;
	 	 else $multi_index++;
		 $this->debug && $this->logArr['multicullog'][$multi_index]['ctime']=microtime(true);
	 	 foreach ($urls as $url) {
			$ch = curl_init();
			curl_setopt($ch, CURLOPT_URL,$url);
			curl_setopt($ch, CURLOPT_USERAGENT, 'Mozilla/5.0 (Windows NT 6.1; Win64; x64; rv:25.0) Gecko/20100101 Firefox/25.0');
			curl_setopt($ch, CURLINFO_HEADER_OUT, TRUE);
			curl_setopt($ch, CURLOPT_ENCODING, ''); 
			curl_setopt($ch, CURLOPT_RETURNTRANSFER, 1);
			curl_setopt($ch, CURLOPT_SSL_VERIFYPEER, false);
			curl_setopt($ch, CURLOPT_SSL_VERIFYHOST, false);
			curl_setopt($ch, CURLOPT_TIMEOUT, 120);
			curl_setopt($ch, CURLOPT_FORBID_REUSE, FALSE);
			curl_setopt($ch, CURLOPT_NOPROGRESS, TRUE);
			curl_setopt($ch, CURLOPT_DNS_CACHE_TIMEOUT, 3600);
			curl_setopt($ch, CURLOPT_REFERER, $referer);
			curl_setopt($ch, CURLOPT_RETURNTRANSFER, true);
			curl_setopt($ch, CURLOPT_MAXREDIRS, 20);
			curl_setopt($ch, CURLOPT_FOLLOWLOCATION, 0);
			if($this->proxy) curl_setopt($ch, CURLOPT_PROXY, $this->proxy);
			curl_multi_add_handle($multi, $ch);
			$channels[$url] = $ch;
			$this->debug && $this->logArr['multicullog'][$multi_index][]=$url;
			$multi++;
	  	}
		$active = null;
		do {
			$mrc = curl_multi_exec($multi, $active);
		}while ($active>0);
		while ($active && $mrc == CURLM_OK) {
		  if (curl_multi_select($multi) == -1) {
			continue;
		  }
		  do{
			$mrc = curl_multi_exec($multi, $active);
		  } while ($active>0); 
		}
		$results=array();
		$this->debug && $this->logArr['multicullog'][$multi_index]['ctime']=round((microtime(true)-$this->logArr['multicullog'][$multi_index]['ctime']),3);
		foreach ($channels as $i=>$channel) {
		  $results[$i]= new stdClass();
		  $results[$i]->info=curl_getinfo($channel);
		  $ret=curl_multi_getcontent($channel);
		  curl_multi_remove_handle($multi, $channel);
		  if ($direct || ($results[$i]->info['http_code'] >= 400)) {
			if (isset($ret)) {$results[$i]->data = $ret;
			}else{ $results[$i]->data = FALSE;}
		  }else {
			$results[$i]->data = @iconv('GBK', 'UTF-8//IGNORE', $ret);
		  }
		  unset ($ret);
		}
		curl_multi_close($multi);
		return $results;
  
    }

	public function JavaScriptToJSON($input, $asObject = FALSE) {
		if (($input == FALSE) || ($input == '')) return new stdClass();
		ini_set('pcre.backtrack_limit', 4*1024*1024);
		ini_set('pcre.recursion_limit', 1024*1024);
		if ($input{0} != '{') {
		  $res = preg_replace('/^.*?(?={)/s', '', $input);
		}else{
		  $res = $input;
		}
		$res = preg_replace('/[^}]*?$/s','', $res);
		$res = preg_replace('/(?<=[\s,{])([a-z0-9\-_]+)\s*:(?!\d{2}:\d{2})/i', '"\1":', $res);
		$res = str_replace("'", '"', $res);
		$res = preg_replace('/("\s*:\s*)(?=[,}])/s', '\1""', $res);
		$cnt = preg_match_all('/(?::\s*")(.*?)(?:"\s*[,}])/', $res, $matches);
		if ($cnt > 0) {
		  foreach ($matches[1] as $src) {
			if (strpos($src, '"') === FALSE) continue;
			$res = str_replace($src, str_replace('"', '\"', $src), $res);
		  }
		}
		if (!$asObject) {
		  return $res;
		}else {
		  $resJSON = json_decode($res);
		  $err = json_last_error();
		  switch ($err) {
			case JSON_ERROR_NONE:
			  return $resJSON;
			  break;
			
			default:
			  return new stdClass();
			  break;
		  }
		}
	}
	
	public function regexMatchAll($ruleXPath,$subject,array &$matches = array(),$flags = 0, $offset = 0) {
		$rule = $this->getDSGRule($ruleXPath);
		ini_set('pcre.backtrack_limit', 4*1024*1024);
		ini_set('pcre.recursion_limit', 1024*1024);
		$res = preg_match_all($rule, $subject, $matches, $flags, $offset);
		if ($res===false && $this->debug) {$this->showError(__FILE__,__FUNCTION__,__LINE__,preg_last_error());}
		return $res;
  	}
	
	public function getObjPropValDef($stringPath, $defVal){
		if (isset($stringPath)) {
		  return $stringPath;
		}else {
		  return $defVal;
		}
  	}
	
	private function parseTaobao($data){
        $resstr = array();
        $res = $this->regexMatch('parse_item_values/user_rate_url', $data->data, $resstr);
        if ($res > 0) {
            $this->DSGItemRes->item->userRateUrl = $resstr[0];
        }
		#抓取商家页面
        $ch=$this->getCurl($this->DSGItemRes->item->userRateUrl,$this->referer);
        $mr=$this->maxredirect;
		$open_basedir = ini_get('open_basedir');
		$safe_mode = ini_get('safe_mode');
	    if(($open_basedir == '') && (in_array($safe_mode, array('0', 'Off'))||!$safe_mode)) {
			curl_setopt($ch, CURLOPT_MAXREDIRS,$mr);
			curl_setopt($ch, CURLOPT_FOLLOWLOCATION,$mr>0);
		}else{
        	curl_setopt($ch,CURLOPT_FOLLOWLOCATION,FALSE);
			if($mr>0){ 
				  $newurl=curl_getinfo($ch,CURLINFO_EFFECTIVE_URL);
				  $originalUrl=$newurl;
				  $rch = curl_copy_handle($ch);
				  curl_setopt($rch, CURLOPT_HEADER, TRUE);
				  curl_setopt($rch, CURLOPT_NOBODY, TRUE);
				  curl_setopt($rch, CURLOPT_FORBID_REUSE, FALSE);
				  curl_setopt($rch, CURLOPT_RETURNTRANSFER, TRUE);
				  curl_setopt($ch, CURLOPT_USERAGENT, 'Mozilla/5.0 (Windows NT 6.1; Win64; x64; rv:25.0) Gecko/20100101 Firefox/25.0');
				  do{
					curl_setopt($rch,CURLOPT_URL,$newurl);
					$mr!=$this->maxredirect && @$this->logArr['curllog'][]=$newurl;
					$header=curl_exec($rch);
					if(curl_errno($rch)) $code=0;
					else{ 
					  $code = curl_getinfo($rch, CURLINFO_HTTP_CODE);
					  if($code == 301 || $code == 302){
						preg_match('/Location:(.*?)[\n\r]/i',$header,$matches);
						$url = trim(array_pop($matches));
						if (preg_match('/http[s]*:\/\/.+?(?=\/)/i', $url)) {
						  $newurl = $url;
						}else{
						  preg_match('/http[s]*:\/\/.+?(?=\/)/i', $newurl, $m);
						  $newurl = trim(array_pop($m)) . $url;
						}
					  }else $code = 0;
					}
					
				  }while($code && --$mr);
				  curl_close($rch);
				  if(!$mr && $this->debug) $this->showError(__FILE__,__FUNCTION__,__LINE__,'redirects exceed '.$this->maxredirect.'. Result:'.E_USER_WARNING);
				  curl_setopt($ch, CURLOPT_URL, $newurl);
			}
	 	}

		$ret=curl_exec($ch);
		$data->rate=@iconv('GBK', 'UTF-8//IGNORE', $ret);
		$this->DSGItemRes->rate = new stdClass();
		$res = preg_match('/data-tnick\s*=\s*"(.+?)"/i', $data->rate, $resstr);
        if ($res > 0){$this->DSGItemRes->rate->nick = urldecode($resstr[1]);
        }else{$this->DSGItemRes->rate->nick ='';}
		
		#2014-11-1 kermit
		$res = preg_match('/\<div class="frame"\>\s*\<div class="list"\>卖家信用：(\d+?)\s*<a href="/s',$data->rate,$resstr);
        $this->DSGItemRes->rate->xinyong_fen=$res>0?urldecode($resstr[1]):'';
		$res = preg_match('/src="http:\/\/pics.taobaocdn.com\/newrank\/(.+?).gif"/u', $data->rate, $resstr);
        $this->DSGItemRes->rate->xinyong_star=$res>0?urldecode($resstr[1]):'';
		$res = preg_match('/\<li\>\s*所在地区\s*：\s*(.+?)\s*\<\/li\>/u', $data->rate, $resstr);
        $this->DSGItemRes->rate->diqu=$res>0?trim(str_replace('&nbsp;','',urldecode($resstr[1]))):'';
		$res = preg_match('/共\<span\>(\d*)\<\/span\>人/u',$data->rate,$resstr);
        $this->DSGItemRes->rate->point_number=$res>0?urldecode($resstr[1]):'';
		$res = preg_match('/宝贝与描述相符：\<\/span\>\s*\<em title="(\d*\.?\d*)分"/s',$data->rate,$resstr);
        $this->DSGItemRes->rate->point_miaosho=$res>0?urldecode($resstr[1]):'';
		$res = preg_match('/卖家的服务态度：\<\/span\>\s*\<em title="(\d*\.?\d*)分"/s',$data->rate,$resstr);
        $this->DSGItemRes->rate->point_fuwu=$res>0?urldecode($resstr[1]):'';
		$res = preg_match('/卖家发货的速度：\<\/span\>\s*\<em title="(\d*\.?\d*)分"/s',$data->rate,$resstr);
        $this->DSGItemRes->rate->point_fahuo=$res>0?urldecode($resstr[1]):'';
		$res = preg_match('/\<em style="color:gray;"\>好评率：(\d*\.\d*%)\<\/em\>/u',$data->rate,$resstr);
        $this->DSGItemRes->rate->haopinglv=$res>0?urldecode($resstr[1]):'';
		$res = preg_match('/id="\s*J_showShopStartDate\s*"\s*value="([\d\-]+?)"\s*\/>/u', $data->rate, $resstr);
		$this->DSGItemRes->rate->starttime=$res>0?urldecode($resstr[1]):'';
		$this->DSGItemRes->rate->shoptype='taobao';
        $res = preg_match_all('/dsr-item\s*"\s*\>(.+?)\s*\<\/li\>/u', $data->rate, $resstr);
		$this->DSGItemRes->rate->point=$res>0?urldecode($resstr[1]):'';

        $resstr = array();
        $res = $this->regexMatch('parse_item_values/cid', $data->data, $resstr);
        if ($res > 0) {$this->DSGItemRes->item->cid = (string) $resstr[1];
        } else {$this->DSGItemRes->item->cid = '0';}
        $res = $this->regexMatch('parse_item_values/num_iid', $data->data, $resstr);
        if ($res > 0) {$this->DSGItemRes->item->num_iid = (string) $resstr[1];
        } else {$this->DSGItemRes->item->num_iid = '0';}
        $res = $this->regexMatch('parse_item_values/seller_id', $data->data, $resstr);
        if ($res > 0) {$this->DSGItemRes->item->seller_id = (string) $resstr[1];
        } else {$this->DSGItemRes->item->seller_id = '0';}
        $res = $this->regexMatch('parse_item_values/nick', $data->data, $resstr);
        if ($res > 0) {$this->DSGItemRes->item->nick = (string) $resstr[1];
        } else {$this->DSGItemRes->item->nick = '';}
        $res = $this->regexMatch('parse_item_values/shop_id', $data->data, $resstr);
        if ($res > 0) {$this->DSGItemRes->item->shop_id = (string) $resstr[1];
        } else {$this->DSGItemRes->item->shop_id = '0';}
        $res = $this->regexMatch('parse_item_values/title', $data->data, $resstr);
        if ($res > 0) {$this->DSGItemRes->item->title = (string) $resstr[1];
        } else {$this->DSGItemRes->item->title = '';}
        $res = $this->regexMatch('parse_item_values/pic_url', $data->data, $resstr);
        if ($res > 0) {$this->DSGItemRes->item->pic_url = (string) $resstr[1];
        } else {$this->DSGItemRes->item->pic_url = '';}
        $res = $this->regexMatch('parse_item_values/price', $data->data, $resstr);
        if ($res > 0) {$this->DSGItemRes->item->price = (float) $resstr[1];
        } else {$this->DSGItemRes->item->price = 0;}
        $res = $this->regexMatch('parse_item_values/block_sib/_url', $data->data, $resstr);
        if ($res <= 0) {
            $this->DSGItemRes->item->num = 0;
            $this->DSGItemRes->item->location = '';
            $this->DSGItemRes->item->post_fee = 0;
            $this->DSGItemRes->item->express_fee = 0;
            $this->DSGItemRes->item->ems_fee = 0;
            $this->DSGItemRes->item->sku_data = new stdClass();
        }else {
            $sib_data = $this->getHttpDocument(
              $resstr[1] . '&ref=' . urldecode('http://item.taobao.com/item.htm?id=' . $this->DSGItemRes->item->num_iid),
			  false,false,'http://item.taobao.com/item.htm?id=' . $this->DSGItemRes->item->num_iid);
            $res = $this->regexMatch('parse_item_values/block_sib/num', $sib_data->data, $resstr);
            if ($res > 0) {$this->DSGItemRes->item->num = $resstr[1];
            } else {$this->DSGItemRes->item->num = 0;}
            $res = $this->regexMatch('parse_item_values/block_sib/location', $sib_data->data, $resstr);
            if ($res > 0) {$this->DSGItemRes->item->location = $resstr[1];
            } else {$this->DSGItemRes->item->location = '';}
            $res = $this->regexMatch('parse_item_values/block_sib/post_fee', $sib_data->data, $resstr);
            if ($res > 0) {
                if (!isset($resstr[2])) {$this->DSGItemRes->item->post_fee = (float) $resstr[1];
                }else {$this->DSGItemRes->item->post_fee = 0;
                }
            } else {$this->DSGItemRes->item->post_fee = 0;}
            $res = $this->regexMatch('parse_item_values/block_sib/express_fee', $sib_data->data, $resstr);
            if ($res > 0) {
                if (!isset($resstr[2])) {$this->DSGItemRes->item->express_fee = (float) $resstr[1];
                } else {$this->DSGItemRes->item->express_fee = 0;}
            } else {$this->DSGItemRes->item->express_fee = 0;}
            $res = $this->regexMatch('parse_item_values/block_sib/ems_fee', $sib_data->data, $resstr);
            if ($res > 0) {
                if (!isset($resstr[2])) {$this->DSGItemRes->item->ems_fee = (float) $resstr[1];
                } else {$this->DSGItemRes->item->ems_fee = 0;}
            } else {$this->DSGItemRes->item->ems_fee = 0;}
            if ($this->DSGItemRes->item->express_fee == 0) {
                $this->DSGItemRes->item->express_fee = max(
                  array(
                    $this->DSGItemRes->item->post_fee,
                    $this->DSGItemRes->item->express_fee
                  )
                );
            }
            $res = $this->regexMatch('parse_item_values/block_sib/sku_promotions', $sib_data->data, $resstr);
            if ($res > 0) {$this->DSGItemRes->item->sku_promotions = $this->JavaScriptToJSON('{' . $resstr[1], true);}
            $res = $this->regexMatch('parse_item_values/block_sib/sku_data', $sib_data->data, $resstr);
            if ($res > 0) {$this->DSGItemRes->item->sku_data = $this->JavaScriptToJSON('{' . $resstr[1], true);}
            unset($sib_data);
        }
        $this->DSGItemRes->item->item_imgs = new stdClass();
        $this->DSGItemRes->item->item_imgs->item_img = array();
        $res = $this->regexMatch('parse_item_values/item_imgs/block', $data->data, $resstr);
        if ($res > 0) {
            $item_imgs_data = $resstr[1];
            $res = $this->regexMatchAll('parse_item_values/item_imgs/url', $item_imgs_data, $resstr);
            unset($item_imgs_data);
            if ($res > 0) {
                foreach ($resstr[1] as $i => $item_img) {
                    $this->DSGItemRes->item->item_imgs->item_img[$i] = new stdClass();
                    $this->DSGItemRes->item->item_imgs->item_img[$i]->id = $i;
                    $this->DSGItemRes->item->item_imgs->item_img[$i]->position = $i;
                    $this->DSGItemRes->item->item_imgs->item_img[$i]->url = $item_img;
                }
                unset($item_img);
            }
        }
        $this->DSGItemRes->item->item_attributes = array();
        $res = $this->regexMatch('parse_item_values/item_attributes/block', $data->data, $resstr);
        if ($res > 0) {
            $attributes_data = $resstr[1];
            $res = $this->regexMatchAll('parse_item_values/item_attributes/propvallist', $attributes_data, $resstr);
            if ($res > 0) {
                foreach ($resstr[1] as $i => $item_attr) {
                    $this->DSGItemRes->item->item_attributes[$i] = new stdClass();
                    $this->DSGItemRes->item->item_attributes[$i]->prop = html_entity_decode($resstr[1][$i],ENT_COMPAT,'UTF-8');
                    $this->DSGItemRes->item->item_attributes[$i]->val = html_entity_decode($resstr[2][$i],ENT_COMPAT,'UTF-8');
                }
                unset($item_attr);
            }
            unset($attributes_data);
        }
        $this->DSGItemRes->item->props = array();
        $res=$this->regexMatch('parse_item_values/prop_imgs/block', $data->data, $resstr);
        if($res>0){
            $propresstr=array();
            $propres=$this->regexMatchAll('parse_item_values/prop_imgs/prop/block', $resstr[1], $propresstr);
            if ($propres>0){
                foreach ($propresstr[1] as $propblock) {
                    $propFinal = new stdClass();
                    $propblockresstr = array();
                    $propblockres = $this->regexMatch('parse_item_values/prop_imgs/prop/title',$propblock,$propblockresstr);
                    if ($propblockres > 0) {
                        $propFinal->cid = $this->DSGItemRes->item->cid;
                        $propFinal->name_zh = $propblockresstr[1];
                        $propFinal->name = $propblockresstr[1];
                        unset($propblockresstr);
                    } else {continue;}
                    $propimgresstr = array();
                    $propimgres = $this->regexMatchAll('parse_item_values/prop_imgs/prop/prop_img/block',$propblock,$propimgresstr);
                    if ($propimgres > 0) {
                        $propFinal->childs = array();
                        foreach ($propimgresstr[1] as $j => $propimgblock) {
                            $resstr0 = array();
                            $res0 = $this->regexMatch('parse_item_values/prop_imgs/prop/prop_img/properties',$propimgblock,$resstr0);
                            if ($res0 > 0) {
                                $propFinal->childs[$j] = new stdClass();
                                $pidvid = explode(':', $resstr0[1]);
                                if (!isset($pidvid[0]) || !isset($pidvid[1])){continue;}
                                $propFinal->childs[$j]->vid = $pidvid[1];
                            } else {continue;}
                            $resstr0 = array();
                            $res0 = $this->regexMatch('parse_item_values/prop_imgs/prop/prop_img/title',$propimgblock,$resstr0);
                            if ($res0 > 0) {
                                $propFinal->childs[$j]->name_zh = $resstr0[1];
                                $propFinal->childs[$j]->name = $resstr0[1];
                            } else {
                                $propFinal->childs[$j]->name_zh = '';
                                $propFinal->childs[$j]->name = '';
                            }
                            $resstr0 = array();
                            $res0 = $this->regexMatch('parse_item_values/prop_imgs/prop/prop_img/url',$propimgblock,$resstr0);
                            if ($res0 > 0) {$propFinal->childs[$j]->url = $resstr0[1];
                            }else {$propFinal->childs[$j]->url = '';}
                        }
                        unset($propimgblock);
                        unset($propimgresstr);
                    }
                    if (isset($pidvid)) {
                        $this->DSGItemRes->item->props[$pidvid[0]] = clone $propFinal;
                        unset($pidvid);
                        unset($propFinal);
                    }
                }
                unset($propblock);
                unset($propresstr);
            }
        }
        $res = $this->regexMatch('parse_item_values/skus/block', $data->data, $resstr);
        if ($res > 0) {
            $skudatajson = $this->JavaScriptToJSON($resstr[1], true);
            unset($data);
            if (!$this->fromCart) {
                if (isset($skudatajson->apiItemDesc)) {
                    $this->DSGItemRes->item->desc = false;
                    $this->DSGItemRes->item->descUrl = (string) $skudatajson->apiItemDesc;
                    unset($dldata);
                }
            }	
            if ($this->curlUseMulti) {
                $urls = array();
                if (!$this->fromCart) {
                    if (isset($skudatajson->valReviewsApi))  $urls[] = (string) $skudatajson->valReviewsApi;
                    if (isset($skudatajson->apiItemInfo)) $urls[] = (string) $skudatajson->apiItemInfo;
				    if (isset($skudatajson->apiRelateMarket)) {
                        $url = preg_replace('/appid=\d+/', 'appid=32', (string) $skudatajson->apiRelateMarket);
                        $url = preg_replace('/count=\d+/', 'count=4', $url);
                        $urls[] = $url;
                    }
                }
                $_truePostage='http://detailskip.taobao.com/json/postageFee.htm?itemId='.$this->DSGItemRes->item->num_iid.'&areaId='.$this->postageArea;
                $urls[] = $_truePostage;
                $downloads = $this->getHttpDocumentArray($urls);
                if (isset($skudatajson->valReviewsApi)) {
                    if (isset($downloads[(string) $skudatajson->valReviewsApi])) {
                        $this->DSGItemRes->item->valReviewsApi = $this->JavaScriptToJSON(
                          preg_replace('/(:?,"babyRateJsonList"|,"rateListInfo").*(?=})/s','',$downloads[(string) $skudatajson->valReviewsApi]->data),true);
                    }
                }
                if (isset($skudatajson->apiItemInfo)) {
                    if (isset($downloads[(string) $skudatajson->apiItemInfo])) {
                        $this->DSGItemRes->item->apiItemInfo = $this->JavaScriptToJSON($downloads[(string) $skudatajson->apiItemInfo]->data,true);
                    }
                }
                if (isset($url)) {
                    if (isset($downloads[$url])) {
                        $this->DSGItemRes->item->apiRelateMarket = $this->JavaScriptToJSON($downloads[$url]->data,true);
                    }
                }
                if (isset($_truePostage) && isset($downloads[$_truePostage])) {
                    $this->DSGItemRes->item->truePostage = $downloads[$_truePostage]->data;
                }

            }else{
                if (!$this->fromCart) {
                    if (isset($skudatajson->valReviewsApi)) {
                        $dldata = $this->getHttpDocument((string) $skudatajson->valReviewsApi);
                        $this->DSGItemRes->item->valReviewsApi = $this->JavaScriptToJSON(
                          preg_replace('/(:?,"babyRateJsonList"|,"rateListInfo").*(?=})/s', '', $dldata->data),true);
                    }
                }
                if (!$this->fromCart) {
                    if (isset($skudatajson->apiItemInfo)) {
                        $dldata = $this->getHttpDocument((string) $skudatajson->apiItemInfo);
                        $this->DSGItemRes->item->apiItemInfo = $this->JavaScriptToJSON($dldata->data, true);
                    }
                }
                if (!$this->fromCart) {
                    if (isset($skudatajson->apiRelateMarket)) {
                        $url = preg_replace('/appid=\d+/', 'appid=32', (string) $skudatajson->apiRelateMarket);
                        $url = preg_replace('/count=\d+/', 'count=32', $url);
                        $dldata = $this->getHttpDocument($url);
                        $this->DSGItemRes->item->apiRelateMarket = $this->JavaScriptToJSON($dldata->data, true);
                    }
                }
                $url ='http://detailskip.taobao.com/json/postageFee.htm?itemId='.$this->DSGItemRes->item->num_iid.'&areaId='.$this->postageArea;
				$dldata = $this->getHttpDocument($url);
                $this->DSGItemRes->item->truePostage = $dldata->data;
            }
            if (isset($this->DSGItemRes->item->truePostage)){
                $res = $this->regexMatch('parse_item_values/block_sib/express_fee', $this->DSGItemRes->item->truePostage, $resstr);
                if ($res > 0) {
                    if (!isset($resstr[2])) {$this->DSGItemRes->item->express_fee = (float) $resstr[1];
                    }else {$this->DSGItemRes->item->express_fee = 0;}
                }else{$this->DSGItemRes->item->express_fee = 0;}
                $res = $this->regexMatch('parse_item_values/block_sib/ems_fee', $this->DSGItemRes->item->truePostage, $resstr);
                if($res>0){
                    if(!isset($resstr[2])) {$this->DSGItemRes->item->ems_fee = (float) $resstr[1];
                    }else{$this->DSGItemRes->item->ems_fee = 0;}
                }else{$this->DSGItemRes->item->ems_fee = 0;}
                if ($this->DSGItemRes->item->express_fee == 0) {
                    $this->DSGItemRes->item->express_fee = max(
                      array(
                        $this->DSGItemRes->item->post_fee,
                        $this->DSGItemRes->item->express_fee
                      )
                    );
                }
            }
            if (isset($this->DSGItemRes->item->sku_data->sku)) {
                $skuFromSIB = $this->DSGItemRes->item->sku_data->sku;
                unset($this->DSGItemRes->item->sku_data);
            }
            $this->DSGItemRes->item->promotion_price = $this->DSGItemRes->item->price;
            if (isset($skudatajson->valItemInfo)) {
                if (isset($skudatajson->valItemInfo->skuMap)) {
                    $this->DSGItemRes->item->skus = new stdClass();
                    $srcSkuArray = (array) $skudatajson->valItemInfo->skuMap;
                    $this->DSGItemRes->item->skus->sku = array();
                    foreach ($srcSkuArray as $name => $val) {
                        $this->DSGItemRes->item->skus->sku[] = new stdClass();
                        end($this->DSGItemRes->item->skus->sku)->price = (float) $val->price;
                        end($this->DSGItemRes->item->skus->sku)->properties = trim($name, ';');
                        end($this->DSGItemRes->item->skus->sku)->properties_name = ''; // ???
                        if (isset($skuFromSIB)) {
                            if (isset($skuFromSIB->{$name})){end($this->DSGItemRes->item->skus->sku)->quantity = $skuFromSIB->{$name}->stock;
                            }else{end($this->DSGItemRes->item->skus->sku)->quantity = $val->stock;}
                        }else{end($this->DSGItemRes->item->skus->sku)->quantity = $val->stock;}
                        if (end($this->DSGItemRes->item->skus->sku)->quantity == 99){end($this->DSGItemRes->item->skus->sku)->quantity=0;}
                        end($this->DSGItemRes->item->skus->sku)->sku_id=$val->skuId;
                        if (isset($this->DSGItemRes->item->sku_promotions->{$name})) {
                            $promotions = $this->DSGItemRes->item->sku_promotions->{$name};
                            $PromotionPriceArray = Array();
                            foreach ($promotions as $promotion) {
                                if (isset($promotion->price)) {
                                    if ($promotion->price>0){$PromotionPriceArray[] = (float) $promotion->price;}
                                }
                            }
                            if (count($PromotionPriceArray) > 0) {$promotion_price = min($PromotionPriceArray);
                            } else {$promotion_price = 0;}
                            if ($promotion_price > 0) {end($this->DSGItemRes->item->skus->sku)->promotion_price = $promotion_price;
                            } else {end($this->DSGItemRes->item->skus->sku)->promotion_price = (float) $val->price;}
                        } elseif (isset($val->specPrice)) {
                            if ($val->specPrice == '') {end($this->DSGItemRes->item->skus->sku)->promotion_price = (float) $val->price;
                            } else {end($this->DSGItemRes->item->skus->sku)->promotion_price = (float) $val->specPrice;}
                        } else {end($this->DSGItemRes->item->skus->sku)->promotion_price = (float) $val->price;}
                    }
                    unset($this->DSGItemRes->item->sku_promotions);
                    $PromotionPriceArray = Array();
                    foreach ($this->DSGItemRes->item->skus->sku as $sku) {
                        if (isset($sku->promotion_price)) {
                            if ($sku->promotion_price > 0) {$PromotionPriceArray[] = $sku->promotion_price;}
                        }
                    }
                    $this->DSGItemRes->item->promotion_price = min($PromotionPriceArray);
                   $PromotionPriceArray=$sku=$srcSkuArray=$name=$val=NULL;
                } else {$tryToGetSku_promotions = true;}
            }else{
                $tryToGetSku_promotions = true;
            }
            if (isset($tryToGetSku_promotions) && $tryToGetSku_promotions) {
                if (isset($this->DSGItemRes->item->sku_promotions)) {
                    if (isset($this->DSGItemRes->item->sku_promotions->def)) {
                        if (is_array($this->DSGItemRes->item->sku_promotions->def)) {
                            $promotions = array();
                            foreach ($this->DSGItemRes->item->sku_promotions->def as $defPromotions) {
                                if (isset($defPromotions->price)) {$promotions[] = (float) $defPromotions->price;}
                            }
                            if (count($promotions) > 0) {$this->DSGItemRes->item->promotion_price = min($promotions);}
                        }
                    }
                }
            }
            unset($skuFromSIB);
            unset($dldata);
			//http://tui.taobao.com/recommend?appid=32&count=32&itemid=26733820522
            unset($skudatajson);
        }
        $this->DSGItemRes->item->postage_id = '0';
    }

	public function parseTmall($data){
        $resstr = array();
        $res = $this->regexMatch('parse_item_values/user_rate_url', $data->data, $resstr);
        if ($res > 0){$this->DSGItemRes->item->userRateUrl = $resstr[0];}
        $resstr = array();
        $res = $this->regexMatch('parse_item_values/tshop',$data->data,$resstr);
        if ($res > 0){$this->DSGItemRes->item->tshop=$this->JavaScriptToJSON($resstr[1],true);}
        $resstr = array();
        $this->DSGItemRes->item->cid = $this->getObjPropValDef(@$this->DSGItemRes->item->tshop->itemDO->categoryId,0);
        $this->DSGItemRes->item->num_iid = $this->getObjPropValDef(@$this->DSGItemRes->item->tshop->itemDO->itemId,0);
        $this->DSGItemRes->item->seller_id = $this->getObjPropValDef(@$this->DSGItemRes->item->tshop->itemDO->userId,0);
        $this->DSGItemRes->item->nick = urldecode((string) $this->getObjPropValDef(@$this->DSGItemRes->item->tshop->itemDO->sellerNickName,''));
        $this->DSGItemRes->item->price = (float) $this->getObjPropValDef(@$this->DSGItemRes->item->tshop->itemDO->reservePrice,0);
        $this->DSGItemRes->item->num = $this->getObjPropValDef(@$this->DSGItemRes->item->tshop->itemDO->quantity,0);
        $res = $this->regexMatch('parse_item_values/shop_id', $data->data, $resstr);
        if ($res > 0) {$this->DSGItemRes->item->shop_id = (string) $resstr[1];
        }else{$this->DSGItemRes->item->shop_id = '0';}
        $res = $this->regexMatch('parse_item_values/title', $data->data, $resstr);
        if($res>0){$this->DSGItemRes->item->title = (string) $resstr[1];
        }else{$this->DSGItemRes->item->title = '';}
        $res = $this->regexMatch('parse_item_values/pic_url', $data->data, $resstr);
        if($res>0){$this->DSGItemRes->item->pic_url = (string) $resstr[1];
        }else{$this->DSGItemRes->item->pic_url = '';}
        $this->DSGItemRes->item->location = '';
        $this->DSGItemRes->item->post_fee = 0;
        $this->DSGItemRes->item->express_fee = 0;
        $this->DSGItemRes->item->ems_fee = 0;
        $this->DSGItemRes->item->item_imgs = new stdClass();
        $this->DSGItemRes->item->item_imgs->item_img = array();
        $res = $this->regexMatch('parse_item_values/item_imgs/block', $data->data, $resstr);
        if ($res > 0) {
            $item_imgs_data = $resstr[1];
            $res = $this->regexMatchAll('parse_item_values/item_imgs/url', $item_imgs_data, $resstr);
            unset($item_imgs_data);
            if ($res > 0) {
                foreach ($resstr[1] as $i => $item_img) {
                    $this->DSGItemRes->item->item_imgs->item_img[$i] = new stdClass();
                    $this->DSGItemRes->item->item_imgs->item_img[$i]->id = $i;
                    $this->DSGItemRes->item->item_imgs->item_img[$i]->position = $i;
                    $this->DSGItemRes->item->item_imgs->item_img[$i]->url = $item_img;
                }
                unset($item_img);
            }
        }
        $this->DSGItemRes->item->item_attributes = array();
        $res = $this->regexMatch('parse_item_values/item_attributes/block', $data->data, $resstr);
        if ($res > 0) {
            $attributes_data = $resstr[1];
            $res = $this->regexMatchAll('parse_item_values/item_attributes/propvallist', $attributes_data, $resstr);
            if ($res > 0) {
                foreach ($resstr[1] as $i => $item_attr) {
                    $this->DSGItemRes->item->item_attributes[$i] = new stdClass();
                    $this->DSGItemRes->item->item_attributes[$i]->prop = html_entity_decode($resstr[1][$i],ENT_COMPAT,'UTF-8');
                    $this->DSGItemRes->item->item_attributes[$i]->val = html_entity_decode($resstr[2][$i],ENT_COMPAT,'UTF-8');
                }
                unset($item_attr);
            }
            unset($attributes_data);
        }
        $this->DSGItemRes->item->props = array();
        $res = $this->regexMatch('parse_item_values/prop_imgs/block', $data->data, $resstr);
        if ($res > 0) {
            $propresstr = array();
            $propres = $this->regexMatchAll('parse_item_values/prop_imgs/prop/block', $resstr[1], $propresstr);
            if ($propres > 0) {
                foreach ($propresstr[1] as $propblock) {
                    $propFinal = new stdClass();
                    $propblockresstr = array();
                    $propblockres = $this->regexMatch('parse_item_values/prop_imgs/prop/title',$propblock,$propblockresstr);
                    if ($propblockres > 0) {
                        $propFinal->cid = $this->DSGItemRes->item->cid;
                        $propFinal->name_zh = $propblockresstr[1];
                        $propFinal->name = $propblockresstr[1];
                        unset($propblockresstr);
                    } else {continue;}
                    $propimgresstr = array();
                    $propimgres = $this->regexMatchAll('parse_item_values/prop_imgs/prop/prop_img/block',$propblock,$propimgresstr);
                    if ($propimgres > 0) {
                        $propFinal->childs = array();
                        foreach ($propimgresstr[1] as $j => $propimgblock) {
                            $resstr0 = array();
                            $res0 = $this->regexMatch('parse_item_values/prop_imgs/prop/prop_img/properties',$propimgblock,$resstr0);
                            if($res0 > 0){
                                $propFinal->childs[$j] = new stdClass();
                                $pidvid = explode(':', $resstr0[1]);
                                if (!isset($pidvid[0]) || !isset($pidvid[1])) {continue;}
                                $propFinal->childs[$j]->vid = $pidvid[1];
                            }else{continue;}
                            $resstr0 = array();
                            $res0 = $this->regexMatch('parse_item_values/prop_imgs/prop/prop_img/title',$propimgblock,$resstr0);
                            if($res0 > 0) {
                                $propFinal->childs[$j]->name_zh = $resstr0[1];
                                $propFinal->childs[$j]->name = $resstr0[1];
                            }else {
                                $propFinal->childs[$j]->name_zh = '';
                                $propFinal->childs[$j]->name = '';
                            }
                            $resstr0 = array();
                            $res0 = $this->regexMatch('parse_item_values/prop_imgs/prop/prop_img/url',$propimgblock,$resstr0);
                            if ($res0 > 0) {$propFinal->childs[$j]->url = $resstr0[1];
                            } else {$propFinal->childs[$j]->url = '';}
                        }
                        unset($propimgblock);
                        unset($propimgresstr);
                    }
                    if (isset($pidvid)) {
                        $this->DSGItemRes->item->props[$pidvid[0]] = clone $propFinal;
                        unset($pidvid);
                        unset($propFinal);
                    }
                }
                unset($propblock);
                unset($propresstr);
            }
        }
		
		#kermit 2014-11-1 抓取天猫商店的信用等数据
		$res = preg_match('/id="dsr-ratelink" value="(.*)"\/\>/u',$data->data,$resstr);
        if($res){
			$url=$resstr[1];
			$rate_data=$this->getHttpDocument($url,$this->itemParams->url);
			$rate_data=$rate_data->data;
			$this->DSGItemRes->rate = new stdClass();
			$res = preg_match('/data-tnick\s*=\s*"(.+?)"/i', $rate_data, $resstr);
			if ($res > 0){$this->DSGItemRes->rate->nick = urldecode($resstr[1]);
			}else{$this->DSGItemRes->rate->nick ='';}
			#2014-11-1 kermit
			$res = preg_match('/\<div class="frame"\>\s*\<div class="list"\>卖家信用：(\d+?)\s*<a href="/s',$rate_data,$resstr);
			$this->DSGItemRes->rate->xinyong_fen=$res>0?urldecode($resstr[1]):'';
			$res = preg_match('/src="http:\/\/pics.taobaocdn.com\/newrank\/(.+?).gif"/u', $rate_data, $resstr);
			$this->DSGItemRes->rate->xinyong_star=$res>0?urldecode($resstr[1]):'';
			$res = preg_match('/\<li\>\s*所在地区\s*：\s*(.+?)\s*\<\/li\>/u', $rate_data, $resstr);
			$this->DSGItemRes->rate->diqu=$res>0?trim(str_replace('&nbsp;','',urldecode($resstr[1]))):'';
			$res = preg_match('/共\<span\>(\d*)\<\/span\>人/u',$rate_data,$resstr);
			$this->DSGItemRes->rate->point_number=$res>0?urldecode($resstr[1]):'';
			$res = preg_match('/宝贝与描述相符：\<\/span\>\s*\<em title="(\d*\.?\d*)分"/s',$rate_data,$resstr);
			$this->DSGItemRes->rate->point_miaosho=$res>0?urldecode($resstr[1]):'';
			$res = preg_match('/卖家的服务态度：\<\/span\>\s*\<em title="(\d*\.?\d*)分"/s',$rate_data,$resstr);
			$this->DSGItemRes->rate->point_fuwu=$res>0?urldecode($resstr[1]):'';
			$res = preg_match('/卖家发货的速度：\<\/span\>\s*\<em title="(\d*\.?\d*)分"/s',$rate_data,$resstr);
			$this->DSGItemRes->rate->point_fahuo=$res>0?urldecode($resstr[1]):'';
			$res = preg_match('/\<em style="color:gray;"\>好评率：(\d*\.\d*%)\<\/em\>/u',$rate_data,$resstr);
			$this->DSGItemRes->rate->haopinglv=$res>0?urldecode($resstr[1]):'';
			$res = preg_match('/id="\s*J_showShopStartDate\s*"\s*value="([\d\-]+?)"\s*\/>/u', $rate_data, $resstr);
			$this->DSGItemRes->rate->starttime=$res>0?urldecode($resstr[1]):'';
			$this->DSGItemRes->rate->shoptype='taobao';
			$res = preg_match_all('/dsr-item\s*"\s*\>(.+?)\s*\<\/li\>/u', $rate_data, $resstr);
			$this->DSGItemRes->rate->point=$res>0?urldecode($resstr[1]):'';
		}
        if (!$this->fromCart) {
            if (isset($this->DSGItemRes->item->tshop->api->descUrl)) {
                $this->DSGItemRes->item->desc = false; //$dldata->data;
                $this->DSGItemRes->item->descUrl = (string) $this->DSGItemRes->item->tshop->api->descUrl;
                unset ($dldata);
            }
        }
        if ($this->curlUseMulti) {
            $urls = array();
            if (!$this->fromCart) {
                if (isset($this->DSGItemRes->item->tshop->itemDO->itemId) && isset($this->DSGItemRes->item->tshop->itemDO->userId)) {
                    $_valReviewsApi = 'http://dsr.rate.tmall.com/list_dsr_info.htm?itemId='
                      . $this->DSGItemRes->item->tshop->itemDO->itemId.'&sellerId='.$this->DSGItemRes->item->tshop->itemDO->userId;
                    $urls[] = $_valReviewsApi;
                }
                $_apiRelateMarket = 'http://aldcdn.tmall.com/recommend.htm?itemId=' . $this->DSGItemRes->item->num_iid . '&refer=&rn=32&appId=03054';
                $urls[] = $_apiRelateMarket;
            }
            $_truePostage='http://detailskip.taobao.com/json/postageFee.htm?itemId='.$this->DSGItemRes->item->num_iid.'&areaId='.$this->postageArea;
            $urls[] = $_truePostage;
            $downloads = $this->getHttpDocumentArray($urls);
            if (isset($this->DSGItemRes->item->tshop->itemDO->itemId) && isset($this->DSGItemRes->item->tshop->itemDO->userId)) {
                if (isset($_valReviewsApi) && isset($downloads[$_valReviewsApi])) {
                    $this->DSGItemRes->item->valReviewsApi = $this->JavaScriptToJSON($downloads[$_valReviewsApi]->data,true);
                }
            }
            if (isset($_apiRelateMarket) && isset($downloads[$_apiRelateMarket])) {
                $downloads[$_apiRelateMarket]->data = preg_replace('/,{"acurl".*/s','',$downloads[$_apiRelateMarket]->data);
                $this->DSGItemRes->item->apiRelateMarket = $this->JavaScriptToJSON($downloads[$_apiRelateMarket]->data,true);
            }
            if (isset($_truePostage) && isset($downloads[$_truePostage])) {
                $this->DSGItemRes->item->truePostage = $downloads[$_truePostage]->data;
            }
        } else {
            //http://dsr.rate.tmall.com/list_dsr_info.htm?itemId=20008134785&sellerId=1714306514
            if (!$this->fromCart) {
                if (isset($this->DSGItemRes->item->tshop->itemDO->itemId) && isset($this->DSGItemRes->item->tshop->itemDO->userId)) {
                    $dldata = $this->getHttpDocument(
                      'http://dsr.rate.tmall.com/list_dsr_info.htm?itemId='
                      . $this->DSGItemRes->item->tshop->itemDO->itemId . '&sellerId='. $this->DSGItemRes->item->tshop->itemDO->userId);
                    $this->DSGItemRes->item->valReviewsApi = $this->JavaScriptToJSON($dldata->data, true);
                }
            }
            if (!$this->fromCart) {
                $url = 'http://aldcdn.tmall.com/recommend.htm?itemId=' . $this->DSGItemRes->item->num_iid . '&refer=&rn=32&appId=03054';
                $dldata = $this->getHttpDocument($url);
                $dldata->data = preg_replace('/,{"acurl".*/s', '', $dldata->data);
                $this->DSGItemRes->item->apiRelateMarket = $this->JavaScriptToJSON($dldata->data, true);
            }
            $url ='http://detailskip.taobao.com/json/postageFee.htm?itemId='.$this->DSGItemRes->item->num_iid.'&areaId='.$this->postageArea;
            $dldata = $this->getHttpDocument($url);
            $this->DSGItemRes->item->truePostage = $dldata->data;
        }
        //http://aldcdn.tmall.com/recommend.htm?itemId=20008134785&refer=&rn=32&appId=03054
        //http://tui.taobao.com/recommend?appid=32&count=32&itemid=26733820522
        if (isset($this->DSGItemRes->item->tshop->initApi)) {
            $initApiData =$this->getHttpDocument($this->DSGItemRes->item->tshop->initApi,false,false,'http://detail.tmall.com/item.htm?id='.$this->DSGItemRes->item->num_iid);
            $initApi=$this->JavaScriptToJSON($initApiData->data, true);
            unset($initApiData);
        }else {$initApi = new stdClass();}
        if(isset($this->DSGItemRes->item->truePostage)){
            $res=$this->regexMatch('parse_item_values/block_sib/express_fee', $this->DSGItemRes->item->truePostage, $resstr);
            if($res>0){
                if(!isset($resstr[2])){$this->DSGItemRes->item->express_fee = (float) $resstr[1];
                }else{$this->DSGItemRes->item->express_fee = 0;}
            }else {$this->DSGItemRes->item->express_fee = 0;}
            $res = $this->regexMatch('parse_item_values/block_sib/ems_fee', $this->DSGItemRes->item->truePostage, $resstr);
            if ($res > 0) {
                if (!isset($resstr[2])) {$this->DSGItemRes->item->ems_fee = (float) $resstr[1];
                }else {$this->DSGItemRes->item->ems_fee = 0;}
            } else {$this->DSGItemRes->item->ems_fee = 0;}
            if ($this->DSGItemRes->item->express_fee == 0) {
                $this->DSGItemRes->item->express_fee = max(
                  array(
                    $this->DSGItemRes->item->post_fee,
                    $this->DSGItemRes->item->express_fee
                  )
                );
            }
    	}else{
        $postage = 0;
        if (isset($initApi->defaultModel->deliveryDO->deliverySkuMap->default[0]->postage)) {
            $postage = $initApi->defaultModel->deliveryDO->deliverySkuMap->default[0]->postage;
            $res = preg_match('/([\d\.]+)/', $postage, $postages);
            if ($res > 0) {
                if (floatval($postages[1])) {
                    $postage = (float) $postages[1];
                } else {
                    $postage = 0;
                }
            } else {
                $postage = 0;
            }
        }
        unset($postages);
        $this->DSGItemRes->item->post_fee = $postage;
        $this->DSGItemRes->item->express_fee = $postage;
        $this->DSGItemRes->item->ems_fee = $postage;
    }
        //SKUs 
        $this->DSGItemRes->item->promotion_price = $this->DSGItemRes->item->price;
        if (isset($this->DSGItemRes->item->tshop->valItemInfo)) {
            if (isset($this->DSGItemRes->item->tshop->valItemInfo->skuMap)) {
                $this->DSGItemRes->item->skus = new stdClass();
                $srcSkuArray = (array) $this->DSGItemRes->item->tshop->valItemInfo->skuMap;
                $this->DSGItemRes->item->skus->sku = array();
                foreach ($srcSkuArray as $name => $val) {
                    $this->DSGItemRes->item->skus->sku[] = new stdClass();
                    end($this->DSGItemRes->item->skus->sku)->price = (float) $val->price;
                    end($this->DSGItemRes->item->skus->sku)->properties = trim($name, ';');
                    end($this->DSGItemRes->item->skus->sku)->properties_name = ''; // ???
                    end($this->DSGItemRes->item->skus->sku)->quantity = $val->stock;
                    if (end($this->DSGItemRes->item->skus->sku)->quantity == 99) {
                        end($this->DSGItemRes->item->skus->sku)->quantity = 0;
                    }
                    end($this->DSGItemRes->item->skus->sku)->sku_id = $val->skuId;
                    if (isset($initApi->defaultModel->itemPriceResultDO->priceInfo->{$val->skuId}->promotionList)) {
                        $promotions = $initApi->defaultModel->itemPriceResultDO->priceInfo->{$val->skuId}->promotionList;
                        $PromotionPriceArray = Array();
                        foreach ($promotions as $promotion) {
                            if (isset($promotion->price)) {
                                if ($promotion->price > 0) {$PromotionPriceArray[] = (float) $promotion->price;}
                            }
                        }
                        if (count($PromotionPriceArray) > 0) {$promotion_price = min($PromotionPriceArray);
                        } else {$promotion_price = 0;}
                        if ($promotion_price > 0) {end($this->DSGItemRes->item->skus->sku)->promotion_price = $promotion_price;
                        } else {end($this->DSGItemRes->item->skus->sku)->promotion_price = (float) $val->price;}
                    } elseif (isset($val->specPrice)) {
                        if($val->specPrice == ''){end($this->DSGItemRes->item->skus->sku)->promotion_price = (float) $val->price;

三、调用淘宝API接口获取产品详情数据-淘宝API封装

    原来开发的这套淘宝抓取程序可以使用淘宝API或者淘宝页面抓取两种方式，这里分享调用淘宝API提取淘宝和产品详情数据，包括产品的属性值信息等整个产品详情中所要用的数据。淘宝API需要授权的账号，我这里现在也没有可用的账号了，之后我会把这些程序都放到github上，本博客中的下载地址请进资源中搜索。源码如下：

#2014-12-03
#等同于TbData.PHP 将产品数据通过API接口获取和TbData.php取得的结构一样的数据
#将数据统一返回由日本服务器进行翻译

error_reporting(E_ALL ^ E_NOTICE);
set_time_limit(100);
date_default_timezone_set('Europe/Moscow');
!headers_sent() && header("Content-type:text/html;charset=utf-8");

class TbApiData{
	
	private $appId='11111111';
	private $appSecret='901f71b256f3841e920be005ca3aa6fd';
	private $id;
	private $start;
	public $cost;
	
	#实例化类，可入参产品ID
	public function __construct($product_id=0) {
		$this->id = $product_id;
		$this->start=microtime(true);
	}
	
	#返回格式化数据函数
	public function formatData($data,$promotion){
		
		#基础数据
		$dsgData=new stdClass();
		$dsgData->item=new stdClass();
		$dsgData->item->num_iid=$data['item_get_response']['item']['num_iid'];
		$dsgData->item->cid=$data['item_get_response']['item']['cid'];
		$dsgData->item->nick=$data['item_get_response']['item']['nick'];
		$dsgData->item->title=$data['item_get_response']['item']['title'];
		$dsgData->item->pic_url=$data['item_get_response']['item']['pic_url'];
		$dsgData->item->post_fee=$data['item_get_response']['item']['post_fee'];
		$dsgData->item->ems_fee=$data['item_get_response']['item']['ems_fee'];
		
		$dsgData->item->price=$data['item_get_response']['item']['price'];
		$dsgData->item->num=$data['item_get_response']['item']['num'];
		$dsgData->item->location=@implode('.',array_reverse($data['item_get_response']['item']['location']));
		$dsgData->item->item_imgs->item_img=array();
		
		#图片数据转化为对象
		if(isset($data['item_get_response']['item']['item_imgs']['item_img']) && $data['item_get_response']['item']['item_imgs']['item_img']){
			foreach($data['item_get_response']['item']['item_imgs']['item_img'] as $k=>$row){
				$dsgData->item->item_imgs->item_img[$k]=(object)$row;		
			}
		}
		
		#要替换的props数据整理
		$property_new=array();
		if(isset($data['item_get_response']['item']['property_alias']) && $data['item_get_response']['item']['property_alias']){
			$property_alias=explode(';',$data['item_get_response']['item']['property_alias']);
			foreach($property_alias as $k=>$value){
				list($pid,$vid,$vname)=explode(':',$value);
				$property_new[$pid.':'.$vid]=$vname;
			}
		}
		
		#预处理属性图片
		$property_img=array();
		if(isset($data['item_get_response']['item']['prop_imgs']['prop_img']) && $data['item_get_response']['item']['prop_imgs']['prop_img']){
			foreach($data['item_get_response']['item']['prop_imgs']['prop_img'] as $k=>$row){
				$property_img[$row['properties']]=$row['url'];
			}
		}
	
		#取item_attributes  返回props_name由翻译里执行
		/*$dsgData->item->item_attributes=array();
		if($data['item_get_response']['item']['props_name']){
			$props=explode(';',$data['item_get_response']['item']['props_name']);
			$prop_arr=array();
			foreach($props as $k=>$value){
				list($pid,$vid,$pname,$vname)=explode(':',$value);
				$key=array_search($pname,$prop_arr);
				#是否要替换
				$new_key=$pid.':'.$vid;
				if(isset($property_new[$new_key])) $vname=$property_new[$new_key];
				if($key!==false){
					$dsgData->item->item_attributes[$key]->val.=' '.$vname;
				}else{
					$dsgData->item->item_attributes[$k]=new stdClass();
					$dsgData->item->item_attributes[$k]->prop=$pname;
					$dsgData->item->item_attributes[$k]->val=$vname;
					$prop_arr[$k]=$pname;
				}
				
			}
		}*/
		
		#价格预拼接
		$sku_price=array();
		$dsgData->item->promotion_price='';  
		if(isset($promotion['ump_promotion_get_response']['promotions']['promotion_in_item']['promotion_in_item'][0])){
			$dsgData->item->promotion_price=$promotion['ump_promotion_get_response']['promotions']['promotion_in_item']['promotion_in_item'][0]['item_promo_price'];
			foreach($promotion['ump_promotion_get_response']['promotions']['promotion_in_item']['promotion_in_item'][0]['sku_id_list']['string'] as $k=>$skuid){
				$skuid=(string)$skuid;
				$sku_price[$skuid]=$promotion['ump_promotion_get_response']['promotions']['promotion_in_item']['promotion_in_item'][0]['sku_price_list']['price'][$k];
			}
		}
		
		#props拼接  #同时添加进SKU值
		$dsgData->item->props=array();
		
		$dsgData->item->skus->sku=array();
		if(isset($data['item_get_response']['item']['skus']) && $data['item_get_response']['item']['skus']){
			foreach($data['item_get_response']['item']['skus']['sku'] as $k=>$row){
				$prop_arr=explode(';',$row['properties_name']);
				#SKU入数据
				$sku_add=new stdClass();
				$sku_add->price=$row['price'];
				$sku_add->properties=$row['properties'];
				$sku_add->properties_name= '';
				$sku_add->quantity=$row['quantity'];
				$sku_add->sku_id =$row['sku_id'];
				$skukey=(string)$row['sku_id'];
				@$sku_add->promotion_price=$sku_price[$skukey];
				$dsgData->item->skus->sku[]=$sku_add;
				
				#PROPS入数据
				foreach($prop_arr as $sk=>$prop){
					list($pid,$vid,$pname,$vname)=explode(':',$prop);
					if(!isset($dsgData->item->props[$pid])){
						$dsgData->item->props[$pid]=new stdClass();
						$dsgData->item->props[$pid]->cid=$data['item_get_response']['item']['cid'];
						#$dsgData->item->props[$pid]->name_zh=
						$dsgData->item->props[$pid]->name=$pname;
						$dsgData->item->props[$pid]->childs=array();
					}
			
					#添加[childs]
					if(!isset($dsgData->item->props[$pid]->childs[$vid])){
						$childObj=new stdClass();
						$childObj->vid=$vid;
						#是否要替换
						$new_key=$pid.':'.$vid;
						if(isset($property_new[$new_key])) $vname=$property_new[$new_key];
						#$childObj->name_zh=
						$childObj->name=$vname;
						$childObj->url=isset($property_img[$new_key])?$property_img[$new_key]:'';
						$dsgData->item->props[$pid]->childs[$vid]=$childObj;
					}		
				}		
			}
		}
		
		#添加props_name以供翻译使用
		$dsgData->item->props_name=$data['item_get_response']['item']['props_name'];
		$dsgData->item->Apidesc=$data['item_get_response']['item']['desc'];
		$dsgData->item->desc=$this->clearHtml($data['item_get_response']['item']['desc']);
		$dsgData->item->Apidesc=NULL;
		
		$this->cost=microtime(true)-$this->start;
		return $dsgData;
	}

	#总调用接口
	public function MethodProduct($product_id){
		if(!$product_id) exit('no id');
		$this->id=$product_id;
		
		#第一步：调产品信息
		$result=$this->MethodItem($product_id);
		#第二步：调产品prop
		$promotion=$this->MethodProp($product_id);
		
		#测试展示API抓取数据
		#print_r($result);print_r($promotion);exit;		
		
		#第三步：组合产品结构
		$data=$this->formatData($result,$promotion);
		
		#第四步：取回产品RATE和sellerID值
		$RateData=$this->getRate();
		#print_r($RateData);exit;	
	
		#将rate值组合进Data
		$data->item->isTmall=$RateData->item->isTmall;
		$data->item->seller_id=$RateData->item->seller_id;
		if(!isset($data->item->cid) || $data->item->cid) $data->item->cid=$RateData->item->cid;
		if(!isset($data->item->shop_id) || $data->item->shop_id) $data->item->shop_id=$RateData->item->shop_id;
		if(!isset($data->item->post_fee) || $data->item->post_fee) $data->item->post_fee=$RateData->item->post_fee;
		if(!isset($data->item->express_fee) || $data->item->express_fee) $data->item->express_fee=$RateData->item->express_fee;
		if(!isset($data->item->ems_fee) || $data->item->ems_fee) $data->item->ems_fee=$RateData->item->ems_fee;
		if(!isset($data->item->num) || $data->item->num) $data->item->num=$RateData->item->num;
		$data->rate=$RateData->rate;
		
		$RateData=NULL;
		return $data;
		
	}
	
	#取产品详细信息接口
	public function MethodItem($product_id=0){
		!$product_id && $product_id=$this->id;
		if(!$product_id) return false;
		$paramArr=array(
			  'fields'=>'cid,seller_cids,props,input_pids,input_str,pic_url,num,location,price,item_img,prop_img,score,num_iid,title,nick,desc,sku,props_name,property_alias,item_weight,change_prop,sub_title,sold_quantity,shop_type,post_fee,ems_fee',
			  'num_iid' => $product_id
		);
		return $this->api('taobao.item.get',$paramArr);
	}
	
	#提取产品prop详细信息
	public function MethodProp($product_id=0){
		!$product_id && $product_id=$this->id;
		if(!$product_id) return false;
		$paramArrs=array(
			'item_id'=>$product_id
		);
		return $this->api('taobao.ump.promotion.get',$paramArrs);
	}
	
	#底层调取淘宝接口
	public function api($method,$params=array()){
		#数据拼接
		$params=array_merge(array(
			'app_key' 	=> $this->appId,
			'method' 	=> $method,
			'session' 	=> '',
			'format' 	=> 'json',
			'v'			=> '2.0',
			'partner_id'=> 'top-sdk-php-20131101',
			'timestamp' => date('Y-m-d H:i:s'),
			'sign_method'=> 'md5'
		),$params);
		$params['sign']=$this->createSign($params,$this->appSecret);
		#执行调用
		$result = $this->makeRequest('http://gw.api.taobao.com/router/rest',$params);
		return $result;
	}
	
	#远程CURL
	 private function makeRequest($url,$params,$method ='GET') {
		$ch = curl_init();
		$opts = array(
			CURLOPT_CONNECTTIMEOUT => 10,
			CURLOPT_RETURNTRANSFER => true,
			CURLOPT_TIMEOUT => 60
		);
		if($method == 'POST') {
		  $opts[CURLOPT_URL] = $url;
		  $opts[CURLOPT_POST] = true;
		  $opts[CURLOPT_POSTFIELDS] = $params;
		} elseif ($method == 'GET') {
		  $opts[CURLOPT_URL]=$url.'?'.$this->createStrParam($params);
		}
		curl_setopt_array($ch,$opts);
		$result=curl_exec($ch);
		curl_close($ch);
		return json_decode($result,true);
	}
	 
	#生成SIGN值
	private static function createSign($params=array(),$appSecret){
		ksort($params);
		$sign = $appSecret;
		foreach ($params as $key => $val) {
		    if(($key != '' && $val != '') || $val === 0) {
				$sign .= $key . $val;
		    }
		}
		return strtoupper(md5($sign . $appSecret));
	}
	
	#参数拼接
	private function createStrParam($params) {
   		$query = array();
		foreach ($params as $key => $val) {
		    if(($key!='' && $val != '') || $val === 0){
				$query[]=$key.'='.urlencode($val);
			}
		}
		return implode('&', $query);
    }
	
	#处理DESC中的html
	public function clearHtml($content){
		if($content=='') return $content;
		$content = preg_replace("/<a.*?/a>/i", "", $content);
		preg_match_all ("/<img[^>]*>/i", $content, $images);;
		$content = strip_tags($content);
		
		if (is_array($images) && count($images) > 0){
			$images = implode("n", $images[0]) . "n";
		}else{
			$images = '';
		}
		return $images;
	}
	
	#抓取产品rate和sellerID值
	public function getRate(){
		require('TbRateData.php');
		$TbRateData=new TbRateData();
		return $TbRateData->getData(array('id'=>$this->id));
	}
	
}
	
#接受产品ID
$id=isset($_POST['product_id'])?$_POST['product_id']:'';
if(!$id) $id=isset($_GET['product_id'])?$_GET['product_id']:'';
if($id){
	$TbApiData=new TbApiData();
	$data=$TbApiData->MethodProduct($id);
	#echo '<pre>';print_r($data);echo '</pre>';exit;
	echo gzcompress(serialize($data),9);
}else{
	echo gzcompress(serialize(array('error'=>'no id value!')));
}
林戈的IT生涯
关注
  • 16
    点赞
  • 踩
  • 7
    收藏
    觉得还不错? 一键收藏
  • 打赏
    打赏
  • 2
    评论
专栏目录
调用淘宝API接口获取产品详情数据-淘宝API封装 TbApiData.zip
06-17
调用淘宝API接口获取产品详情数据-淘宝API封装 TbApiData.zip 。 原来开发的这套淘宝抓取程序可以使用淘宝API或者淘宝页面抓取两种方式，这里分享调用淘宝API提取淘宝和产品详情数据，包括产品的属性值信息等整个...
淘宝天猫商品详情API接口（商品详情页面数据接口，商品销量接口）
07-28
淘宝商品详情API接口，淘宝商品销量接口，淘宝商品价格接口，淘宝商品列表接口，淘宝商品数据列表接口，淘宝关键词搜索列表接口，淘宝APP详情接口，淘宝APP商品详情接口，淘宝H5详情接口，天猫商品详情API接口，天猫...
1688商品详情API接口（item_get-获得1688商品详情接口）
Andyfu2019的博客
07-07 927
通过商品ID请求封装接口1688商品详情接口，1688详情API接口，1688sku价格接口，1688详情属性接口，1688销量接口等可以获取到详情页面上的参数数据包括：商品标题，商品图片，sku价格，区间价，最小起批量，库存，属性图片，详情图，销量，店铺昵称，商品所在地等页面上有的数据均可以拿到，大家都知道，1688的反爬虫机制十分严，而很多时候，没办法高效的拿到数据内容响应终端需求，而依赖爬虫就会造成动不动就出现滑块验证，让人很无解，正好，公司有这样的需求，让我负责解决这个问题，刚开始各种尝试，始终没有
JS逆向批改网实现自动提交作文 调用文心一言API自动生成作文
最新发布
wuyubo197的博客
06-15 1120
抓到了数据包，这里应该会返回我没写完作文的所有信息，但是因为我的作文全部用这个脚本秒了，所以啥都没看到，这里我是用xpath的方法批量提取我没完成作文的所有作文编号，并存在一个列表中。前天熬了个大夜，下午一点才起，一听到舍友说又要写那个恶心的批改网，气得我直接写了个脚本自动把所有未完成的作文秒杀，话不多说直接开始分析。原来是我们验证通过后，服务器会直接给我们重定向到登陆的主界面，若我们不禁止重定向，就无法抓取到能验证我们身份的cookies。直接调用main函数，并传入作文题目，就能返回对应的文章了。
Python爬取网站数据
qq_45601874的博客
03-17 4206
Python爬取网站数据 前言 什么是爬虫？ 通过编写程序，模拟浏览器上网，然后让其去互联网上抓取数据的过程 爬虫合法还是违法？ 在法律上是不被禁止的 但是也有违法风险 爬虫带来的风险可以体现在如下2方面 爬虫干扰了被访问网站的正常运行 爬虫抓取了受到法律保护的特定类型的数据或信息 如果在使用编写爬虫的过程中避免违法 经常的优化自己的程序，避免干扰被访问网站的正常运行 在使用、传播爬取到的数据时，审查抓取到的内容 如果发现涉及到用户隐私或者商业机密等敏感内容 需要及时停止爬取并及时进行删除
android安卓源码海量项目合集打包-1
热门推荐
chenhao0568的专栏
06-11 13万+
下载地址 最后更新共计113个分类5177套源码29.2 GB。 卷 新加卷 的文件夹 PATH 列表 卷序列号为 00000200 5E7A:7F30 F:. ├─前台界面 │ ├─3D标签云卡片热门 │ │ Android TagCloudView云标签的灵活运用.rar │ │ Android 实现 标签 拖动 改变位置.rar │ │ android 流式布局和热门标签.zip │ │ ...
PHP调用接口京东API封装的例子（ 获得JD商品详情，按关键字搜索商品， 按图搜索京东商品（拍立淘），获得店铺）
电商数据Girl的博客
05-27 1328
POST和GET是HTTP协议中两种最基本的请求方式。其主要差别在于传参方式、数据大小等方面，下面做详细介绍：1. GET（获取）：从服务器获取资源或数据当一个GET请求发生时，客户端发送一个请求给服务端，服务端会返回请求的内容。这个请求可以使用一个URL地址，在该地址后添加查询参数。2. POST（提交）：向服务器提交数据并让其处理当一个POST请求发生时，客户端将一个请求发送到服务端，并且包含了所有要提交的数据。这些数据可以位于HTML表单中，或者是通过JavaScript打包。
京东商品链接获取京东商品详情数据接口（用 Python 实现京东商品信息抓取）
weixin_19970108018的博客
10-10 508
在网页抓取方面，可以使用 Python、Java 等编程语言编写程序，通过模拟 HTTP 请求，获取京东网站上的商品页面。在数据提取方面，可以使用正则表达式、XPath 等方式从 HTML 代码中提取出有用的信息。值得注意的是，京东网站的页面结构会不断更新，因此需要定期更新程序，以保证数据的准确性。（2）避免被封 IP。京东平台对于频繁访问的 IP 地址会进行封锁，因此需要合理规划访问频率，避免被封 IP。（1）保证数据的准确性。京东平台上的商品信息会不断更新，因此需要定期更新程序，以保证数据的准确性。
爬虫数据采集基础
m0_46427459的博客
06-28 6216
1
2021-07-02 swift大礼包
一个帅气潇洒的豆子
07-02 5952
全面的Swift学习资料整理_walkerwqp的博客-CSDN博客 全面的Swift学习资料整理 ...
爬虫笔记
小僵尸打字员的博客
01-12 3494
e1.HTTP和HTTPS HTTP协议（HyperText Transfer Protocol，超文本传输协议）：是一种发布和接收 HTML页面的方法。 HTTPS（Hypertext Transfer Protocol over Secure Socket Layer）简单讲是HTTP的安全版，在HTTP下加入SSL层。 SSL（Secure Sockets Layer 安全套接层）主要
Crawler-淘宝京东详情页图片抓取-1.1.0.zip
12-30
名称：Crawler-淘宝京东详情页图片抓取 -------------------- 版本：1.1.0 作者：lcs584911924 分类：其他 -------------------- 概述：使用这个附加组件，可以便捷的将国内主要的电商平台：淘宝、天猫、京东的...
php curl抓取网页的介绍和推广及使用CURL抓取淘宝页面集成方法
10-23
抓取网页内容，分析网页数据经常使用php curl，简洁易用，本篇文章通过代码实例给大家讲解 php curl抓取网页的介绍和推广及使用CURL抓取淘宝页面集成方法，需要的朋友参考下
新浪财经API接口获取期货实时秒级行情数据的Python源代码
08-08
最近学习Python进行量化交易，第一步是获取实时行情数据，本资源是从新浪财经API接口获取期货实时行情数据的Python源代码（本代码获得的数据不再仅是5分钟行情数据，而是秒级行情更新，行情刷新间隔视网速及获取品种...
js代码-淘宝详情页抓取
07-16
js代码-淘宝详情页抓取
PHP抓取淘宝商品的用户晒单评论+图片+搜索商品列表实例
10-22
下面是小编在前段时间做淘宝客引发的一些思考，有关PHP抓取淘宝商品的用户晒单评论+图片实例的方法，需要的朋友参考下吧
python按综合、销量排序抓取100页的淘宝商品列表信息
09-20
主要为大家详细介绍了python按综合、销量排序抓取100页的淘宝商品列表信息，具有一定的参考价值，感兴趣的小伙伴们可以参考一下
替代chatGPT，很火的聊天插件BITO的api接口封装
06-17
很火的BITO插件，逆向抓取了api接口，仅供学习研究用途。 终于有不限次数且完全免费的AI聊天接口啦，速度也是杠杠的。 提供项目完整源码，直接可运行，启动一个http接口服务。 基于golang的，不但封装了bito接口，还...
Python抓取API接口数据到excel中
03-26
以下是一个示例代码，用于Python抓取API接口数据并将其存储到Excel中： ```python # 导入必要的库 import requests import pandas as pd # 指定API接口URL和参数 url = "https://api.example.com/data" params = {...

“相关推荐”对你有帮助么？

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论 2
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包

打赏作者

林戈的IT生涯

你的鼓励将是我创作的最大动力

¥1 ¥2 ¥4 ¥6 ¥10 ¥20
扫码支付：¥1
获取中
扫码支付

您的余额不足，请更换扫码支付或充值

打赏作者

实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值