通过google hack技术抓取连接,再通过python script来处理这些信息
为后续的test和exploit做准备吧.
github: https://github.com/meibenjin/GoogleSearchCrawler/blob/master/gsearch.py
http://bbs.csdn.net/topics/370248049
通过调用google api来解决问题相关代码
http://www.zhihu.com/question/24111766
google搜索出的典型模块
<li class="g"><!--m--><div class="rc" data-hveid="39"><h3 class="r"><a href="https://www.facebook.com/nl.action" οnmοusedοwn="return rwt(this,'','','','2','AFQjCNHlx7o2tDXhBb940-Dr7f1Q3oGMIA','_56cxo_8tXXrr6UsYR8tLw','0CCgQFjAB','','',event)" target="_blank">Action - Zwaagdijk-Oost, Noord-Holland, Netherlands ...</a></h3><div class="s"><div><div class="f kv _SWb" style="white-space:nowrap"><cite class="_Rm">https://www.facebook.com/nl.action</cite><div class="action-menu ab_ctl"><a class="_Fmb ab_button" href="#" id="am-b1" aria-label="搜尋結果的詳細資訊" aria-expanded="false" aria-haspopup="true" role="button" jsaction="ab.tdd;keydown:ab.hbke;keypress:ab.mskpe" data-ved="0CCkQ7B0wAQ"><span class="mn-dwn-arw"></span></a><div class="action-menu-panel ab_dropdown" role="menu" tabindex="-1" jsaction="keydown:ab.hdke;mouseover:ab.hdhne;mouseout:ab.hdhue" data-ved="0CCoQqR8wAQ"><ul><li class="action-menu-item ab_dropdownitem" role="menuitem"><a class="fl" href="http://webcache.googleusercontent.com/search?q=cache:CEXX4vG-Oh0J:https://www.facebook.com/nl.action+&cd=2&hl=zh-TW&ct=clnk&gl=us" οnmοusedοwn="return rwt(this,'','','','2','AFQjCNE6HR3jKjn-tZLGkyMvIwTlBW2NAA','uTEKs_nyKDMLTNdQBo6AWQ','0CCsQIDAB','','',event)" target="_blank">頁庫存檔</a></li><li class="action-menu-item ab_dropdownitem" role="menuitem"><a class="fl" href="/search?newwindow=1&espv=2&biw=1024&bih=643&q=related:https://www.facebook.com/nl.action&tbo=1&sa=X&ei=ogRMVdLXK4_0oASaz4GQCg&ved=0CCwQHzAB">類似內容</a></li></ul></div></div><a class="fl" href="http://translate.google.com/translate?hl=zh-TW&sl=nl&u=https://www.facebook.com/nl.action&prev=search" οnmοusedοwn="return rwt(this,'','','','2','AFQjCNFcPYw5AUmdqdgtX5nYQEB2JdQpjA','-rKUqJLxTzUKlVLAs3MivA','0CC4Q7gEwAQ','','',event)" target="_blank">翻譯這個網頁</a></div><span class="st">Action, Zwaagdijk-Oost, Noord-Holland, Netherlands. 33295 likes · 1967 talking about this. Welkom op de Facebookpagina van Action. Stel hier je vragen...</span></div></div></div><!--n--></li>