Java如何爬虫奥运奖牌榜数据，恭喜中国获得东京奥运会首金！

2020年的东京奥运会在2021年7月23日开幕了。

2021年7月24日上午，中国的00后选手杨倩，获得了女子10米气步枪的金牌，未来可期，恭喜！

看到如此激动人心的消息，你是否想要获取奥运会的奖牌榜数据呢?

本文带你使用Java>>>来进行爬虫获取2020年东京奥运奖牌榜的数据。

首金

然后我们可以打开浏览器的调试工具，查看网络请求并分析源代码，然后找到如下相关的代码：

页面配置

通过对变量的分析与判断，可以知道了4个URL信息，即国家的信息、比赛项目的信息、比赛日期的信息、奖牌榜数据的信息。

对于截图中的medalPage.js文件，通过分析可以知道是负责处理奖牌榜相关请求与页面渲染的主要文件，感兴趣的深入学习研究。

我们可以通过浏览器单独访问这几个接口，获得相关返回的JSON数据，各个请求如下：

国家请求：

{"result":{"status":{"code":0,"msg":"olympic country"},"timestamp":"Thu Aug 05 10:56:20 +0800 2021","data":{"AFG":"\u963f\u5bcc\u6c57","AHO":"\u8377\u5c5e\u5b89\u7684\u5217\u65af","AIA":"\u5b89\u572d\u62c9","ALA":"\u5965\u5170\u7fa4\u5c9b","ALB":"\u963f\u5c14\u5df4\u5c3c\u4e9a","ALG":"\u963f\u5c14\u53ca\u5229\u4e9a","AND":"\u5b89\u9053\u5c14","ANG":"\u5b89\u54e5\u62c9","ANT":"\u5b89\u63d0\u74dc\u548c\u5df4\u5e03\u8fbe","ANZ":"\u6fb3\u6d32\/\u65b0\u897f\u5170","ARG":"\u963f\u6839\u5ef7","ARM":"\u4e9a\u7f8e\u5c3c\u4e9a","ARU":"\u963f\u9c81\u5df4","ASA":"\u7f8e\u5c5e\u8428\u6469\u4e9a","ATA":"\u5357\u6781\u6d32","ATF":"\u6cd5\u5c5e\u5357\u90e8\u9886\u5730","AUS":"\u6fb3\u5927\u5229\u4e9a","AUT":"\u5965\u5730\u5229","AZE":"\u963f\u585e\u62dc\u7586","BAH":"\u5df4\u54c8\u9a6c","BAN":"\u5b5f\u52a0\u62c9\u56fd","BAR":"\u5df4\u5df4\u591a\u65af","BDI":"\u5e03\u9686\u8fea","BEL":"\u6bd4\u5229\u65f6","BEN":"\u8d1d\u5b81","BER":"\u767e\u6155\u5927","BES":"\u6ce2\u5167\u8d6b\u3001\u5723\u5c24\u65af\u7279\u6b47\u65af\u548c\u8428\u5df4","BHU":"\u4e0d\u4e39","BIH":"\u6ce2\u9ed1","BIZ":"\u4f2f\u5229\u5179","BLM":"\u5723\u5df4\u6cf0\u52d2\u7c73\u5c9b","BLR":"\u767d\u4fc4\u7f57\u65af","BOL":"\u73bb\u5229\u7ef4\u4e9a","BOT":"\u535a\u8328\u74e6\u7eb3","BRA":"\u5df4\u897f","BRN":"\u5df4\u6797","BRU":"\u6587\u83b1","BUL":"\u4fdd\u52a0\u5229\u4e9a","BUR":"\u5e03\u57fa\u7eb3\u6cd5\u7d22","BVT":"\u5e03\u97e6\u5c9b","CAF":"\u4e2d\u975e","CAM":"\u67ec\u57d4\u5be8","CAN":"\u52a0\u62ff\u5927","CAY":"\u5f00\u66fc\u7fa4\u5c9b","CCK":"\u79d1\u79d1\u65af\uff08\u57fa\u6797\uff09\u7fa4\u5c9b","CGO":"\u521a\u679c\uff08\u5e03\uff09","CHA":"\u4e4d\u5f97","CHI":"\u667a\u5229","CHN":"\u4e2d\u56fd","CIS":"\u72ec\u7acb\u56fd\u5bb6\u8054\u5408\u4f53","CIV":"\u79d1\u7279\u8fea\u74e6","CMR":"\u5580\u9ea6\u9686","COD":"\u521a\u679c\uff08\u91d1\uff09","COK":"\u5e93\u514b\u7fa4\u5c9b","COL":"\u54e5\u4f26\u6bd4\u4e9a","COM":"\u79d1\u6469\u7f57","COR":"\u671d\u9c9c","CPV":"\u4f5b\u5f97\u89d2","CRC":"\u54e5\u65af\u8fbe\u9ece\u52a0","CRO":"\u514b\u7f57\u5730\u4e9a","CUB":"\u53e4\u5df4","CUW":"\u5e93\u62c9\u7d22","CXR":"\u5723\u8bde\u5c9b","CYP":"\u585e\u6d66\u8def\u65af","CZE":"\u6377\u514b","DEN":"\u4e39\u9ea6","DJI":"\u5409\u5e03\u63d0","DMA":"\u591a\u7c73\u5c3c\u514b","DOM":"\u591a\u7c73\u5c3c\u52a0","ECU":"\u5384\u74dc\u591a\u5c14","EGY":"\u57c3\u53ca","EOR":"\u96be\u6c11\u4ee3\u8868\u56e2","ERI":"\u5384\u7acb\u7279\u91cc\u4e9a","ESA":"\u8428\u5c14\u74e6\u591a","ESH":"\u897f\u6492\u54c8\u62c9","ESP":"\u897f\u73ed\u7259","EST":"\u7231\u6c99\u5c3c\u4e9a","ETH":"\u57c3\u585e\u4fc4\u6bd4\u4e9a","EUN":"\u8054\u5408\u961f","FIJ":"\u6590\u6d4e","FIN":"\u82ac\u5170","FLK":"\u798f\u514b\u5170\u7fa4\u5c9b","FRA":"\u6cd5\u56fd","FRG":"\u8054\u90a6\u5fb7\u56fd","FRO":"\u6cd5\u7f57\u7fa4\u5c9b","FSM":"\u5bc6\u514b\u7f57\u5c3c\u897f\u4e9a","GAB":"\u52a0\u84ec","GAM":"\u5188\u6bd4\u4e9a","GBR":"\u82f1\u56fd","GBS":"\u51e0\u5185\u4e9a\u6bd4\u7ecd","GDR":"\u6c11\u4e3b\u5fb7\u56fd","GEO":"\u683c\u9c81\u5409\u4e9a","GEQ":"\u8d64\u9053\u51e0\u5185\u4e9a","GER":"\u5fb7\u56fd","GGY":"\u6839\u897f","GHA":"\u52a0\u7eb3","GIB":"\u76f4\u5e03\u7f57\u9640","GLP":"\u74dc\u5fb7\u7f57\u666e","GRE":"\u5e0c\u814a","GRL":"\u683c\u9675\u5170","GRN":"\u683c\u6797\u7eb3\u8fbe","GUA":"\u5371\u5730\u9a6c\u62c9","GUF":"\u6cd5\u5c5e\u572d\u4e9a\u90a3","GUI":"\u51e0\u5185\u4e9a","GUM":"\u5173\u5c9b","GUY":"\u572d\u4e9a\u90a3","HAI":"\u6d77\u5730","HKG":"\u4e2d\u56fd\u9999\u6e2f","HMD":"\u8d6b\u5fb7\u5c9b\u548c\u9ea6\u514b\u5510\u7eb3\u7fa4\u5c9b","HON":"\u6d2a\u90fd\u62c9\u65af","HUN":"\u5308\u7259\u5229","IMN":"\u9a6c\u6069\u5c9b","INA":"\u5370\u5ea6\u5c3c\u897f\u4e9a","IND":"\u5370\u5ea6","IOA":"\u72ec\u7acb\u5965\u6797\u5339\u514b\u8fd0\u52a8\u5458","IOP":"\u72ec\u7acb\u5965\u6797\u5339\u514b\u53c2\u8d5b\u8005","IOT":"\u82f1\u5c5e\u5370\u5ea6\u6d0b\u9886\u5730","IPA":"\u72ec\u7acb\u6b8b\u5965\u8fd0\u52a8\u5458","IPP":"\u72ec\u7acb\u6b8b\u5965\u53c2\u8d5b\u8005","IRI":"\u4f0a\u6717","IRL":"\u7231\u5c14\u5170","IRQ":"\u4f0a\u62c9\u514b","ISL":"\u51b0\u5c9b","ISR":"\u4ee5\u8272\u5217","ISV":"\u7f8e\u5c5e\u7ef4\u5c14\u4eac\u7fa4\u5c9b","ITA":"\u610f\u5927\u5229","IVB":"\u82f1\u5c5e\u7ef4\u5c14\u4eac\u7fa4\u5c9b","JAM":"\u7259\u4e70\u52a0","JER":"\u6cfd\u897f\u5c9b","JOR":"\u7ea6\u65e6","JPN":"\u65e5\u672c","KAZ":"\u54c8\u8428\u514b\u65af\u5766","KEN":"\u80af\u5c3c\u4e9a","KGZ":"\u5409\u5c14\u5409\u65af\u65af\u5766","KIR":"\u57fa\u91cc\u5df4\u65af","KOR":"\u97e9\u56fd","KOS":"\u79d1\u7d22\u6c83","KSA":"\u6c99\u7279\u963f\u62c9\u4f2f","KUW":"\u79d1\u5a01\u7279","LAO":"\u8001\u631d","LAT":"\u62c9\u8131\u7ef4\u4e9a","LBA":"\u5229\u6bd4\u4e9a","LBN":"\u9ece\u5df4\u5ae9","LBR":"\u5229\u6bd4\u91cc\u4e9a","LCA":"\u5723\u5362\u897f\u4e9a","LES":"\u83b1\u7d22\u6258","LIE":"\u5217\u652f\u6566\u58eb\u767b","LTU":"\u7acb\u9676\u5b9b","LUX":"\u5362\u68ee\u5821","MAC":"\u4e2d\u56fd\u6fb3\u95e8","MAD":"\u9a6c\u8fbe\u52a0\u65af\u52a0","MAF":"\u6cd5\u5c5e\u5723\u9a6c\u4e01","MAR":"\u6469\u6d1b\u54e5","MAS":"\u9a6c\u6765\u897f\u4e9a","MAW":"\u9a6c\u62c9\u7ef4","MDA":"\u6469\u5c14\u591a\u74e6","MDV":"\u9a6c\u5c14\u4ee3\u592b","MEX":"\u58a8\u897f\u54e5","MGL":"\u8499\u53e4","MHL":"\u9a6c\u7ecd\u5c14\u7fa4\u5c9b","MKD":"\u5317\u9a6c\u5176\u987f","MLI":"\u9a6c\u91cc","MLT":"\u9a6c\u8033\u4ed6","MNE":"\u9ed1\u5c71","MNP":"\u5317\u9a6c\u91cc\u4e9a\u7eb3\u7fa4\u5c9b","MON":"\u6469\u7eb3\u54e5","MOZ":"\u83ab\u6851\u6bd4\u514b","MRI":"\u6bdb\u91cc\u6c42\u65af","MSR":"\u8499\u585e\u62c9\u7279\u5c9b","MTN":"\u6bdb\u91cc\u5854\u5c3c\u4e9a","MTQ":"\u9a6c\u63d0\u5c3c\u514b","MYA":"\u7f05\u7538","MYT":"\u9a6c\u7ea6\u7279","NAM":"\u7eb3\u7c73\u6bd4\u4e9a","NCA":"\u5c3c\u52a0\u62c9\u74dc","NCL":"\u65b0\u5580\u91cc\u591a\u5c3c\u4e9a","NED":"\u8377\u5170","NEP":"\u5c3c\u6cca\u5c14","NFK":"\u8bfa\u798f\u514b\u5c9b","NGR":"\u5c3c\u65e5\u5229\u4e9a","NIG":"\u5c3c\u65e5\u5c14","NIU":"\u7ebd\u57c3","NOR":"\u632a\u5a01","NRU":"\u7459\u9c81","NZL":"\u65b0\u897f\u5170","OMA":"\u963f\u66fc","PAK":"\u5df4\u57fa\u65af\u5766","PAN":"\u5df4\u62ff\u9a6c","PAR":"\u5df4\u62c9\u572d","PCN":"\u76ae\u7279\u51ef\u6069\u7fa4\u5c9b","PER":"\u79d8\u9c81","PHI":"\u83f2\u5f8b\u5bbe","PLE":"\u5df4\u52d2\u65af\u5766","PLW":"\u5e15\u52b3","PNG":"\u5df4\u5e03\u4e9a\u65b0\u51e0\u5185\u4e9a","POL":"\u6ce2\u5170","POR":"\u8461\u8404\u7259","PRK":"\u671d\u9c9c","PUR":"\u6ce2\u591a\u9ece\u5404","PYF":"\u6cd5\u5c5e\u6ce2\u5229\u5c3c\u897f\u4e9a","QAT":"\u5361\u5854\u5c14","REU":"\u7559\u5c3c\u6c6a","ROC":"ROC","ROU":"\u7f57\u9a6c\u5c3c\u4e9a","RSA":"\u5357\u975e","RUS":"\u4fc4\u7f57\u65af","RWA":"\u5362\u65fa\u8fbe","SAM":"\u8428\u6469\u4e9a","SCG":"\u585e\u9ed1","SEN":"\u585e\u5185\u52a0\u5c14","SEY":"\u585e\u820c\u5c14","SGP":"\u65b0\u52a0\u5761","SGS":"\u5357\u4e54\u6cbb\u4e9a\u5c9b&\u5357\u6851\u5a01\u5947\u7fa4\u5c9b","SHN":"\u5723\u8d6b\u52d2\u62ff\u5c9b","SJM":"\u65af\u74e6\u5df4\u548c\u626c\u9a6c\u5ef6","SKN":"\u5723\u57fa\u8328\u548c\u5c3c\u7ef4\u65af","SLE":"\u585e\u62c9\u5229\u6602","SLO":"\u65af\u6d1b\u6587\u5c3c\u4e9a","SMR":"\u5723\u9a6c\u529b\u8bfa","SOL":"\u6240\u7f57\u95e8\u7fa4\u5c9b","SOM":"\u7d22\u9a6c\u91cc","SPM":"\u5723\u76ae\u57c3\u5c14\u548c\u5bc6\u514b\u9686","SRB":"\u585e\u5c14\u7ef4\u4e9a","SRI":"\u65af\u91cc\u5170\u5361","SSD":"\u5357\u82cf\u4e39","STP":"\u5723\u591a\u7f8e & \u666e\u6797\u897f\u6bd4","SUD":"\u82cf\u4e39","SUI":"\u745e\u58eb","SUR":"\u82cf\u91cc\u5357","SVK":"\u65af\u6d1b\u4f10\u514b","SWE":"\u745e\u5178","SWZ":"\u65af\u5a01\u58eb\u5170","SXM":"\u8377\u5c5e\u5723\u9a6c\u4e01","SYR":"\u53d9\u5229\u4e9a","TAN":"\u5766\u6851\u5c3c\u4e9a","TCA":"\u7279\u514b\u65af\u548c\u51ef\u79d1\u65af\u7fa4\u5c9b","TCH":"\u6377\u514b\u65af\u6d1b\u4f10\u514b","TGA":"\u6c64\u52a0","THA":"\u6cf0\u56fd","TJK":"\u5854\u5409\u514b\u65af\u5766","TKL":"\u6258\u514b\u52b3","TKM":"\u571f\u5e93\u66fc\u65af\u5766","TLS":"\u4e1c\u5e1d\u6c76","TOG":"\u591a\u54e5","TPE":"\u4e2d\u56fd\u53f0\u5317","TTO":"\u7279\u7acb\u5c3c\u8fbe & \u591a\u5df4\u54e5","TUN":"\u7a81\u5c3c\u65af","TUR":"\u571f\u8033\u5176","TUV":"\u56fe\u74e6\u5362","UAE":"\u963f\u8054\u914b","UGA":"\u4e4c\u5e72\u8fbe","UKR":"\u4e4c\u514b\u5170","UMI":"\u7f8e\u56fd\u672c\u571f\u5916\u5c0f\u5c9b\u5c7f","URS":"\u82cf\u8054","URU":"\u4e4c\u62c9\u572d","USA":"\u7f8e\u56fd","UZB":"\u4e4c\u5179\u522b\u514b\u65af\u5766","VAN":"\u74e6\u52aa\u963f\u56fe","VAT":"\u68b5\u8482\u5188\u57ce\u56fd","VEN":"\u59d4\u5185\u745e\u62c9","VIE":"\u8d8a\u5357","VIN":"\u5723\u6587\u68ee\u7279\u548c\u683c\u6797\u7eb3\u4e01\u65af","WLF":"\u74e6\u5229\u65af\u548c\u5bcc\u56fe\u7eb3\u7fa4\u5c9b","XXA":"\u65e0\u56fd\u7c4d","XXB":"\u96be\u6c11","YEM":"\u4e5f\u95e8","YUG":"\u5357\u65af\u62c9\u592b","ZAM":"\u8d5e\u6bd4\u4e9a","ZIM":"\u6d25\u5df4\u5e03\u97e6"}}}

比赛项目请求：

{"result":{"status":{"code":0,"msg":"olympic discipline"},"timestamp":"Thu Aug 05 10:56:27 +0800 2021","data":{"SHO":"\u5c04\u51fb","ARC":"\u5c04\u7bad","FBL":"\u8db3\u7403","BKB":"\u7bee\u7403","BK3":"\u4e09\u5bf9\u4e09\u7bee\u7403","ATH":"\u7530\u5f84","SWM":"\u6e38\u6cf3","SWA":"\u82b1\u6837\u6e38\u6cf3","OWS":"\u9a6c\u62c9\u677e\u6e38\u6cf3","WLF":"\u4e3e\u91cd","DIV":"\u8df3\u6c34","VVO":"\u6392\u7403","VBV":"\u6c99\u6ee9\u6392\u7403","TTE":"\u4e52\u4e53\u7403","BDM":"\u7fbd\u6bdb\u7403","GTR":"\u8e66\u5e8a","GAR":"\u7ade\u6280\u4f53\u64cd","GRY":"\u827a\u672f\u4f53\u64cd","BOX":"\u62f3\u51fb","JUD":"\u67d4\u9053","WRE":"\u6454\u8de4","TKW":"\u8dc6\u62f3\u9053","KTE":"\u7a7a\u624b\u9053","HBL":"\u624b\u7403","WPO":"\u6c34\u7403","MTB":"\u5c71\u5730\u81ea\u884c\u8f66","CRD":"\u516c\u8def\u81ea\u884c\u8f66","CTR":"\u573a\u5730\u81ea\u884c\u8f66","BMF":"\u5c0f\u8f6e\u8f66\u81ea\u7531\u8d5b","BMX":"\u5c0f\u8f6e\u8f66\u8d8a\u91ce\u8d5b","SRF":"\u51b2\u6d6a","ROW":"\u8d5b\u8247","CSP":"\u76ae\u5212\u8247-\u9759\u6c34","CSL":"\u76ae\u5212\u8247-\u6fc0\u6d41\u56de\u65cb","SAL":"\u5e06\u8239\u5e06\u677f","EQU":"\u9a6c\u672f","TEN":"\u7f51\u7403","GLF":"\u9ad8\u5c14\u592b","TRI":"\u94c1\u4eba\u4e09\u9879","MPN":"\u73b0\u4ee3\u4e94\u9879","CLB":"\u6500\u5ca9","SKB":"\u6ed1\u677f","FEN":"\u51fb\u5251","RUG":"\u6a44\u6984\u7403","HOC":"\u66f2\u68cd\u7403","BSB":"\u68d2\u7403\u5792\u7403"}}} 

比赛日期请求：

{"result":{"status":{"code":0,"msg":"olympic day"},"timestamp":"Thu Aug 05 10:57:31 +0800 2021","data":["2021-07-21","2021-07-22","2021-07-23","2021-07-24","2021-07-25","2021-07-26","2021-07-27","2021-07-28","2021-07-29","2021-07-30","2021-07-31","2021-08-01","2021-08-02","2021-08-03","2021-08-04","2021-08-05","2021-08-06","2021-08-07","2021-08-08"]}}

奖牌榜数据请求：

{"result":{"status":{"code":0,"msg":"all succ"},"timestamp":"Thu Aug 05 10:57:46 +0800 2021","data":{"total":[{"gold":"32","silver":"22","bronze":"16","total":"70","goldMan":"11","silverMan":"10","bronzeMan":"9","totalMan":"30","goldWoman":"18","silverWoman":"9","bronzeWoman":"7","totalWoman":"34","goldMixed":"3","silverMixed":"3","bronzeMixed":"0","totalMixed":"6","country":"CHN","countryNameSSY":"\u4e2d\u56fd","countryFlagSSY":"https:\/\/www.sinaimg.cn\/ty\/2020\/Olympic\/flag\/CHN.png","olympicEventId":"1628","ischn":"1","rank":"1"},{"gold":"25","silver":"31","bronze":"23","total":"79","goldMan":"11","silverMan":"7","bronzeMan":"5","totalMan":"23","goldWoman":"14","silverWoman":"21","bronzeWoman":"16","totalWoman":"51","goldMixed":"0","silverMixed":"2","bronzeMixed":"2","totalMixed":"4","country":"USA","countryNameSSY":"\u7f8e\u56fd","countryFlagSSY":"https:\/\/www.sinaimg.cn\/ty\/2020\/Olympic\/flag\/USA.png","olympicEventId":"38","ischn":"