我创建了一个食品卫生刮板,它根据用户输入的邮政编码显示结果。有了我在下面发布的代码,当运行和结果被正确地输出到控制台时,一切都工作得很好。在
我想把结果输出到一个文本文件。在
我的代码是:import requests
import time
import sys
from bs4 import BeautifulSoup
class RestaurantScraper(object):
def __init__(self, pc):
self.pc = pc # the input postcode
self.max_page = self.find_max_page() # The number of page available
self.restaurants = list() # the final list of restaurants where the scrape data will at the end of process
def run(self):
for url in self.generate_pages_to_scrape():
restaurants_from_url = self.scrape_page(url)
self.restaurants += restaurants_from_url # we increment the restaurants to the global restaurants list
def create_url(self):
"""
Create a core url to scrape
:return: A url without pagination (= page 1)<