Crawler选填判断题

1. What is a web crawler primarily used for?

   • A: Playing games
   • B: Downloading music
   • C: Indexing website content for search engines
   • D: Editing videos
   答案 C

2. Which Python library is commonly used for making HTTP requests in web crawling?

   • A: NumPy
   • B: Pandas
   • C: Requests
   • D: Matplotlib
   答案 C

3. What is ‘rate limiting’ in the context of web crawling?

   • A: Limiting the number of websites a crawler can access
   • B: Limiting the speed at which a crawler sends requests
   • C: Limiting the size of the data a crawler can download
   • D: Limiting the types of data a crawler can request
   答案 B

4. Which Python library is widely used for web crawling and scraping?

   • A: Flask
   • B: Django
   • C: Scrapy
   • D: TensorFlow
   答案 C

5. What function in the Requests library is used to send a GET request?

   • A: requests.post()
   • B: requests.get()
   • C: requests.send()
   • D: requests.receive()
   答案 B

6. How can you parse a URL and extract its components in Python?

   • A: Using the urllib.parse module
   • B: Using the os.path module
   • C: Using the json module
   • D: Using the csv module
   答案 A

7. In Scrapy, what is the purpose of the parse method in a spider class?

   • A: To start the crawler
   • B: To process the response and extract data
   • C: To handle exceptions
   • D: To store the crawled data
   答案 B

8. Which of the following is not a part of the Scrapy architecture?

   • A: Scheduler
   • B: Downloader
   • C: Executor
   • D: Item Pipeline
   答案 D

9. Which function is used to create an array in NumPy?

   • A: array()
   • B: list()
   • C: dict()
   • D: set()
   答案 A

10. Which method is used to compute the mean of elements in a NumPy array?

    • A: .sum()
    • B: .avg()
    • C: .mean()
    • D: .total()
    答案 C

11. How do you change the shape of an existing NumPy array?

    • A: reshape()
    • B: resize()
    • C: reshape_array()
    • D: array_shape()
    答案 A

12. Which of the following is not a valid attribute of a NumPy array?

    • A: shape
    • B: dtype
    • C: size
    • D: typecode
    答案 D

13. What is a core element of web crawlers?

    • A: Iteration
    • B: Recursion
    • C: Conditional statements
    • D: Variables
    答案 B

14. What Python package is used to parse HTML and XML documents?

    • A: requests
    • B: BeautifulSoup
    • C: lxml
    • D: pandas
    答案 B

15. Which of the following is not a type of object discussed in BeautifulSoup?

    • A: Tag
    • B: NavigableString
    • C: BeautifulSoup
    • D: LinkObject
    答案 D