全部

1·Maximum database size for crawler 2GB 2GB

爬虫的最大数据库大小 2GB 2GB

2·Use a site map to lead the crawler around your site.

使用站点地图引导爬行器遍历您的站点。

3·Define the crawler subdirectories, as illustrated in Figure 8.

定义爬虫子目录，如图8所示。

4·This article took you through the task of creating a Web crawler by.

本文向您介绍了创建Web crawler的过程。

5·Notice also that only the base URI string is added to the crawler.

另外请注意，只有基 URI 字符串被添加到了 crawler。

6·She still needs to prove herself before she can get with this wall-crawler.

她在和攀墙者走到一起之前还需要证明她自己。

7·Click on the Edit button in the query_statistic line to move to the crawler TAB.

单击query_statistic行的Ededit按钮，移向爬虫选项卡。

8·The basic design of this crawler is to load the first link to check onto a queue.

这个爬虫的基本设计是加载第一个链接并将其放入一个队列。

9·The CollectUrls Web crawler program takes advantage of a fixed-size thread pool.

CollectUrls Web crawler程序利用一个固定大小的线程池。

10·The next step is to make a sample announcement document available to the crawler.

下一步是为爬行器提供一个样例通知文档。

(1)crawler crane履带起重机；履带吊

(1)crawler tractor覆带式拖拉机