Skip to content

Commit 87e010a

Browse files
committed
docs: fix
1 parent ebb0dbf commit 87e010a

1 file changed

Lines changed: 2 additions & 2 deletions

File tree

docs/spiders/advanced.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -17,7 +17,7 @@ The spider system uses three class attributes to control how aggressively it cra
1717
| `concurrent_requests` | `4` | Maximum number of requests being processed at the same time |
1818
| `concurrent_requests_per_domain` | `0` | Maximum concurrent requests per domain (0 = no per-domain limit) |
1919
| `download_delay` | `0.0` | Seconds to wait before each request |
20-
| `robots_txt_obey` | `False` | Respect robots.txt rules (Disallow, Crawl-delay, Request-rate) |
20+
| `robots_txt_obey` | `False` | Respect robots.txt rules (Disallow, Crawl-delay, Request-rate) |
2121

2222
```python
2323
class PoliteSpider(Spider):
@@ -98,7 +98,7 @@ print(result.stats.autothrottle_delays) # {'example.com': 0.62}
9898
* `autothrottle_max_delay` caps everything, including `Retry-After`. If a website asks for longer than your ceiling, raise `autothrottle_max_delay` to honor it.<br/>
9999
* The learned delays are not checkpointed. After a pause and resume, each domain starts again from `autothrottle_start_delay`.
100100

101-
### Using uvloop
101+
## Using uvloop
102102

103103
The `start()` method accepts a `use_uvloop` parameter to use the faster [uvloop](https://github.com/MagicStack/uvloop)/[winloop](https://github.com/nicktimko/winloop) event loop implementation, if available:
104104

0 commit comments

Comments
 (0)