<<Previous: Multiple Fetches | ↑Up: Advanced Walk Settings | Next>>: Max Redirects |
Syntax: select Y or N
When walking multiple hosts, setting Follow Cross-Site Links
to Y
will allow links from one host to another to be respected,
as opposed to only starting from each host's Base URLs.
If you have a lot of Base URLs that have lots of duplicate links to
each other that would've been found on-site anyway, setting
Follow Cross-Site Links
to N
can improve walk
performance.
<<Previous: Multiple Fetches | ↑Up: Advanced Walk Settings | Next>>: Max Redirects |