LinkCrawler FOLLOWREDIRECT example
Posted by pspzockerscene psp, Last modified by pspzockerscene psp on 08 January 2021 03:40 PM

LinkCrawler example - FOLLOWREDIRECT

FOLLOWREDIRECT rules can be used for the following tasks:

  • Make JD accept unsupported URLs that redirect to URLs (via http status codes 3XX) which JD either accepts or which are handled by subsequent LinkCrawler rules e.g. -->

[ {
"enabled": true,
"name": "example rule for LinkCrawler type FOLLOWREDIRECT",
"pattern": "https?://example\\.com/[A-Za-z0-9]+",
} ]