Further reading

  • A simple documented example which demonstrates the crawler usage.

  • Some useful examples can be found in the integration tests (and to a certain extent in the unit tests).

  • TODO: Information on caching