Hexomatic - Crawler 0 0

Posted ByClark

A web crawler (also known as a web spider or web robot) is a program or automated script which browses the World Wide Web in a methodical, automated manner. This process is called Web crawling or spidering. It is very useful when you want to find out if any of your links or pages on your website does respond or 


We will help you to crawl your preferred website in just a short period of time.


Here are the things we will need for this task:

  • User Credential (Hexomatic) to be shared via Dashlane.
  • Website URL/Source URL (What website will be crawled?)
  • URL Type. (Internal Links, External Links, or All Items)
  • URL Limit.

** The time is base on Asia/Singapore timezone