Web Crawler

Getting all the information from the internet into the database of the search engine.

Algorithmia Platform License · Internet Access · Calls Other Algorithms

Try the API

!!!

Install & Use

Use

curl -X POST -d '"www.google.com"' -H 'Content-Type: application/json' -H 'Authorization: Simple YOUR_API_KEY' https://api.algorithmia.com/v1/algo/JamesBond007/WebCrawler/0.1.0