Sign in
Contact us
Algorithmia, a DataRobot company
jpeck

jpeck / scrapydemo / 0.1.3

scrapydemo

Royalty Free
Extracts <title> tags from the provided URLs using multithreaded Scrapy
demo
Language
Python 3.x
Metrics
API Calls - 189 Avg call duration - N/A
Permissions
The Algorithm Platform License is the set of terms that are stated in the Software License section of the Algorithmia Application Developer and API License Agreement. It is intended to allow users to reserve as many rights as possible without limiting Algorithmia's ability to run it as a service. Learn more
This is necessary for algorithms that rely on external services, however it also implies that this algorithm is able to send your input data outside of the Algorithmia platform.
This allows an algorithm to compose sophisticated functionality using other algorithms as building blocks , however it also carries the potential of incurring additional royalty and usage costs from any algorithm that it calls .

Run an example

Input
Output
[
  [
    "<title>Example Domain</title>"
  ],
  [
    "<title>Yahoo</title>"
  ],
  [
    "<title>Google</title>"
  ]
]

Install and use

Install

Install the Algorithmia CLI client by running: 

curl -sSLf https://algorithmia.com/install.sh | sh

Then authenticate by running:


          $ algo auth
# When prompted for api endpoint, hit enter
# When prompted for API key, enter your key: YOUR_API_KEY
CLI install docs

Use



    algo run jpeck/scrapydemo/0.1.3 -d '["http://www.example.com/","http://www.yahoo.com/","http://google.com"] ' --timeout 300
CLI docs