outofstep

outofstep / ScrapeRedditByDomainName / 0.1.0

ScrapeRedditByDomainName

5 Credit Royalty
Get all links for a top-level domain on Reddit
Language
Java
Metrics
API Calls - 86 Avg call duration - N/A
Permissions
The Algorithm Platform License is the set of terms that are stated in the Software License section of the Algorithmia Application Developer and API License Agreement. It is intended to allow users to reserve as many rights as possible without limiting Algorithmia's ability to run it as a service. Learn More
This is necessary for algorithms that rely on external services, however it also implies that this algorithm is able to send your input data outside of the Algorithmia platform.

Run an Example

Input
Output
[
  {
    "title": "Short tutorial for building serverless apps using AWS Lambda and Algorithmia",
    "url": "http://www.reddit.com/r/aws/comments/3u3z8a/short_tutorial_for_building_serverless_apps_using/",
    "pubDate": "Tue, 24 Nov 2015 18:42:11 +0000"
  },
  {
    "title": "Get Started Building Intelligent, Serverless Apps Using AWS Lambda and Algorithmia",
    "url": "http://www.reddit.com/r/MachineLearning/comments/3u8k0q/get_started_building_intelligent_serverless_apps/",
    "pubDate": "Wed, 25 Nov 2015 17:15:11 +0000"
  },
  {
    "title": "Get Started Building Intelligent, Serverless Apps Using AWS Lambda and Algorithmia",
    "url": "http://www.reddit.com/r/programming/comments/3u3t23/get_started_building_intelligent_serverless_apps/",
    "pubDate": "Tue, 24 Nov 2015 18:03:40 +0000"
  },
  {
    "title": "[FREE] Related Content Recommendation Engine plugin",
    "url": "http://www.reddit.com/r/WordpressPlugins/comments/3pt599/free_related_content_recommendation_engine_plugin/",
    "pubDate": "Thu, 22 Oct 2015 19:10:13 +0000"
  },
  {
    "title": "Getting Started With Natural Language Processing (NLP)",
    "url": "http://www.reddit.com/r/textdatamining/comments/3om349/getting_started_with_natural_language_processing/",
    "pubDate": "Tue, 13 Oct 2015 17:50:52 +0000"
  },
  {
    "title": "Who's Who: a web app that uses a facial recognition model to identify the cast from Parks and Rec",
    "url": "http://www.reddit.com/r/webdev/comments/3o43mh/whos_who_a_web_app_that_uses_a_facial_recognition/",
    "pubDate": "Fri, 09 Oct 2015 15:54:58 +0000"
  },
  {
    "title": "Who's Who: a facial recognition model trained with the cast of Parks and Rec",
    "url": "http://www.reddit.com/r/PandR/comments/3o451o/whos_who_a_facial_recognition_model_trained_with/",
    "pubDate": "Fri, 09 Oct 2015 16:05:00 +0000"
  },
  {
    "title": "Getting Started With Natural Language Processing",
    "url": "http://www.reddit.com/r/technology/comments/3n0a8b/getting_started_with_natural_language_processing/",
    "pubDate": "Wed, 30 Sep 2015 19:44:21 +0000"
  },
  {
    "title": "Getting started with NLP for beginners",
    "url": "http://www.reddit.com/r/datascience/comments/3mw2pu/getting_started_with_nlp_for_beginners/",
    "pubDate": "Tue, 29 Sep 2015 22:17:28 +0000"
  },
  {
    "title": "How to get started with NLP for beginners",
    "url": "http://www.reddit.com/r/programming/comments/3mvwez/how_to_get_started_with_nlp_for_beginners/",
    "pubDate": "Tue, 29 Sep 2015 21:33:29 +0000"
  },
  {
    "title": "Excited to share that we were selected as a Startup Showcase finalist for Strata + Hadoop World in NYC!!",
    "url": "http://www.reddit.com/r/EntrepreneurRideAlong/comments/3lc9hn/excited_to_share_that_we_were_selected_as_a/",
    "pubDate": "Thu, 17 Sep 2015 19:38:02 +0000"
  },
  {
    "title": "Mining Product Hunt: Detecting Vote-Rings",
    "url": "http://www.reddit.com/r/programming/comments/3e9g2u/mining_product_hunt_detecting_voterings/",
    "pubDate": "Wed, 22 Jul 2015 23:56:23 +0000"
  },
  {
    "title": "Mining Product Hunt, Part 1: Detecting Vote-Rings",
    "url": "http://www.reddit.com/r/hackernews/comments/3e83k8/mining_product_hunt_part_1_detecting_voterings/",
    "pubDate": "Wed, 22 Jul 2015 18:03:26 +0000"
  },
  {
    "title": "[Tech] Mining Product Hunt, Part 1: Detecting Vote-Rings",
    "url": "http://www.reddit.com/r/Newsbeard/comments/3e7wky/tech_mining_product_hunt_part_1_detecting/",
    "pubDate": "Wed, 22 Jul 2015 17:14:42 +0000"
  },
  {
    "title": "Using artificial intelligence to detect nudity",
    "url": "http://www.reddit.com/r/MachineLearning/comments/3aq0e5/using_artificial_intelligence_to_detect_nudity/",
    "pubDate": "Mon, 22 Jun 2015 15:55:46 +0000"
  },
  {
    "title": "Tracking Economic Development with Open Data and Predictive Algorithms",
    "url": "http://www.reddit.com/r/Economics/comments/36ih8a/tracking_economic_development_with_open_data_and/",
    "pubDate": "Tue, 19 May 2015 17:07:58 +0000"
  },
  {
    "title": "Tracking economic development with open data and predictive algorithms",
    "url": "http://www.reddit.com/r/dataisbeautiful/comments/36iaw5/tracking_economic_development_with_open_data_and/",
    "pubDate": "Tue, 19 May 2015 16:25:21 +0000"
  },
  {
    "title": "Tracking Economic Development with Open Data and Predictive Algorithms",
    "url": "http://www.reddit.com/r/economy/comments/36jvpl/tracking_economic_development_with_open_data_and/",
    "pubDate": "Tue, 19 May 2015 22:41:14 +0000"
  },
  {
    "title": "How machines see the web: visualizing the graph structure of domains [OC]",
    "url": "http://www.reddit.com/r/dataisbeautiful/comments/32vouu/how_machines_see_the_web_visualizing_the_graph/",
    "pubDate": "Fri, 17 Apr 2015 02:30:55 +0000"
  },
  {
    "title": "How Machines See the Web: Exploring the Web Algorithmically",
    "url": "http://www.reddit.com/r/algorithms/comments/32t0n7/how_machines_see_the_web_exploring_the_web/",
    "pubDate": "Thu, 16 Apr 2015 14:02:05 +0000"
  },
  {
    "title": "How Machines See the Web: Exploring the Web Algorithmically",
    "url": "http://www.reddit.com/r/webdev/comments/32sbcy/how_machines_see_the_web_exploring_the_web/",
    "pubDate": "Thu, 16 Apr 2015 08:56:52 +0000"
  },
  {
    "title": "How Machines See the Web: Exploring the Web Algorithmically",
    "url": "http://www.reddit.com/r/dataisbeautiful/comments/32skxt/how_machines_see_the_web_exploring_the_web/",
    "pubDate": "Thu, 16 Apr 2015 11:20:19 +0000"
  },
  {
    "title": "How Machines See the Web: Exploring the Web Algorithmically",
    "url": "http://www.reddit.com/r/bigseo/comments/32sc3n/how_machines_see_the_web_exploring_the_web/",
    "pubDate": "Thu, 16 Apr 2015 09:08:26 +0000"
  },
  {
    "title": "How Machines See the Web: Exploring the Web Algorithmically",
    "url": "http://www.reddit.com/r/programming/comments/32qfpo/how_machines_see_the_web_exploring_the_web/",
    "pubDate": "Wed, 15 Apr 2015 21:54:05 +0000"
  },
  {
    "title": "BogoSort - Algorithmia",
    "url": "http://www.reddit.com/r/programming/comments/2zlrmn/bogosort_algorithmia/",
    "pubDate": "Thu, 19 Mar 2015 17:20:14 +0000"
  }
]

Install and Use

Install

Install the Algorithmia CLI client by running:

curl -sSLf https://algorithmia.com/install.sh | sh

Then authenticate by running:

$ algo auth
# When prompted for api endpoint, hit enter
# When prompted for API key, enter your key: YOUR_API_KEY
CLI Install Docs

Use



algo run outofstep/ScrapeRedditByDomainName/0.1.0 -d '"algorithmia.com"' --timeout 300
  
CLI Docs