Crawl And Page Rank

(no tags)

    Algorithmia Platform License · Internet Access · Calls Other Algorithms

    Run an Example

    {
      "https://algorithmia.com/algorithms/williamaustinwebb/GetURLFromSite#python": 0.004137684594964557,
      "https://algorithmia.com/algorithms/williamaustinwebb/ParallelSiteMatcher#javascript": 0.004137684594964557,
      "https://algorithmia.com/algorithms/TimeSeries/OutlierDetection": 0.004137684594964557,
      "https://algorithmia.com/algorithms/tags/RelatedTags": 0.004137684594964557,
      "https://algorithmia.com/algorithms/opencv/FaceDetection": 0.004137684594964557,
      "https://algorithmia.com/users/williamaustinwebb": 0.004137684594964557,
      "https://algorithmia.com/algorithms/williamaustinwebb/testingSampleInput": 0.004137684594964557,
      "https://algorithmia.com/users/zskurultay": 0.004137684594964557,
      "https://algorithmia.com/algorithms/williamaustinwebb/ParallelSiteMatcher": 0.004137684594964557,
      "http://blog.algorithmia.com/post/115255527924/accessing-algorithmia-through-python#notes": 0.004137684594964557,
      "https://algorithmia.com/tags/microservices": 0.004137684594964557,
      "https://algorithmia.com/users/TimeSeries": 0.004137684594964557,
      "https://algorithmia.com/algorithms/zskurultay/JOptimizer": 0.004137684594964557,
      "http://blog.algorithmia.com/mobile": 0.004137684594964557,
      "https://algorithmia.com/algorithms//": 0.004137684594964557,
      "http://blog.algorithmia.com/": 0.004137684594964557,
      "https://algorithmia.com/algorithms/diego/GeographicDistance": 0.004137684594964557,
      "https://algorithmia.com/demo/pathplan": 0.004137684594964557,
      "https://algorithmia.com/tags/web": 0.004137684594964557,
      "https://algorithmia.com/bounty_terms": 0.004137684594964557,
      "https://algorithmia.com/algorithms/util/ip2hostname": 0.004137684594964557,
      "https://algorithmia.com/algorithms": 0.004137684594964557,
      "https://algorithmia.com/bounties/10": 0.004137684594964557,
      "https://algorithmia.com/users/kenny": 0.004137684594964557,
      "https://algorithmia.com/algorithms/williamaustinwebb/GenerateClumpedSample": 0.004137684594964557,
      "https://algorithmia.com/algorithms/nlp/ProfanityDetection": 0.004137684594964557,
      "https://algorithmia.com/algorithms/zskurultay/CaptchaValidate": 0.004137684594964557,
      "https://algorithmia.com/algorithms/util/Cat": 0.004137684594964557,
      "https://algorithmia.com/algorithms/tags/RecommendGitHubFromTags#javascript": 0.004137684594964557,
      "https://algorithmia.com/algorithms/kenny/LDA": 0.004137684594964557,
      "https://algorithmia.com/algorithms/tags/RecommendGithub#javascript": 0.004137684594964557,
      "https://algorithmia.com/algorithms/tags/RelatedTags#curl": 0.004137684594964557,
      "https://algorithmia.com/algorithms/TimeSeries/CumulativeMovingAverage": 0.004137684594964557,
      "https://algorithmia.com/": 0.004137684594964557,
      "https://algorithmia.com/algorithms/TimeSeries/FourierFilter": 0.004137684594964557,
      "https://algorithmia.com/algorithms/zskurultay/ImageSimilarity": 0.004137684594964557,
      "https://algorithmia.com/algorithms/williamaustinwebb/SiteMatcher#python": 0.004137684594964557,
      "https://algorithmia.com/bounties/24": 0.004137684594964557,
      "https://algorithmia.com/algorithms/tags/ScrapeHN": 0.004137684594964557,
      "https://algorithmia.com/bounties/25": 0.004137684594964557,
      "https://algorithmia.com/bounties/26": 0.004137684594964557,
      "https://api.algorithmia.com/api/nlp/ProfanityDetection": 0.004137684594964557,
      "https://algorithmia.com/tags/graphs": 0.004137684594964557,
      "https://algorithmia.com/optout": 0.004137684594964557,
      "http://blog.algorithmia.com/page/2": 0.004137684594964557,
      "https://algorithmia.com/algorithms/TimeSeries/ThresholdAnomalyDetection": 0.004344568824712784,
      "https://algorithmia.com/docs/marketplace#perms": 0.004137684594964557,
      "https://algorithmia.com/demo/lda": 0.004137684594964557,
      "https://algorithmia.com/algorithms/zskurultay/ImageSimilarity#javascript": 0.004137684594964557,
      "https://algorithmia.com/users/tags": 0.004137684594964557,
      "https://algorithmia.com/algorithms/nlp/LanguageIdentification": 0.004137684594964557,
      "https://algorithmia.com/algorithms/tags/AutoTagGithub#python": 0.004137684594964557,
      "https://algorithmia.com/algorithms/nlp/Summarizer#curl": 0.004137684594964557,
      "https://algorithmia.com/algorithms/nlp/AutoTag": 0.004137684594964557,
      "http://blog.algorithmia.com/tagged/profanity-detection": 0.004137684594964557,
      "https://algorithmia.com/algorithms/tags/RelatedTags#python": 0.004137684594964557,
      "https://algorithmia.com/users/nlp": 0.004137684594964557,
      "http://www.algorithmia.com": 0.004137684594964557,
      "https://algorithmia.com/algorithms/williamaustinwebb/DataAPITest#curl": 0.004137684594964557,
      "https://algorithmia.com/algorithms/TimeSeries/LinearDetrend": 0.004137684594964557,
      "https://algorithmia.com/bounties/35": 0.004137684594964557,
      "https://algorithmia.com/bounties/36": 0.004137684594964557,
      "https://algorithmia.com/algorithms/web/SiteMap": 0.004137684594964557,
      "https://algorithmia.com/algorithms/nlp/SentimentAnalysis#curl": 0.004137684594964557,
      "https://algorithmia.com/bounties/38": 0.004137684594964557,
      "https://algorithmia.com/algorithms/util/Html2Text#python": 0.004137684594964557,
      "https://algorithmia.com/algorithms/zskurultay/CaptchaGenerate": 0.004137684594964557,
      "https://algorithmia.com/bounties/33": 0.004137684594964557,
      "https://algorithmia.com/bounties/34": 0.004137684594964557,
      "https://algorithmia.com/algorithms/TimeSeries/ExponentialMovingAverage": 0.004137684594964557,
      "https://algorithmia.com/algorithms/williamaustinwebb/DataAPITest": 0.004137684594964557,
      "https://algorithmia.com/signup?invite=OpenMarketplace": 0.004137684594964557,
      "https://algorithmia.com/algorithms/williamaustinwebb/SiteMatcher#javascript": 0.004137684594964557,
      "https://algorithmia.com/algorithms/TimeSeries/RemoveSeasonality": 0.004137684594964557,
      "https://algorithmia.com/algorithms/util/Html2Text#curl": 0.004137684594964557,
      "https://algorithmia.com/algorithms/williamaustinwebb/GenerateClumpedSample#python": 0.004137684594964557,
      "https://algorithmia.com/algorithms/util/Null": 0.004137684594964557,
      "http://blog.algorithmia.com/rss": 0.004137684594964557,
      "https://algorithmia.com/algorithms/util/Html2Text#javascript": 0.004137684594964557,
      "https://algorithmia.com/reset": 0.004137684594964557,
      "https://algorithmia.com/users/util": 0.004137684594964557,
      "https://algorithmia.com/tags/utilities": 0.004137684594964557,
      "https://algorithmia.com/algorithms/tags/ScrapeRSS": 0.004137684594964557,
      "http://blog.algorithmia.com/tagged/data-science": 0.004137684594964557,
      "https://algorithmia.com/algorithms/williamaustinwebb/DataAPITest#javascript": 0.004137684594964557,
      "https://algorithmia.com/algorithms/tags/ScrapeHN#curl": 0.004137684594964557,
      "http://blog.algorithmia.com/tagged/data": 0.004137684594964557,
      "https://algorithmia.com/algorithms/TimeSeries/SpikeDetection": 0.004137684594964557,
      "https://algorithmia.com/algorithms/TimeSeries/FourierClean": 0.004137684594964557,
      "https://algorithmia.com/algorithms/williamaustinwebb/PublishTest#javascript": 0.004137684594964557,
      "https://algorithmia.com/bounties/42": 0.004137684594964557,
      "https://algorithmia.com/tags/audio%20video": 0.004137684594964557,
      "https://algorithmia.com/algorithms/williamaustinwebb/GenerateClumpedSample#curl": 0.004137684594964557,
      "https://algorithmia.com/terms": 0.004137684594964557,
      "https://algorithmia.com/algorithms/util/ParallelForEach": 0.004137684594964557,
      "https://algorithmia.com/algorithms/tags/RecommendGitHubFromTags#python": 0.004137684594964557,
      "http://blog.algorithmia.com/ask": 0.004137684594964557,
      "http://blog.algorithmia.com/tagged/algorithmia": 0.004137684594964557,
      "https://algorithmia.com/algorithms/zskurultay/ImageSimilarity#python": 0.004137684594964557,
      "https://algorithmia.com/algorithms/williamaustinwebb/testingSampleInput#javascript": 0.004137684594964557,
      "http://algorithmia.com": 0.004137684594964557,
      "https://algorithmia.com/signin": 0.004137684594964557,
      "http://blog.algorithmia.com/tagged/algorithms": 0.004137684594964557,
      "https://algorithmia.com/algorithms/TimeSeries/FFTAutocorrelation": 0.004137684594964557,
      "https://algorithmia.com/algorithms/util/ExtractText": 0.004137684594964557,
      "https://algorithmia.com/algorithms/tags/RecommendGitHubFromTags": 0.004137684594964557,
      "https://algorithmia.com/algorithms/tags/RecommendGitHubFromTags#curl": 0.004137684594964557,
      "https://algorithmia.com/algorithms/tags/AutoTagURL#curl": 0.004137684594964557,
      "https://algorithmia.com/assets/javascripts/algorithmia.js": 0.004137684594964557,
      "https://algorithmia.com/algorithms/nlp/SentimentAnalysis": 0.004137684594964557,
      "https://algorithmia.com/#": 0.004137684594964557,
      "https://algorithmia.com/api": 0.004137684594964557,
      "https://algorithmia.com/algorithms/util/Html2Text": 0.004137684594964557,
      "https://algorithmia.com/tags/text%20analysis": 0.004137684594964557,
      "https://algorithmia.com/algorithms/williamaustinwebb/DataAPITest#python": 0.004137684594964557,
      "https://algorithmia.com/algorithms/util/mysqlToJSON": 0.004137684594964557,
      "https://algorithmia.com/algorithms/tags/AutoTagURL#python": 0.004137684594964557,
      "https://algorithmia.com/algorithms/williamaustinwebb/SiteMatcher": 0.004137684594964557,
      "https://algorithmia.com/algorithms/williamaustinwebb/testingSampleInput#python": 0.004137684594964557,
      "https://algorithmia.com/algorithms/tags/AutoTagURL#javascript": 0.004137684594964557,
      "https://algorithmia.com/algorithms/williamaustinwebb/ParallelSiteMatcher#python": 0.004137684594964557,
      "https://algorithmia.com/algorithms/TimeSeries/TimeSeriesSummary": 0.004137684594964557,
      "https://algorithmia.com/algorithms/nlp/Summarizer#javascript": 0.004137684594964557,
      "http://blog.algorithmia.com": 0.004137684594964557,
      "https://algorithmia.com/algorithms/tags/AutoTagURL": 0.004137684594964557,
      "https://algorithmia.com/algorithms/tags/AutoTagUrl": 0.004137684594964557,
      "https://algorithmia.com/algorithms/tags/RecommendGithub#python": 0.004137684594964557,
      "https://algorithmia.com/algorithms/williamaustinwebb/testingSampleInput#curl": 0.004137684594964557,
      "https://algorithmia.com/algorithms/WebPredict/DoWordsRhyme": 0.004137684594964557,
      "https://algorithmia.com/contact": 0.004137684594964557,
      "https://algorithmia.com/algorithms/williamaustinwebb/SiteMatcher#curl": 0.004137684594964557,
      "https://algorithmia.com/algorithms/tags/AutoTagGithub#javascript": 0.004137684594964557,
      "https://algorithmia.com/api_dev_terms": 0.004137684594964557,
      "https://algorithmia.com/algorithms/williamaustinwebb/GetURLFromSite": 0.004137684594964557,
      "https://algorithmia.com/algorithms/util/PrepareInputArray": 0.004137684594964557,
      "https://algorithmia.com/algorithms/williamaustinwebb/PublishTest": 0.004137684594964557,
      "http://blog.algorithmia.com/post/113414162819/the-future-of-algorithm-development#notes": 0.004137684594964557,
      "http://blog.algorithmia.com/random": 0.004137684594964557,
      "https://algorithmia.com/about": 0.004137684594964557,
      "https://algorithmia.com/algorithms/nlp/RetrieveStopWords": 0.004137684594964557,
      "https://algorithmia.com/privacy": 0.05898144672429144,
      "https://algorithmia.com/algorithms/TimeSeries/SimpleMovingAverage": 0.004137684594964557,
      "http://blog.algorithmia.com/post/115255527924/accessing-algorithmia-through-python": 0.004137684594964557,
      "https://algorithmia.com/algodev": 0.004137684594964557,
      "https://algorithmia.com/algorithms/tags/RecommendGithub": 1,
      "http://blog.algorithmia.com/archive": 0.004137684594964557,
      "https://algorithmia.com/algorithms/diego/WordFrequencyCounter": 0.004137684594964557,
      "https://algorithmia.com/algorithms/tags/AutoTagGithub": 0.004137684594964557,
      "https://algorithmia.com/algorithms/zskurultay/SimpleGaussianFilter": 0.004137684594964557,
      "https://algorithmia.com/algorithms/williamaustinwebb/PublishTest#curl": 0.004137684594964557,
      "https://algorithmia.com/tags/machine%20learning": 0.004137684594964557,
      "https://algorithmia.com/demo/autotag": 0.004137684594964557,
      "https://algorithmia.com/algorithms/util/Echo": 0.004137684594964557,
      "https://algorithmia.com/algorithms/tags/ScrapeRSS#python": 0.004137684594964557,
      "http://blog.algorithmia.com/tagged/python": 0.004137684594964557,
      "http://blog.algorithmia.com/post/113414162819/the-future-of-algorithm-development": 0.004137684594964557,
      "https://algorithmia.com/algorithms/util/Curl": 0.004137684594964557,
      "https://algorithmia.com/algorithms/tags/ScrapeHN#python": 0.004137684594964557,
      "https://algorithmia.com/algorithms/williamaustinwebb/GenerateClumpedSample#javascript": 0.004137684594964557,
      "https://algorithmia.com/algorithms/kenny/Dijkstra": 0.004137684594964557,
      "https://algorithmia.com/algorithms/tags/ScrapeRSS#curl": 0.004137684594964557,
      "https://algorithmia.com/algorithms/nlp/SentimentAnalysis#javascript": 0.004137684594964557,
      "https://algorithmia.com/tags/computational%20mathematics": 0.004137684594964557,
      "https://algorithmia.com/algorithms/util/ForEach": 0.004137684594964557,
      "https://algorithmia.com/algorithms/williamaustinwebb/PublishTest#python": 0.004137684594964557,
      "https://algorithmia.com": 0.004137684594964557,
      "https://algorithmia.com/algorithms/tags/ScrapeHN#javascript": 0.004137684594964557,
      "http://blog.algorithmia.com/post/75680476188/algorithm-development-is-broken": 0.004137684594964557,
      "https://algorithmia.com/algorithms/nlp/SentimentAnalysis#python": 0.004137684594964557,
      "https://algorithmia.com/algorithms/TimeSeries/FourierDetrend": 0.004137684594964557,
      "https://algorithmia.com/algorithms/williamaustinwebb/ParallelSiteMatcher#curl": 0.004137684594964557,
      "https://algorithmia.com/algorithms/util/AggregateDirectory": 0.004137684594964557,
      "https://algorithmia.com/tags/algorithms%20101": 0.004137684594964557,
      "https://algorithmia.com/algorithms/tags/AutoTagGithub#curl": 0.004137684594964557,
      "https://algorithmia.com/algorithms/williamaustinwebb/GetURLFromSite#curl": 0.004137684594964557,
      "https://algorithmia.com/algorithms/tags/RelatedTags#javascript": 0.004137684594964557,
      "http://blog.algorithmia.com/tagged/sentiment-analysis": 0.004137684594964557,
      "https://algorithmia.com/algorithms/tags/ScrapeRSS#javascript": 0.004137684594964557,
      "https://algorithmia.com/tags/computer%20vision": 0.004137684594964557,
      "https://algorithmia.com/algorithms/zskurultay/ImageSimilarity#curl": 0.004137684594964557,
      "https://algorithmia.com/pricing": 0.004137684594964557,
      "https://algorithmia.com/algorithms/nlp/Summarizer": 0.004137684594964557,
      "https://algorithmia.com/algorithms/nlp/Summarizer#python": 0.004137684594964557,
      "https://algorithmia.com/algorithms/tags/RecommendGithub#curl": 0.004137684594964557,
      "https://algorithmia.com/algorithms/williamaustinwebb/GetURLFromSite#javascript": 0.004137684594964557,
      "https://algorithmia.com/algorithms/util/Url2Text": 0.004137684594964557
    }

    Install & Use

    Use
    
    curl -X POST -d '"algorithmia.com"' -H 'Content-Type: application/json' -H 'Authorization: Simple YOUR_API_KEY' https://api.algorithmia.com/v1/algo/web/CrawlAndPageRank/0.3.0