specrom

specrom / Extract_From_Indeed_Job_Scraper / 0.1.5

Extract From Indeed (dot) Com: Jobs Scraper

50 Credit Royalty
Scrape job postings from indeed.com
Language
Python 3.x
Metrics
API Calls - 186 Avg call duration - 1.14sec
Permissions
The Algorithm Platform License is the set of terms that are stated in the Software License section of the Algorithmia Application Developer and API License Agreement. It is intended to allow users to reserve as many rights as possible without limiting Algorithmia's ability to run it as a service. Learn More
This is necessary for algorithms that rely on external services, however it also implies that this algorithm is able to send your input data outside of the Algorithmia platform.
This allows an algorithm to compose sophisticated functionality using other algorithms as building blocks , however it also carries the potential of incurring additional royalty and usage costs from any algorithm that it calls .

Run an Example

Input
Output
[
  {
    "company_name": "eBay Inc.",
    "date": "9 days ago",
    "job_title": "Software Engineer, Recent Graduate",
    "location": "New York, NY",
    "salary": "none",
    "summary": "Think globally and help eBay be on the top tier with new products, including cloud-based or internet-related tools.",
    "total_page_count": 1082,
    "url": "https://www.indeed.com/pagead/clk?mo=r&ad=-6NYlbfkN0A9TGvvMbs_9tzUmxh-6hF76myvpV3Plf7hsqRV14VZ2cfT-rsmf5GV6ECGl_ZVloQ6jNKD9wdM4AaLqKT_M9CrjPRcaYTBjFJelWK0NvPraYrv3AWYfvKFHjuOaZVi6oVM2rveBZ902fqEMMKxGoOzRftQgU1TdLZhdBUcBiQaWkAq3xbnV0hMROzcCUemejE8SUMtzXQLc-7DYoBrRcoHPxaiwMhBE2s0fnnlGFhj0E5fXht7Wnq_u1TnfeIgN-N8h6ByuTeCW3OHrPHM6GkohSE1esVwQlX-rWDJb5CTAIPRPz3ySUiIpK08hT-Ri3qKA1oBf2cisqnIm7WTbCj2PQLJR3IfWpqhl7Mw9imlUbylxkpziIjce3uj8kfYLzxg6e5cqQgXAg==&p=0&fvj=0&vjs=3"
  },
  {
    "company_name": "Bitpush Inc.",
    "date": "8 days ago",
    "job_title": "(Remote) Need experienced Python developer - intern or part-time",
    "location": "New York, NY",
    "salary": "none",
    "summary": "We are recruiting intern and/or part-time Python developer to help build an advanced computing engine to grab, analyze and store trading data and integrate…",
    "total_page_count": 1082,
    "url": "https://www.indeed.com/pagead/clk?mo=r&ad=-6NYlbfkN0CVH-yy-CyZpBtZG6Y7k0Eyf5wlURKfDtiMTsrjQkWWz5uyfuRvksGjYZRINkMSDHlmiaWxdplYJ632iFy_BlufGlQM5X1RaOn5RdBKWXiaHA5mMK4mUdEhYXKOvPzn8GNcp9aMkTKTaIanifboHUcqop2BkSF4fAroc6VpYJW42qVkJxiImRuWHtZ1k4nRJm2g_sAilRyYGxTK_wR_0joqxaSTgdsaP7POOuhpTzo8u6WEHaoRNsz5euVNShHk17M5-jMDGxigpLLLkBrIlbcagYgNhqSE_DQNrX30Wu1bsE8cc2Sz9wg4lfNSXDtleBKFwW7y6bOQNFRrcafhhLeco3WRoteQdgqxXtJairvVSEQZUZlKsCVmhflRjacHbICwETZtcx5K_KVREWmAzM1S2T1awQJ0e43631hJdCi2gC5u2GBa8yGnbqrG3yMiN0x84pKaKT01NAGXr7nw6Kzcp89wbvkMAmg9NMPDFXEORfvytsORYdaluBly8Vmfx1UHsopgq41p8A==&p=1&fvj=1&vjs=3"
  },
  {
    "company_name": "Quantbot Technologies LP",
    "date": "27 days ago",
    "job_title": "Trading Ops Developer - NYC (Python)",
    "location": "New York, NY",
    "salary": "none",
    "summary": "The candidate will work on ops-specific tools and tasks and assist in developing solutions for a wide variety of technical challenges across the firm.",
    "total_page_count": 1082,
    "url": "https://www.indeed.com/company/Quantbot-Technologies-LP/jobs/Trading-Ops-Developer-eb16b3c5d9367c79?fccid=dd616958bd9ddc12&vjs=3"
  },
  {
    "company_name": "GuardX Inc",
    "date": "Today",
    "job_title": "Quantitative Developer, Python",
    "location": "New York, NY",
    "salary": "none",
    "summary": "Seeking a quantitative developer to assist in the implementation, maintenance, and continuing enhancement of a global macro strategy that employs a variety of…",
    "total_page_count": 1082,
    "url": "https://www.indeed.com/rc/clk?jk=b905499367112b35&fccid=376cafc34c3b98c4&vjs=3"
  },
  {
    "company_name": "Bloomberg",
    "date": "30+ days ago",
    "job_title": "2020 Software Engineer Intern",
    "location": "New York, NY",
    "salary": "none",
    "summary": "Engineering interns take ownership of their projects under the mentorship of full-time software engineers.\nIn addition to your projects, you'll participate in…",
    "total_page_count": 1082,
    "url": "https://www.indeed.com/cmp/Bloomberg"
  },
  {
    "company_name": "Appfigures, Inc.",
    "date": "30+ days ago",
    "job_title": "Backend Software Engineer",
    "location": "New York, NY",
    "salary": "none",
    "summary": "*You have mastered a programming language of your choice.\nYou are likely sick and tired of writing Fizz Buzz.\nA BS / MS in Computer Science or related field-- a…",
    "total_page_count": 1082,
    "url": "https://www.indeed.com/pagead/clk?mo=r&ad=-6NYlbfkN0Cyc7-Vy3Be0nd7H_W9wbGJEHSzCDtaFMMlgkD8SzrJB_eZU7CWU00wQ6sFO-44JHRSGR0g7yXaZaQgWtDYbasUlH4Pddo4oRpVkIFX7_ve4l-9Rg51Re8CALuMwKYpCV4NcECVB-sBqLB_29sGVAqj2aH7psPe-d_rc3I8xWclndqKtvvT7BJv1qm7nEoqA_83EkGL166zrpgHjY1ZP5vt0aaJo93aIU33Ufj40oLgUZmsPTOXAFZyLqd9V4Rgw_9suyvAaAptaIF8-2ToUZXKam0E92Q1UDLGQn4DFX4H6VDAKiD6Vsa7CZ0Zzl0kFM2f0La3MBoddnzOAi_NAsAd6O3MeVFFrV0WQRjYPizfBmDFP_wKRVSIaqlqyIV8uF5lvZr-D7fO7i9gFOj0WyTbSw5r3FHnvzLtK6fdXbvrgzpfNnpbOLYcLgMzlj0gJH66IXVPODEl3ege2XKX9GlFNRTlbpOD6Po=&p=5&fvj=1&vjs=3"
  },
  {
    "company_name": "Scaleneworks Inc",
    "date": "2 days ago",
    "job_title": "Sr. Python Developer",
    "location": "New York, NY",
    "salary": "\n$55 - $57 an hour",
    "summary": "Pipeline and the data intake.\nClaims line feed - File data.\nData from CMS with claim lines…two CCLF files are received.\nJob Types: Full-time, Contract.",
    "total_page_count": 1082,
    "url": "https://www.indeed.com/company/Scaleneworks-Inc/jobs/Senior-Python-Developer-c053c7fe6c20eb9a?fccid=532f4284a13e4a85&vjs=3"
  },
  {
    "company_name": "Systemonex INC",
    "date": "30+ days ago",
    "job_title": "Python Developer",
    "location": "New York, NY",
    "salary": "\n$35 - $45 an hour",
    "summary": "The company with relevant services and trustworthy efforts.\nSystemonex Inc maintains the standard as suitable scientific techniques and surveys.",
    "total_page_count": 1082,
    "url": "https://www.indeed.com/pagead/clk?mo=r&ad=-6NYlbfkN0BWDhERcgegtO3fQgQ6i1lKFLXqfs8lEm3nmlRKvZdoSOmcEpi6eRTO-dPxXMXK_bLJfB0mdH74lyan7FPkLG0nyn-IGtvU_7fsPnX_CNkm7Dr68KS75cPuHWBWvc-uk5d6aZXzcWOOljsXWltm_XCDo8UHn3syakNbh39sX7q2mZDpE5gRS2Bl8yTOiJoGRlck97y1-U9TRsFht7XEYoHj9J1eQ_VsAojC5h6Uw_Xz6BKtwGeo65ja6Zstwuhhyf5GVsBWXTKrFV8KUFZGn2YFNqwKrTtV8VtrxGZ0DsUjJJroWsow2ANPlE6Q4TSRbYsetoiFblzYG9ZS291uwYPcrBnZkjmZclGXH1NZtuYXRn0TlfcbuPxxDURQ_CxZFuu31QwMssp1_6n1Dq9ngE1dHlAKTmrGm6nnYRItGh3ufnJEz485FmqS8CF0A1-jlnAUgyP5LdzqS33Om31dgHIX&p=7&fvj=1&vjs=3"
  },
  {
    "company_name": "Magnus Technology Solutions Inc",
    "date": "16 days ago",
    "job_title": "Python Developer",
    "location": "New York, NY",
    "salary": "\n$84,584 - $213,022 a year",
    "summary": "Only US Citizen , GC-EAD , H4-EAD , L2-EAD can apply.\n2-5 or more years of experience with Python; full software development life-cycle, architecting scalable…",
    "total_page_count": 1082,
    "url": "https://www.indeed.com/company/EA-Learn/jobs/Python-Developer-4df58be94f2c9896?fccid=549e37b5057b3a77&vjs=3"
  },
  {
    "company_name": "Jarvis Cole, Inc.",
    "date": "2 days ago",
    "job_title": "Sr. Python Developer",
    "location": "New York, NY",
    "salary": "\n$125,000 - $175,000 a year",
    "summary": "You will be a founding member of the engineering team that will develop and maintain various software products.\nImprove functionality of existing systems.",
    "total_page_count": 1082,
    "url": "https://www.indeed.com/pagead/clk?mo=r&ad=-6NYlbfkN0BeqOXt1Ki4TgaqVzKgHyO684REiCAwMDt6QdkLJMyKFE4U8Gf44T3q6743LZi-2_p_XCppDVPFs_FE2Xe2i0aRPBH6weWkKtIUf_Grrt4Tj3ow6iUFIA2-9QmoH_gPNOf2__-lLNGwseqX1elCdYJ1hce2brqEDZaSa58An80ireOe4v6UfqDa5bKTzf8oK5Hdcxl8gffdnfk2EkXo3q2v7869TdwrrQ4m6ZmKK-nRWcwblJ72N-iVuVFw__pt3d5YIwKJinrY79wVVKS0NReWNL_WY5MJFnJNQoM_q6F4XfRujIXa7ckK1ALli0USGqa7znTkfe78NuXVf6OOGlHRoc8a0l0DjlhhGkE569hJB2TXtYwbXNaM3-XeTFCj04xo9MYiEtfhLKBDLO0d1Y_88dUmD5lwWQFlaFKoyIZreW7rKjIB3oUR256YZALE7G38z0TmIKFGnHjyDbw2afojk-C9kjbDl3s=&p=9&fvj=1&vjs=3"
  },
  {
    "company_name": "Oscar Health",
    "date": "1 day ago",
    "job_title": "Software Engineering Intern 2021",
    "location": "New York, NY",
    "salary": "none",
    "summary": "Our products and platform are built primarily in Python, JavaScript, Java, and Go.\nPublic-facing full-stack applications which inform our members about…",
    "total_page_count": 1082,
    "url": "https://www.indeed.com/rc/clk?jk=d8104b60c3d1eef6&fccid=402a1c36c3f1508f&vjs=3"
  },
  {
    "company_name": "iknowvate technologies",
    "date": "1 day ago",
    "job_title": "Python Engineer",
    "location": "New York, NY",
    "salary": "none",
    "summary": "The top 3 MUST HAVE requirements of the position (years exp, technical, etc.).\nMasters Degree in Financial Engineering or similar field (math, physics, computer…",
    "total_page_count": 1082,
    "url": "https://www.indeed.com/rc/clk?jk=88d41b4bb4a9cf00&fccid=9ace5aa4e4fa6ce2&vjs=3"
  },
  {
    "company_name": "ANB Sourcing LLC",
    "date": "1 day ago",
    "job_title": "Python Developer with Django-- W2 only",
    "location": "New York, NY",
    "salary": "\n$65 - $70 an hour",
    "summary": "Should have exp. with Python, Django.\nShould have exp with pl/sql.\nHealthcare exp. will be good to have.\nShould have good communication skills.",
    "total_page_count": 1082,
    "url": "https://www.indeed.com/company/ABN-Consulting/jobs/Python-Developer-Django-fc95d905d83d2f42?fccid=ec7869d226f1e8bb&vjs=3"
  },
  {
    "company_name": "GTS",
    "date": "30+ days ago",
    "job_title": "Junior Python Developer",
    "location": "New York, NY",
    "salary": "none",
    "summary": "GTS accounts for 3-5% of daily cash equities volume in the U.S. and trades over 30,000 different instruments globally, including listed and OTC equities, ETFs,…",
    "total_page_count": 1082,
    "url": "https://www.indeed.com/rc/clk?jk=f8f068da6dd93fa6&fccid=ca7680692810259a&vjs=3"
  },
  {
    "company_name": "VirtualApt",
    "date": "2 days ago",
    "job_title": "Web Developer/Programmer",
    "location": "New York, NY",
    "salary": "\n$15 - $30 an hour",
    "summary": "You will work closely with the company CTO to tackle both internal and client-facing challenges.\nExceptional candidates will have a vision for creating amazing…",
    "total_page_count": 1082,
    "url": "https://www.indeed.com/pagead/clk?mo=r&ad=-6NYlbfkN0CVAf6oTPDtTfmKtO4-T_C4VV_IxaVOo-w-kM61vHetcowAVLSDOmEOZ3gz60CcMgR81vvkJtMz0T5mWDjlbgKEo36seuKtdp8QtXuUrP2cMhwufhFKfDSTmUNiAD1NxzxCGbqbIoXgHlnLN_7VYBxja32O3-RhwXhegeF39Xj5davyneoTADCuvmQBSpxjp2WEGaFJxNSWwKUxyUGM_AHgzCmvnbY-soUIrEXCDqq2Yiwl0JpFym8YIttkhJmvJx_fme8bXtymfBEk60CrHOrfrYKgCKKj22ruB_EMzkh03IduNVGIdNnqBszE_rAWhZmCnpu8s-2a4JLb_HmlpYujmxdNPqpBSMgs1yS77KESSZLlJ6u8TDRDNQm0oaFELhfaO8v-xRnp1RMvpRkW5PWgFX0Hqy2nfSCXrRVnxBpaiwUys72n9gTMiKDvYyFzh54X4STyFcS3S-jYTTYASCH6&p=14&fvj=1&vjs=3"
  }
]

Install and Use

Install

Install the Algorithmia CLI client by running:

curl -sSLf https://algorithmia.com/install.sh | sh

Then authenticate by running:

$ algo auth
# When prompted for api endpoint, hit enter
# When prompted for API key, enter your key: YOUR_API_KEY
CLI Install Docs

Use



    algo run specrom/Extract_From_Indeed_Job_Scraper/0.1.5 -d '{"search_terms":"python programmer", "location":"New York, NY", "page":"1"}' --timeout 300
  
CLI Docs