specrom

specrom / Extract_From_Indeed_Job_Scraper / 0.1.9

Extract From Indeed (dot) Com: Jobs Scraper

50 Credit Royalty
Scrape job postings from indeed.com
Language
Python 3.x
Metrics
API Calls - 1,274 Avg call duration - 7.49sec
Permissions
The Algorithm Platform License is the set of terms that are stated in the Software License section of the Algorithmia Application Developer and API License Agreement. It is intended to allow users to reserve as many rights as possible without limiting Algorithmia's ability to run it as a service. Learn More
This is necessary for algorithms that rely on external services, however it also implies that this algorithm is able to send your input data outside of the Algorithmia platform.
This allows an algorithm to compose sophisticated functionality using other algorithms as building blocks , however it also carries the potential of incurring additional royalty and usage costs from any algorithm that it calls .

Run an Example

Input
Output
[
  {
    "company_name": "Systemonex INC",
    "date": "30+ days ago",
    "job_title": "Python Developer",
    "location": "none",
    "salary": "\n$35 - $45 an hour",
    "summary": "\n\nThe company with relevant services and trustworthy efforts.\nSystemonex Inc maintains the standard as suitable scientific techniques and surveys.\n",
    "total_page_count": 1686,
    "url": "https://www.indeed.com/pagead/clk?mo=r&ad=-6NYlbfkN0BWDhERcgegtO3fQgQ6i1lKFLXqfs8lEm3nmlRKvZdoSOmcEpi6eRTO-dPxXMXK_bLJfB0mdH74lyan7FPkLG0nyn-IGtvU_7fsPnX_CNkm7Dr68KS75cPuHWBWvc-uk5d6aZXzcWOOljsXWltm_XCDo8UHn3syakNbh39sX7q2mTin6zlqcVHlC10x-VmvkunwQ-EbEkBFq9Fwn4Z3AlUuEIQzinZsgE65VxEuGZs1m3lNA6pEaMhtnqdv-Hw3v2uB79ztjwaPEVBVzU6TIEygYukEt0tiUuLABF4ASmMorWEaNg1hFG7AVkMh49azxlJxh_A68QM09jIA6SSdJk57ssC7pCWEuj1lZlvCIgjbsoRcsliqu1SKK26ceypkwyVKA2OGmtCDOVI8GsrscWWPXChbcpQ4EMPGRJbYDYwIzkeCjMDXiCCXGczPI1ASyIsOVsTf2nAfNrJaQvv18JZi&p=0&fvj=1&vjs=3"
  },
  {
    "company_name": "Grady Levkov & Co",
    "date": "8 days ago",
    "job_title": "Mid Level C# and Python Developer",
    "location": "none",
    "salary": "\n$150,000 - $250,000 a year",
    "summary": "\n\nExcellent communication skills a must.\nAnalyze user needs and develop software solutions.\nCollaborate with other developers to design and optimize code.\n",
    "total_page_count": 1686,
    "url": "https://www.indeed.com/pagead/clk?mo=r&ad=-6NYlbfkN0A2ClPHAcZk25iyIaI_iBnkKFS5uIZz-XdgYUIihhxDXVlzLD8-8ldl8Qpx3_kgji7CPhOn7MPLWQGxQ0m_1gAnH-z2UB6CRy_yf8xuBqm6XU3GqtjflARno9_FASjnX_gltWwECumanwphSr_AjiegXoLGCgnQVrO160_mVcUEmKmNsNg72BNQaMeCtVtkrXxnEyjG52iWNjeBGkbowR4-cuq7FcxyEcH5L-sSEmnnrnxR-q9FpJzNZCAj2yw8nlMTdZAebFmkLphQNHgFS7z2WMoiJK1wCfxSfNATmOwvHpcxdXh1neQPwGt8lUre66BQZaPKtHmAjfnKACLDFj0MACpGyCXA_ubOVBiixcxFQWywEfr06nSA811z6Ma50LOHMVxalhFZu52AgPhNZcOzMfZyBp8w8sZVsLMds8i2d_-5bM84_5wc-x2mVU3siKCfoHA_oHj4Kj5Svmo_QUEKziHMUYcbYc8-Sj9T6sU6Gw==&p=1&fvj=1&vjs=3"
  },
  {
    "company_name": "Summit Tech Partners",
    "date": "3 days ago",
    "job_title": "Python Developer",
    "location": "none",
    "salary": "\n$55 - $60 an hour",
    "summary": "\n\nDesign and develop software programs and database objects.\nRecommend software improvements to ensure strong functionality and optimization.\n",
    "total_page_count": 1686,
    "url": "https://www.indeed.com/pagead/clk?mo=r&ad=-6NYlbfkN0Cx9WzmcffLUtGR8SIC5cyTCx17l4i9Xvh_30rVFfauM4CQGUCJMCiTl6oH6DOFsOw2F2ehnXGsszvaobRggq0QSe_vQwcMfHIx4Fsr1CvFE5pkUzSxxzJqacYrJtNnlocIhXplCOvP_-mtNIAEgkwZsPxbmTWNCrqkVqUwTUppP9vNF5ybaH4hlTKob00sQ6ShoGRihz-gIpaiZ2TgNmz_MC8rL7EqJkpOafkDTBaWOAzWMY9aOa90KKJvpgKs9JAImTkNbc_eAB5ujq_2P5GVRZJ7Ut4PsHt-reVB-jph-wSqH4q4gA-VJYqwUDjT8VmFeOCLl1_P8iJCVji2TPnwTudTWtEYfShYL62bWgSHQybYR3jEs3M_736Qh83s_hU4IEK7d_1Snq_mXVyCTwnhsXbMd6qTa9etHtZeogAe_8GOOFaJRGNf601Ty376iTbwzY-uslK3PKFBlq2IfReLGOe06jSLPaY=&p=2&fvj=1&vjs=3"
  },
  {
    "company_name": "Smoothstack",
    "date": "30+ days ago",
    "job_title": "Entry Level Software Developer",
    "location": "none",
    "salary": "\n$50,000 - $55,000 a year",
    "summary": "\n\nO Basic knowledge of Java, C#, .\nNet, Python, or similar programming languages.\nO Hands-on experience or bachelor’s degree or minor in any of the following:…\n",
    "total_page_count": 1686,
    "url": "https://www.indeed.com/cmp/Smoothstack-Inc."
  },
  {
    "company_name": "Hudson River Trading",
    "date": "30+ days ago",
    "job_title": "Algo Software Engineer (C++/Python)",
    "location": "none",
    "salary": "none",
    "summary": "\n\nAlgo Software Engineers (AE) are programmers that are embedded in HRT's trading teams and work hand-in-hand with Algo Strategy Developers (AD).\n",
    "total_page_count": 1686,
    "url": "https://www.indeed.com/pagead/clk?mo=r&ad=-6NYlbfkN0ApzxvIc50HcKj8BAybGugjBuKrONKyeCp_AR1ox5bF72DwDsD9iEnpPVATIb1d44LXYfufXNpoyhqiUZkSN_Z9iRpVJlqhF0wP1I8-fj5C-gHDWqXwVnnlC25PMfbXSW9LoRFZK9WRmezPHzMrZdmiT6fGW7muO6fyuDhAzejz-ZK3Nb14J8QMjDq4WBuQbMMOH7OmDh01lJ_sRtGXwNlg_BaRMGxAr8b-rfowVVFWyMneN_IHodcO0MXXWqfivzM1SU1sL8TkhcNB0Xt5QI29ojzNaCfioAGFQ74C-UE2ASwWR--6-AZSI-DbJNaW3JGo-GtL3w6wA1V4_6ZAd96RhBPRvRqlmrf7yVXzH_951uGKPRPI-PskmanTm98JyEPgjvPYX65s6Q==&p=4&fvj=0&vjs=3"
  },
  {
    "company_name": "Katana Financial",
    "date": "6 days ago",
    "job_title": "Junior Python Developer",
    "location": "New York, NY 10007 (Tribeca area)",
    "salary": "\n$80,000 - $100,000 a year",
    "summary": "\n\nWe are looking for a mathematically and statistically adept Python developer with crypto/digital asset data experience to help us build our digital asset quant…\n",
    "total_page_count": 1686,
    "url": "https://www.indeed.com/company/Katana-Financial/jobs/Junior-Python-Developer-e5ea56e308e1258b?fccid=8facda9ef34154c5&vjs=3"
  },
  {
    "company_name": "Bitpush Inc.",
    "date": "30+ days ago",
    "job_title": "(Remote) Need experienced Python developer - intern or part-time",
    "location": "none",
    "salary": "none",
    "summary": "\n\nWe are recruiting intern and/or part-time Python developer to help build an advanced computing engine to grab, analyze and store trading data and integrate…\n",
    "total_page_count": 1686,
    "url": "https://www.indeed.com/pagead/clk?mo=r&ad=-6NYlbfkN0CVH-yy-CyZpBtZG6Y7k0Eyf5wlURKfDtiMTsrjQkWWz5uyfuRvksGjYZRINkMSDHlmiaWxdplYJ632iFy_BlufGlQM5X1RaOn5RdBKWXiaHA5mMK4mUdEhYXKOvPzn8GNcp9aMkTKTaIanifboHUcqop2BkSF4fAroc6VpYJW42hIVPxHGF2BnLHQXgzKVJ-OstyVMAQaZ5H0v3HdZWLfBjwU0SRSWzmNMdEzhByAo9zJ1U0XsOXXgo5WqFTUFMtx1Tb5jh66--aWDXYuXjklegiqaSijWBOFq6Mgnd9SjMtQfHIKVJk2L5FT-9Zpyn45RQnbLAYTG_eAcewByZ-1bx1jdP--s2szbD6awcDQhzukWIeC4BgZLfy8_D0gv6CBKCxvONWY-I0jpwJfUIG-vMWlG3JZTgx9NxEhuH1xrg7qq29AvO0Acd2bzWVfxKuhwMJvcgap9jY3jaSL1oErBbbve2U7MlHRl2HovKkpL-TlFXnJRNE95KTAJmWM5AcBx3UdywE4RUA==&p=6&fvj=1&vjs=3"
  },
  {
    "company_name": "Dash Technologies Inc",
    "date": "2 days ago",
    "job_title": "Jr. Python Developer",
    "location": "New York, NY",
    "salary": "\n$73,795 - $132,957 a year",
    "summary": "\n\nDevelop back-end components to improve responsiveness and overall performance.\nIntegrate user-facing elements into applications.\nJob Types: Full-time, Contract.\n",
    "total_page_count": 1686,
    "url": "https://www.indeed.com/company/Dash-Technologies-Inc/jobs/Junior-Python-Developer-7ca89883b29b4fc2?fccid=899d5c87949021be&vjs=3"
  },
  {
    "company_name": "BlackRock",
    "date": "5 days ago",
    "job_title": "Associate, Software Engineer (Java/Python) - New York, NY",
    "location": "New York, NY",
    "salary": "none",
    "summary": "\n\nBlackRock offers a range of solutions — from rigorous fundamental and quantitative active management approaches aimed at maximizing outperformance to highly…\n",
    "total_page_count": 1686,
    "url": "https://www.indeed.com/rc/clk?jk=6bd065ff9687f90b&fccid=58c732f14833248a&vjs=3"
  },
  {
    "company_name": "Emonics LLC",
    "date": "2 days ago",
    "job_title": "Python Developer",
    "location": "Jersey City, NJ",
    "salary": "\n$60,000 - $110,000 a year",
    "summary": "\n\nLocation: Jersey City, NJ (Must be open for Relocation across all US)*.\nExpertise in at least one popular Python framework (like Django, Flask or Pyramid).\n",
    "total_page_count": 1686,
    "url": "https://www.indeed.com/company/Emonics-LLC/jobs/Python-Developer-967f1833ab235950?fccid=28ce6cdf6e3af83d&vjs=3"
  },
  {
    "company_name": "Etsy",
    "date": "30+ days ago",
    "job_title": "Software Engineer, Help Me Grow",
    "location": "Brooklyn, NY 11201",
    "salary": "none",
    "summary": "\n\nProviding sellers with the data and reports they need to understand how their shop is performing.\nWe also use a lot of other technologies and languages – Scala…\n",
    "total_page_count": 1686,
    "url": "https://www.indeed.com/rc/clk?jk=6eb4aa0e384b5d53&fccid=9ecb91618c39a24f&vjs=3"
  },
  {
    "company_name": "Hearst Media Services",
    "date": "9 days ago",
    "job_title": "Software Engineer, Python",
    "location": "New York, NY",
    "salary": "none",
    "summary": "\n\nParticipate in product and software design discussions, working directly with other engineers, product and design teams, DevOps, and other stakeholders.\n",
    "total_page_count": 1686,
    "url": "https://www.indeed.com/rc/clk?jk=a07b268e5108d423&fccid=02bd2bdda97deebf&vjs=3"
  },
  {
    "company_name": "Gallery Media Group",
    "date": "6 days ago",
    "job_title": "JUNIOR FRONTEND ENGINEER",
    "location": "New York, NY",
    "salary": "none",
    "summary": "\n\nWe are seeking a full-time Frontend Engineer for the New York City office (Remote till we return to the office).\n",
    "total_page_count": 1686,
    "url": "https://www.indeed.com/rc/clk?jk=e1b6e869679ab208&fccid=8a2fab7a8b6807c6&vjs=3"
  },
  {
    "company_name": "Lazard Ltd.",
    "date": "30+ days ago",
    "job_title": "2021 Software Engineer Summer Internship",
    "location": "New York, NY",
    "salary": "none",
    "summary": "\n\nThe primary responsibility is designing, building, testing, and maintaining large-scale software applications and data products.\n",
    "total_page_count": 1686,
    "url": "https://www.indeed.com/rc/clk?jk=bfaee5060a21d174&fccid=f16b975bd9c56fcd&vjs=3"
  },
  {
    "company_name": "Morgan Stanley",
    "date": "30+ days ago",
    "job_title": "Python Developer",
    "location": "New York, NY",
    "salary": "none",
    "summary": "\n\nThe project involves data warehousing and a data access layer that provides transparent access to data.\nSolid knowledge of the UNIX/Linux environment.\n",
    "total_page_count": 1686,
    "url": "https://www.indeed.com/rc/clk?jk=802c2e8d0359c9e1&fccid=0c39fb2c91742dcf&vjs=3"
  }
]

Install and Use

Install

Install the Algorithmia CLI client by running:

curl -sSLf https://algorithmia.com/install.sh | sh

Then authenticate by running:


          $ algo auth
# When prompted for api endpoint, hit enter
# When prompted for API key, enter your key: YOUR_API_KEY
      
CLI Install Docs

Use



    algo run specrom/Extract_From_Indeed_Job_Scraper/0.1.9 -d '{"search_terms":"python programmer", "location":"New York, NY", "page":"1"}' --timeout 300
  
CLI Docs