specrom

specrom / Extract_From_Indeed_Job_Scraper / 0.2.0

Extract From Indeed (dot) Com: Jobs Scraper

350 Credit Royalty
Scrape job postings from indeed.com
Language
Python 3.x
Metrics
API Calls - 1,658 Avg call duration - 48.25sec
Permissions
The Algorithm Platform License is the set of terms that are stated in the Software License section of the Algorithmia Application Developer and API License Agreement. It is intended to allow users to reserve as many rights as possible without limiting Algorithmia's ability to run it as a service. Learn More
This is necessary for algorithms that rely on external services, however it also implies that this algorithm is able to send your input data outside of the Algorithmia platform.
This allows an algorithm to compose sophisticated functionality using other algorithms as building blocks , however it also carries the potential of incurring additional royalty and usage costs from any algorithm that it calls .

Run an Example

Input
Output
[
  {
    "company_name": "Barclays",
    "date": "8 days ago",
    "job_title": "newFront Office Python Developer",
    "location": "New York, NY 10019 (Midtown area)",
    "salary": "none",
    "summary": "\nAs a Barclays Python Developer, you will provide tactical solutions for the Quantitative index research activities of the Strategies trading desk which involves…\n",
    "total_page_count": 2998,
    "url": "https://www.indeed.com/rc/clk?jk=0b88fa21463577f2&fccid=057abf3fd357e717&vjs=3"
  },
  {
    "company_name": "AUGMENTED REALITY CONCEPTS INC",
    "date": "3 days ago",
    "job_title": "newJunior Software Engineer",
    "location": "New York, NY 10002 (Lower East Side area)",
    "salary": "none",
    "summary": "\nAt least one prior full-time position or internship as a software engineer or programmer.\nWrite and debug code to integrate SpinCar's software on customer…\n",
    "total_page_count": 2998,
    "url": "https://www.indeed.com/company/AUGMENTED-REALITY-CONCEPTS-INC/jobs/Junior-Software-Engineer-e21070913ea5c03d?fccid=e219ab9c1a97f910&vjs=3"
  },
  {
    "company_name": "Uber",
    "date": "1 day ago",
    "job_title": "newSoftware Engineer",
    "location": "New York, NY",
    "salary": "none",
    "summary": "\nDesign, deliver and maintain systems that enable thousands of engineers and managers to improve the reliability of their services, apps and processes.\n",
    "total_page_count": 2998,
    "url": "https://www.indeed.com/rc/clk?jk=90dc4c1dfb559cdc&fccid=f766f8bfbc3effb7&vjs=3"
  },
  {
    "company_name": "Goldman Sachs",
    "date": "30+ days ago",
    "job_title": "Machine Learning Engineer",
    "location": "New York, NY 10282 (Battery Park area)",
    "salary": "none",
    "summary": "\nThe financial industry thrives on data driven decision making.\nThe resulting systems are not only part and parcel of the daily life of hundreds of Goldman Sachs…\n",
    "total_page_count": 2998,
    "url": "https://www.indeed.com/rc/clk?jk=22cedeb251d86ad5&fccid=16a97ed26c75bf2d&vjs=3"
  },
  {
    "company_name": "MassMutual",
    "date": "30+ days ago",
    "job_title": "Full Stack Programmer",
    "location": "New York, NY 10004 (Financial District area)",
    "salary": "none",
    "summary": "\nYour job will require you to work closely with your fellow technology team members, to coordinate with QA resources, and to communicate with business team…\n",
    "total_page_count": 2998,
    "url": "https://www.indeed.com/rc/clk?jk=7a72d6e77feebe32&fccid=430cffbf1c607717&vjs=3"
  },
  {
    "company_name": "1DocWay",
    "date": "30+ days ago",
    "job_title": "Software Engineers & Web Developers",
    "location": "New York, NY",
    "salary": "none",
    "summary": "\nOur Engineering program prepares entry level candidates, who understand the fundamentals of web-development for an exciting and rewarding career in the health…\n",
    "total_page_count": 2998,
    "url": "https://www.indeed.com/rc/clk?jk=597b9830f39b5420&fccid=bc8bf69154b5fc28&vjs=3"
  },
  {
    "company_name": "JPMorgan Chase Bank, N.A.",
    "date": "11 days ago",
    "job_title": "Python/React developer",
    "location": "New York, NY",
    "salary": "none",
    "summary": "\nDesign and develop applications by gathering requirements from users.\nWrite maintainable & testable code using Python & React.\n",
    "total_page_count": 2998,
    "url": "https://www.indeed.com/rc/clk?jk=84cd5d4912bbccd3&fccid=aaf3b433897ea465&vjs=3"
  },
  {
    "company_name": "Splunk",
    "date": "30+ days ago",
    "job_title": "Software Engineer-Remote OK",
    "location": "New York, NY 10001 (Chelsea area)•Remote",
    "salary": "$95,000 a year",
    "summary": "\nSplunk's Cloud group is looking for a Software Engineer to help lead, design and develop continuous build and delivery for Cloud Infrastructure.\n",
    "total_page_count": 2998,
    "url": "https://www.indeed.com/rc/clk?jk=ae3139c2282ce2b2&fccid=aef928e89977f7f0&vjs=3"
  },
  {
    "company_name": "Ribbon Health",
    "date": "30+ days ago",
    "job_title": "Software Engineer (All Levels)",
    "location": "New York, NY",
    "salary": "none",
    "summary": "\nYou’ll be involved throughout the product lifecycle and collaborate closely with technical and non-technical stakeholders to understand our customers’ use cases…\n",
    "total_page_count": 2998,
    "url": "https://www.indeed.com/rc/clk?jk=2134c7942751417c&fccid=1b3df0faac85255e&vjs=3"
  },
  {
    "company_name": "Virtusa",
    "date": "1 day ago",
    "job_title": "newPython GCP Engineer",
    "location": "New York, NY",
    "salary": "none",
    "summary": "\nProfessional experience working as a lead python engineer on GCP.\nPython, Python web frameworks, Jenkins, Snowflake, Docker, Kubernetes, Helm.\n",
    "total_page_count": 2998,
    "url": "https://www.indeed.com/rc/clk?jk=1d9c4728b8f035d2&fccid=146443e77d8c0778&vjs=3"
  },
  {
    "company_name": "Udacity",
    "date": "Today",
    "job_title": "newMentors (Independent Contractor) - Machine Learning Engineer...",
    "location": "New York, NY",
    "salary": "none",
    "summary": "\nTechnical Competence: Python, Panda, AWS, ML Models, API, Computer Vision, NLP, Deep Learning.\nFlexibility for part-time, independent contract work.\n",
    "total_page_count": 2998,
    "url": "https://www.indeed.com/rc/clk?jk=7623faf5dd2540dc&fccid=1503f9b2e8718009&vjs=3"
  },
  {
    "company_name": "Loadsmart",
    "date": "16 days ago",
    "job_title": "Python Backend Engineer",
    "location": "New York, NY",
    "salary": "none",
    "summary": "\nDiscuss good practices for software modularization and feel comfortable suggesting contributions to build our set of internal guidelines and shared code.\n",
    "total_page_count": 2998,
    "url": "https://www.indeed.com/company/Loadsmart/jobs/Python-Backend-Engineer-3f9c51f500feb55b?fccid=bf02915605893e1a&vjs=3"
  },
  {
    "company_name": "JPMorgan Chase Bank, N.A.",
    "date": "15 days ago",
    "job_title": "Software Engineer - All Levels",
    "location": "New York, NY",
    "salary": "none",
    "summary": "\nDesign technology solutions on different scales.\nDevelop and unit test software application modules using disciplined software development processes (Agile).\n",
    "total_page_count": 2998,
    "url": "https://www.indeed.com/rc/clk?jk=4cf060bc16d3fcca&fccid=aaf3b433897ea465&vjs=3"
  },
  {
    "company_name": "Goldman Sachs",
    "date": "14 days ago",
    "job_title": "Software Engineer - AMD Engineering",
    "location": "New York, NY 10282 (Battery Park area)",
    "salary": "none",
    "summary": "\nAMD Technology is directly aligned to the business.\nGoldman Sachs Engineers are innovators and problem-solvers, building solutions in risk management, big data,…\n",
    "total_page_count": 2998,
    "url": "https://www.indeed.com/rc/clk?jk=022e3df8954188b0&fccid=16a97ed26c75bf2d&vjs=3"
  },
  {
    "company_name": "TEACHERS RETIREMENT SYSTEM",
    "date": "11 days ago",
    "job_title": "Computer Programmer Analyst College Aide",
    "location": "Manhattan, NY",
    "salary": "$16.02 - $19.00 an hour",
    "summary": "\nThe Computer Programmer Analyst College Aide will apply his/her skills to develop high-quality software for various pension administration related core and…\n",
    "total_page_count": 2998,
    "url": "https://www.indeed.com/rc/clk?jk=3323dc87ab1a1edd&fccid=fc9a452ddd49e00a&vjs=3"
  }
]

Install and Use

Install

Install the Algorithmia CLI client by running:

curl -sSLf https://algorithmia.com/install.sh | sh

Then authenticate by running:


          $ algo auth
# When prompted for api endpoint, hit enter
# When prompted for API key, enter your key: YOUR_API_KEY
      
CLI Install Docs

Use



    algo run specrom/Extract_From_Indeed_Job_Scraper/0.2.0 -d '{"search_terms":"python programmer", "location":"New York, NY", "page":"1"}' --timeout 300
  
CLI Docs