Algorithmia Now Integrates with Amazon S3 and Dropbox We know how hard and frustrating it is to have data stored in one location when you need it in another. Wouldn’t it be better to not have to deal with uploading your data to a new service in order to work with it?

That’s why we’re excited to announce the Algorithmia Data Portal. This dedicated I/O hub – a starting point for reading and writing your data from any data source – makes it easy to connect with Amazon S3 and Dropbox to access your data where it’s at. Now, application developers can read their data from an external source, process it using the algorithmic microservices from Algorithmia, and then write the output where it’s needed. No DevOps required.

“Algorithms allow you to gain insights from your data, but without data, what do you need algorithms for?” Diego Oppenheimer says, Algorithmia CEO and co-founder. “That’s why we’re enabling Algorithmia users to access their data where it’s stored, removing the friction of using state-of-the-art algorithms to interpret, and extract insights from data.”

With the Algorithmia Data Portal, we’re addressing one of the core issues of data portability and interoperability. Algorithmia can now retrieve your data on-demand, removing the need for developers to ship or on-board their data in advance. We believe that ingesting, processing, and writing data should be as simple as an API call. 

To demonstrate, we’ve created an image processing pipeline in 10-lines of Python code. Simply by connecting to an existing data source, like Amazon S3 or Dropbox, we can easily batch process an entire folder of images. In this demo, we make an API call to our data source to list the files, then make another API call to Algorithmia’s SmartThumbnail microservice. The service processes each image, and then writes a new file to a folder in the same data source.

Here’s the image processing pipeline tutorial for Amazon S3, and for Dropbox.

Learn how to connect, configure, and read/write from your data in a few easy steps with our data portal guides below. If you have any questions or suggestions, please get in touch by email or @Algorithmia.

Don’t use Amazon S3 or Dropbox? No problem. Algorithmia also offers a free hosted data service for storing large files, preserving state, creating collections, and more.

Data Portal Guides

For the algorithm developer, Algorithmia hosted data is perfect for storing trained machine learning models and instantly turning them into a live, scalable API. For more, check out our guides for hosting your NLTK and scikit-learn models on Algorithmia.


For Application Developers

For Algorithm Developers

More About Algorithmia

We’ve created an open marketplace for algorithms and algorithm development, making state-of-the-art algorithms accessible and discoverable by everyone. On Algorithmia, algorithms run as microservices, creating the building blocks of algorithmic intelligence developers can use to create, share, and remix at scale.

By making algorithms composable, interoperable, and portable, algorithms can be written in any supported language, and then made available to application developers where the code is always “on,” and available via a simple REST API.

Application developers can access the API via our clients for Java, Scala, Python, JavaScript, Node.js, Ruby, Rust, CLI, and cURL. Our AWS Lambda blueprint is perfect for those working on event-driven and IoT-type projects.

Algorithmia is the largest marketplace for algorithms in the world, with more than 18,000 developers leveraging 2,000+ algorithms.