Amazon S3 (Simple Storage Service) vs. Azure Data Lake Storage

For archiving old data that is infrequently accessed it is perfect. You can choose to let it go into cold/glacier storage which saves even further costs but at the expense of accessibility. I like that you can set access rules to automatically move it to the next storage tier after a certain amount of time that it has not been accessed. I also use it a lot with PHP via the API. We have some custom in-house applications that have a fair amount of data uploaded into them. S3 has been a perfect solution to store these files, taking the load off web servers and never having issues with running out of storage.

Incentivized

Azure Data Lake storage is well suited for applications/use cases within organizations where capturing and storing large amounts of data in any format is required, primarily for storing and processing purposes. It's an easy and cost-effective cloud solution for your application data. The ability to integrate with other Azure Services like Azure Databricks and Azure Data Factory is superb.

Incentivized

• Reliable and secure way to store objects in cloud: Storing any type of file(text, pdf, doc, csv, etc) is very easy with S3. Fetching this stored content as and when you require is also pretty easy and can be done using both the console and AWS CLI. Appropriate permissions can be set up for buckets using IAM roles/policies.
• Versioning in buckets: S3 gives you a very handy feature to store multiple versions of objects stored in a bucket.
• Lifecycle policies: You can set up lifecycle policies in S3 that can move your older objects to IA or Glacier. This setup is very easy and can be done within minutes for a bucket.
• Replication: The cross-region replication that S3 provides is wonderful. Beware of the inter-regional data transfer costs though.

Incentivized

• Azure Data Lake Storage is extremely scalable. It allows us to scale up or down endlessly based on what we need including replication.
• In terms of security, Azure Data Lake Storage fits our requirements really well as we can monitor and encrypt seamlessly. We can also assign permissions through roles and grant network-level access.
• Due to the fact that it can scale, we are able to monitor the cost of storage and any given time and make financial decisions about our infrastructure based on how small or big we want to scale.

Incentivized

• The biggest problem is to rename the bucket. There is no direct way to do it. One need to copy entire content to the different bucket with intended bucket name and then remove the old bucket. Sometimes it creates issues.
• There is no direct way to upload .zip file and extract it to inside the bucket.
• While uploading large files, sometimes you will find a drop of upload speed. I observe it so many times and while checking my internet speed, I find it absolutely perfect. So there must have something wrong on the AWS side.

Incentivized

• I'd like to see a better cross-platform native client. Azure Data Explorer is fine, but it's far from the "SSMS" kind of experience SQL Server users are used to.
• Listing a large number of file is somewhat problematic and slow. Using the native C# library, running directly on an Azure VM, it can take several hours to list just a couple million files.
• Switching from V1 to V2 requires the creation of a new Storage Account and that's pretty inconvenient.

Incentivized

Due to princing, availability and scalability.

Incentivized

The UI could have some improvements (better filters) and there is a lack of some useful functionality, such as renaming an existing bucket: the latter is much needed in the context of rapidly evolving companies. Overall though, Amazon S3 (Simple Storage Service) is easy to use and to onboard people and tools to, thanks to its various APIs and flexibility.

Incentivized

It depends on your tier within Amazon on how great of support you get. For us we have a dedicated Point of Contact that is great in taking in what we need and discussing it with the S3 team. The best thing is features we need or suggest have a good chance of landing on their roadmap.

Incentivized

S3 is the most mature simple storage service on the web. It has direct competitors from Google and Azure, as well as a bunch of other competitors that focus on different aspects. For example, Backblaze specializes on file backups, and while s3 can also be used for that, Backblaze provides a better price point in exchange for more focused functionality. S3 really shines in that it performs simple things astonishingly well, while also being flexible enough to stretch itself to other situations (data lakes, file mounts, backup/restores systems, web hosting, etc.).

Incentivized

The Azure Data Lake solution is designed for organizations that want to take advantage of big data. It provides a data platform that can help developers, data scientists, and analysts store data of any size and format and perform all types of processing and analytics across multiple platforms and programming languages. It can work with your existing solutions, such as identity management and security solutions. It also integrates with other data warehouses and cloud environments. It can be useful for organizations that need the above softwares.

Incentivized

• Allows us to store large amounts of raw traffic from data providers to allow us to view data our systems received at particular times, in order to reconstruct inputs in case of errors
• Is capable of storing very large amounts of data cheaply without material impact to our business

Incentivized

• The cost can be high for more advanced work. In some cases, for instance, time limits and lab runtimes may be too short if you are too slow to learn what is explained as you go along.
• promote flexible team communication. You can create different spaces for different teams, and share files and tasks.

Incentivized