Azure Data Lake Storage Gen2 is a highly scalable and cost-effective data lake solution for big data analytics. It combines the power of a high-performance file system with massive scale and economy to help you speed your time to insight. Data Lake Storage Gen2 extends Azure Blob Storage capabilities and is optimized for analytics workloads.
N/A
HPE Data Fabric
Score 9.4 out of 10
N/A
HPE Data Fabric (formerly MapR, acquired by HPE in 2019) is a software-defined datastore and file system that simplifies data management and analytics by unifying data across core, edge, and multicloud sources into a single platform.
We have used both Hadoop and GCS buckets for our storage needs of very large healthcare data. In terms of comparison with the Hadoop distributed Files system, Azure Data Lake Storage always stands in a far better position due to easy integration with various latest and widely …
Azure Data Lake Storage from a functionality perspective is a much easier solution to work with. It's implementation from Amazon EMR went smooth, and continued usage is definitely better. However, Amazon EMR was significantly cheaper overall between the high transaction fees …
We chose Azure Data Lake due to the fact that it was already a product under the Azure application suite. We didn't have to focus on integrating another 3rd party application within our environment. Also due to the fact Azure Data Lake scales its storage pools very efficiently, …
We decided long ago to develop for the Azure platform, so we only evaluate products from within Azure. And Azure Data Lake Storage is really the dominant offering within its space. But to give you a comparison, previously we used to use Azure SQL Database for our analytical …
Microsoft solutions provide great harmony in end-to-end data value creation, and Azure Data Lake Storage is highly compatible with other analytical solutions, e.g., Azure Data Factory and Databricks. So I would say that it is at the heart of the analytical solution in the …
AWS charges you on an hourly basis but Azure has a pricing model of per minute charge. In terms of short term subscriptions, Azure has more flexibility but it is more expensive. Azure has a much better hybrid cloud support in comparison with AWS. AWS provides direct connections …
I am much more familiar with Snowflake. I thought it was fairly straightforward to use and did not have to learn much syntax. With Azure Data Lake Storage, I have had to learn some new syntax and thought there was a steeper learning curve. We selected it because of cost savings.
We looked at the Amazon solution and it did not play as well with our existing tools and added a layer of maintenance that we were not willing to take on at the time. We thought that our Microsoft contract and support were good and that our internal team had the knowledge to …
The Azure Data Lake solution is designed for organizations that want to take advantage of big data. It provides a data platform that can help developers, data scientists, and analysts store data of any size and format and perform all types of processing and analytics across …
Hortonworks and Cloudera are both sort of hacky. We have to do a lot of extra steps to automate those two. MapR has far fewer issues and doesn't force you into a once size fits all deployment scenario. There are multiple ways to deploy and some are more amenable to automation, …
When we were shopping, Mapr had the momentum, high availability even on Hadoop 1.x, an improved file system and better a central control system. Now it looks like the situation has changed a lot.
We supported all three Hadoop vendors with our Hadoop RDBMS product. Here's how I see the commercial Hadoop distribution world. If you need raw performance and don't mind proprietary technology, go with MapR. If you care about the most pure open source, go with Hortonworks. If …
Azure Data Lake storage is well suited for applications/use cases within organizations where capturing and storing large amounts of data in any format is required, primarily for storing and processing purposes. It's an easy and cost-effective cloud solution for your application data. The ability to integrate with other Azure Services like Azure Databricks and Azure Data Factory is superb.
If you need Hadoop and just need raw speed for I/O and have a Hadoop savvy group of engineers who don't need/like web UIs, then MapR is a great fit for you. If you are new to Hadoop or have DevOps folks that are not Hadoop gurus, choosing MapR as your Hadoop vendor will have a steeper learning curve as you will need to do more training and build more admin consoles for them.
Azure Data Lake Storage is extremely scalable. It allows us to scale up or down endlessly based on what we need including replication.
In terms of security, Azure Data Lake Storage fits our requirements really well as we can monitor and encrypt seamlessly. We can also assign permissions through roles and grant network-level access.
Due to the fact that it can scale, we are able to monitor the cost of storage and any given time and make financial decisions about our infrastructure based on how small or big we want to scale.
I'd like to see a better cross-platform native client. Azure Data Explorer is fine, but it's far from the "SSMS" kind of experience SQL Server users are used to.
Listing a large number of file is somewhat problematic and slow. Using the native C# library, running directly on an Azure VM, it can take several hours to list just a couple million files.
Switching from V1 to V2 requires the creation of a new Storage Account and that's pretty inconvenient.
I think MapR's main problem is name recognition. Hortonworks and Cloudera both are big names in the industry, but their deployment mechanisms are a little more difficult to use, especially when trying to fully automate it's deployment.
Documentation could always be better. But really, if that's your main weakness, it's everybody's weakness.
The Azure Data Lake solution is designed for organizations that want to take advantage of big data. It provides a data platform that can help developers, data scientists, and analysts store data of any size and format and perform all types of processing and analytics across multiple platforms and programming languages. It can work with your existing solutions, such as identity management and security solutions. It also integrates with other data warehouses and cloud environments. It can be useful for organizations that need the above softwares.
Hortonworks and Cloudera are both sort of hacky. We have to do a lot of extra steps to automate those two. MapR has far fewer issues and doesn't force you into a once size fits all deployment scenario. There are multiple ways to deploy and some are more amenable to automation, MapR just has that in spades
The cost can be high for more advanced work. In some cases, for instance, time limits and lab runtimes may be too short if you are too slow to learn what is explained as you go along.
promote flexible team communication. You can create different spaces for different teams, and share files and tasks.