Databricks Data Intelligence Platform vs. Vertex AI

If you need a managed big data megastore, which has native integration with highly optimized Apache Spark Engine and native integration with MLflow, go for Databricks Lakehouse Platform. The Databricks Lakehouse Platform is a breeze to use and analytics capabilities are supported out of the box. You will find it a bit difficult to manage code in notebooks but you will get used to it soon.

Incentivized

Since we have used this platforms in multiple scenarios we can confidently say that where this excels is when you want to combine free form Q&A bots with structured responses. Gemini shines through and stands tall with it's natural language model and accurate reading of knowledge base to provide the best answers to whatever prompt you can throw at it.

Incentivized

• There is databricks community, which is a free version. It is available for beginners to have an easy start with a big data platform. It does not have every feature of the full version but is still adequate for extremely new coders.
• There are many resourceful training elements that are available to developers, data scientists, data engineers and other IT professionals to learn Apache Spark.

Incentivized

• Vertex AI comes with support for LOTs of LLMs out of the box
• MLOps tools are available that help to standardize operational aspects
• Document AI is an out of the box feature that works just perfectly for our use cases of automating lots to tedious data extraction tasks from images as well as papers

Incentivized

• Connect my local code in Visual code to my Databricks Lakehouse Platform cluster so I can run the code on the cluster. The old databricks-connect approach has many bugs and is hard to set up. The new Databricks Lakehouse Platform extension on Visual Code, doesn't allow the developers to debug their code line by line (only we can run the code).
• Maybe have a specific Databricks Lakehouse Platform IDE that can be used by Databricks Lakehouse Platform users to develop locally.
• Visualization in MLFLOW experiment can be enhanced

Incentivized

• Customization of AutoML models - A must needed capability to be able to tweak hyperparameters and also working with different models
• Model Explainability -Providing more comprehensive explanations about how models are utilizing features could be very beneficial
• Model versioning and experiments tracking - Enhancing the versioning capability could be good for end users

Incentivized

Because it is an amazing platform for designing experiments and delivering a deep dive analysis that requires execution of highly complex queries, as well as it allows to share the information and insights across the company with their shared workspaces, while keeping it secured.

in terms of graph generation and interaction it could improve their UI and UX

Incentivized

Google is always top notch with their security and user interface performance. We use Google's entire suite in our business anyways, so using Vertex became second nature very quickly. I will say, though, that Google does need to come down on the price somewhat with their token allocation. Also, their UI is very robust, so it does require some time for training to really master it.

Incentivized

One of the best customer and technology support that I have ever experienced in my career. You pay for what you get and you get the Rolls Royce. It reminds me of the customer support of SAS in the 2000s when the tools were reaching some limits and their engineer wanted to know more about what we were doing, long before "data science" was even a name. Databricks truly embraces the partnership with their customer and help them on any given challenge.

Databricks is a true all-in-one platform, and at the time of implementation, it had more features available to us, making it a clear choice over Snowflake. Moving our workloads from local computing to the servers in Databricks gave our start-up staff a great quality of life boost.

Incentivized

Out the gate, Vertex just seemed to be more accurate on command with our prompts. We spent less time versus other platforms getting exactly what we wanted. Google's UI is way more robust, too, with how you can configure the exact settings you want when doing image generation. The other platforms do a decent job, but we've gravitated more towards using Vertex now.

Incentivized

• ROI for us has been tremendous. Time to market by processing raw data in our big data infrastructure has been pretty fast.
• Non engineers can easily use Databricks, hence helping business customers.
• Thousands of different data combinations can easily be joined and used by our data teams.

Incentivized

• It is pay as you go model so it'll save more cost of your org. In our case previously we used to incurred 1-2L/Month now we are reduced it to 80k-1L.
• It'll help you save your model training & model selection time as it provides pre-trained models in autoML.
• It'll help you in terms of Security wherein we can use row level security access to authorized persons.

Incentivized