AWS CodePipeline vs. Azure DevOps Services

Overview
ProductRatingMost Used ByProduct SummaryStarting Price
AWS CodePipeline
Score 6.6 out of 10
N/A
AWS CodePipeline is a fully managed continuous delivery service that helps users automate release pipelines. CodePipeline automates the build, test, and deploy phases of the release process every time there is a code change, based on the release model a user defines.
$1
per active pipeline/per month
Azure DevOps Services
Score 7.7 out of 10
N/A
Azure DevOps (formerly VSTS, Microsoft Visual Studio Team System) is an agile development product that is an extension of the Microsoft Visual Studio architecture. Azure DevOps includes software development, collaboration, and reporting capabilities.
$2
per GB (first 2GB free)
Pricing
AWS CodePipelineAzure DevOps Services
Editions & Modules
AWS CodePipeline
$1
per active pipeline/per month
Free Tier
Free
Azure Artifacts
$2
per GB (first 2GB free)
Basic Plan
$6
per user per month (first 5 users free)
Azure Pipelines - Self-Hosted
$15
per extra parallel job (1 free parallel job with unlimited minutes)
Azure Pipelines - Microsoft Hosted
$40
per parallel job (1,800 minutes free with 1 free parallel job)
Basic + Test Plan
$52
per user per month
Offerings
Pricing Offerings
AWS CodePipelineAzure DevOps Services
Free Trial
NoNo
Free/Freemium Version
YesNo
Premium Consulting/Integration Services
NoNo
Entry-level Setup FeeNo setup feeNo setup fee
Additional Details
More Pricing Information
Community Pulse
AWS CodePipelineAzure DevOps Services
Considered Both Products
AWS CodePipeline
Chose AWS CodePipeline
I haven't used any other similar products.
Chose AWS CodePipeline
CodeCommit and CodeDeploy can be used with CodePipeline so it’s not really fair to stack them against each other as they can be quite the compliment. The same goes for Beanstalk, which is often used as a deployment target in relation to CodePipeline. CodePipeline fulfills the …
Chose AWS CodePipeline
We selected AWS CodePipeline mainly because we wanted to keep the application stack completely native to AWS, and CodePipeline provided the best integrations with AWS services that we were using, such as S3, Elastic Beanstalk, and Lamba. Furthermore, AWS CodePipeline provided …
Chose AWS CodePipeline
AWS Codepipeline is proprietary to Amazon Web Services and works well when you're working with other AWS products. If you're using a different technology stack, then Codepipeline may not be the best tool and some open source/closed source tools available on the web may suffice.
Chose AWS CodePipeline
We selected CodePipeline again, because it integrates well with our AWS Based infrastructure.
Chose AWS CodePipeline
They all pretty much have the same feature set. AWS CodePipeline has been improving in recent years, and it just makes sense to keep everything within Amazon's ecosystem.
Chose AWS CodePipeline
I felt that, out of the alternatives, AWS CodePipeline was the simplest to setup and most reliable. Since my client's infrastructure was already hosted in AWS, I felt it was a no-brainer. If a client needed a similar solution with on-prem or non-AWS infrastructure, I would …
Azure DevOps Services
Chose Azure DevOps Services
Jira is fantastic for project management and customer facing portal. It is not good for pure development (no integration with Git, pipeline management, automated testing features). If DevOps were to integrate and adopt the project features of Jira as well as the customer facing …
Chose Azure DevOps Services
Azure DevOps provides integrated environment vs Jira is dependent on third party for couple of features
Chose Azure DevOps Services
The moment I have been working with this tool everything has benn operating efficiently. The software development process has borne positive results under scalable environment. The cost of running Azure DevOps Services us much lower as compared to other tools in the market. It …
Chose Azure DevOps Services
ADO has better linking than Confluence and is adaptable for a specific need, whereas Confluence might be a bit more rigid, but it's also sort of along the same lines as to what can be done with both tools. ADO also had an ease of use to it and can do a bunch of stuff with it, …
Chose Azure DevOps Services
Jira is super clunky and doesn't behave in a modern fashion. monday.com is too flexible and doesn't provide enough feature set. AWS is the most competitive, but it's hard to wrap your brain around all of the features and offerings provided by amazon. ADO does a better job of …
Chose Azure DevOps Services
Azure DevOps has a drag and drop editor so that you can quickly drag build steps into a build or release pipeline. This is much faster than looking up the correct yaml syntax. Additionally, its support for Microsoft and Azure is great. If you're on the .net stack or you use …
Chose Azure DevOps Services
As a cloud services user of Azure, using Azure DevOps made sense because it has the most support tailored for Azure ecosystem.
Chose Azure DevOps Services
Microsoft Planner is used by project managers and IT service managers across our organization for task tracking and running their team meetings. Azure DevOps works better than Planner for software development teams but might possibly be too complex for non-software teams or …
Chose Azure DevOps Services
Graphically it overtakes the grade of traceability of artifacts delivered to environments More user-friendly to orchestrate the deliveries.
Chose Azure DevOps Services
Trello is simple to use, but it's only for a Kanban board. Jira might be the same, but I don't really have enough experience with Jira to fully compare them. When I used it, it missed certain functionalities that I was used to in Azure DevOps. Visually it's a lot different too.
Chose Azure DevOps Services
Azure DevOps Services have huge functionality and are well supported by Microsoft as well. You will get plenty of features in the marketplace and learning documentation.
Chose Azure DevOps Services
Writing the Docker Images, Storing them in Azure Container Registry and then Deploying onto Azure Kubernetes Services is an Easier process which no other software/product is currently providing in the market. Best till date in terms of End to End deployment and maintaining …
Chose Azure DevOps Services
Azure DevOps is widely used because of its collaboration and integration with various other tools. Here the assign of the sub task is quite easy compare to Jira. Also Azure Devops can we integrate easily with Git for better code representation and versioning. It reporting is …
Chose Azure DevOps Services
Azure DevOps is a completed product and ecosystem. It offers a robust ecosystem that does everything that is needed. The above products do lack features like pipelines tasks, third-party integrations. Besides all cloud benefits, the main advantage of Azure DevOps Services …
Chose Azure DevOps Services
Currently, we use both products, however, we use more the Atlassian suite. We have started recently using Azure DevOps for specific implementations and projects. We don't have any plan yet to migrate all our projects to Azure DevOps, we may in the next couple of years. …
Chose Azure DevOps Services
We tested alternatives for Azure DevOps over time. We tested GitHub a while ago and back then lack of some features that now hast, like the project boards and private repositories. We will check GitHub next year.

We also tested AWS CodeCommit and found it very cryptic, …
Chose Azure DevOps Services
Beside all cloud benefits, the main advantage Azure DevOps Services compared to Azure DevOps Server is the easier remote access for third party team members, and always up to date software.
On the other hand, on prem deployment (Azure DevOps Server) makes complex access or …
Chose Azure DevOps Services
The greatest strength of Azure DevOps Services (formerly VSTS) is that it's a one-stop solution for all agile project management instead of setting up bits of different software put together for each and every need. Azure DevOps Services (formerly VSTS) has a great ecosystem …
Chose Azure DevOps Services
I prefer Azure Devops over all other code repository / ci/cd systems that I've used in the past. All features are integrated into a single service (back log, repo mgmt, deployment pipelines, artifacts, etc.). The tools are easy to use and super powerful.
Chose Azure DevOps Services
Our company is already using a lot of Azure services and it makes more sense to start using Azure DevOps Services (formerly VSTS) when we needed a CI/CD tool. We tested different features of Azure DevOps Services (formerly VSTS) and found out that the build and release …
Chose Azure DevOps Services
One of the foremost reasons that acted in favor of Azure DevOps was its all-in-one packed web portal which enabled easy access to all the CI/CD tools and kits. Customizable screens, notifications via Teams/mails, project views, etc. Most other tools/products offer only part of …
Chose Azure DevOps Services
While GitLab has the same features as Azure DevOps, and a potentially more competitive price, its project management features are a bit more primitive. It could be helpful for small projects, but ultimately for our larger projects we went with Azure DevOps. Bitbucket has good …
Chose Azure DevOps Services
Azure DevOps provides a full workflow from planning through to development through to production. After the acquisition of GitHub by Microsoft, GitHub is becoming more fully-featured with the features being ported becoming more polished in the transition. Both are great …
Chose Azure DevOps Services
DevOps is more full-featured than its on-prem predecessor or any of the above with the possible exception of the Atlassian suite. I would say those two are roughly comparable. However, the ease of integration is much better with DevOps and other Microsoft products (although …
Chose Azure DevOps Services
They are really close. Azure DevOps is better because of the deep integration with Microsoft technologies. Jira is better on the customization side. However, Azure DevOps is really improving on that front. They are releasing new features every other week now. Azure DevOps also …
TrustRadius Insights
AWS CodePipelineAzure DevOps Services
Highlights

TrustRadius
Research Team Insight
Published

AWS CodePipeline is a continuous delivery tool used to model and automate software releases, particularly when a CI / CD pipeline relies on at least some AWS products and resources. It can integrate Git repositories like GitHub or AWS CodeCommit, build automation services like CloudBees, Jenkins, or AWS CodeBuild, and testing tools like BlazeMeter. Azure DevOps Services, on Microsoft Azure, is an agile development suite of tools replacing the former VSTS, featuring Azure Pipelines, a service quite similar to but slightly more robust than AWS CodePipeline, alongside agile project space Azure Boards, and Azure’s own repo tools and Azure Test Plans testing toolkit. Both CodePipelines and Azure DevOps with Azure Pipelines are used to orchestrate a CI / CD pipeline in the cloud. Both solutions are deployed across companies of all sizes, and somewhat more at larger companies.

Features

For continuous delivery in the cloud, AWS and Azure DevOps both present some clear advantages.

When building with Azure DevOps, users will reside in a rich ecosystem of apps and serviceable integrations (Chef, GitHub), while having complete in-built CI / CD automation (Azure Pipelines), as well as a strong agile planning tool with Azure Boards. Few competitors can boast breadth of services equal to Azure DevOps. With its native tool for managing teams using agile, waterfall, or hybrid methodologies, Microsoft Azure’s DevOps Services presents a flexible and complete solution.

AWS CodePipelines provides easy integrations with AWS tools, infrastructure and services, and provides the user with either a graphical user interface and setup wizard for modeling the software release process or infrastructure as code via AWS CloudFormation configuration tool; both the in-built graphical interface and the integratable IAC option are highly regarded. A straightforward tool, CodePipelines receives high marks for its core capabilities.

Limitations

There are a few limitations when using Azure DevOps Services or AWS CodePipelines worth mentioning.

AWS CodePipelines does what it does, and little more; users do not like it for building with services outside the AWS ecosystem. In fact, the benefits of working with AWS CodePipelines is directly related to how many AWS services you are using.

Likewise, the greatest limitation of Azure DevOp Services is that the Azure cloud where it resides is not appropriate for every agile project. Additionally, administrators complain about user and team management, access controls, UI quibbles (e.g. lack of clear placement of tools), as well as customizability.

Pricing

AWS CodePipelines is delivered on a pay for what you use model, with the price being $1.00 per active pipeline per month (i.e. it has at least one active code change through the month and has existed for at least 30 days). Pipelines are free up to 30 days from creation. Azure DevOps Services are free for the first 5 users on a team, and then $6 per user subsequently. Azure Pipelines activity is priced so that for Microsoft Azure hosting the first 1800 minutes are free for one parallel job, then $40 for each parallel job with unlimited minutes. The first parallel job is free with self-hosting, with each subsequent one costing $15 dollars. Azure Artifacts are free for the first 2GB, and then $2 for each extra GB.

Best Alternatives
AWS CodePipelineAzure DevOps Services
Small Businesses
GitLab
GitLab
Score 8.7 out of 10
GitHub
GitHub
Score 9.0 out of 10
Medium-sized Companies
GitLab
GitLab
Score 8.7 out of 10
GitHub
GitHub
Score 9.0 out of 10
Enterprises
GitLab
GitLab
Score 8.7 out of 10
Perforce P4
Perforce P4
Score 7.7 out of 10
All AlternativesView all alternativesView all alternatives
User Ratings
AWS CodePipelineAzure DevOps Services
Likelihood to Recommend
9.0
(0 ratings)
8.1
(0 ratings)
Likelihood to Renew
-
(0 ratings)
10.0
(0 ratings)
Usability
9.0
(0 ratings)
6.6
(0 ratings)
Performance
6.8
(0 ratings)
-
(0 ratings)
Support Rating
9.1
(0 ratings)
8.1
(0 ratings)
Implementation Rating
-
(0 ratings)
10.0
(0 ratings)
Ease of integration
7.4
(0 ratings)
-
(0 ratings)
User Testimonials
AWS CodePipelineAzure DevOps Services
Likelihood to Recommend
CodePipeline is well suited for an already existing AWS-native deployment. It is very easy to connect to existing repos like GitHub enterprise or cloud repos like CodeCommit. Being able to define the process by code (YAML) is a huge benefit for developers who favor that type of deployment setup. The UI is easy to use yet very powerful and customizable. Being able to leverage CloudTrail or Lambda is quite powerful, especially in larger more complex projects. It becomes less valuable with smaller projects or locally hosted deployments that don't get the benefits of a managed service in the AWS ecosystem. However, there are agents that can be run on private servers to allow integration. But naturally, smaller one-off projects benefit less from the automation value derived by CodePipeline.
Read full review
ADO is well suited for the visibility of day-to-day tasks and responsibilities as well as things such as Features, user stories, etc. Off the top of my head, I can't think of any scenario where it might not be well suited, as you can customize ADO to your liking to a degree.
Read full review
Pros
  • It is reliable and works without errors
  • It integrates well with our repository and all other AWS functions as well as our end database
Read full review
  • Flexible Requirements Hierarchy Management: AZDO makes it easy to track items such as features or epics as a flat list, or as a hierarchy in which you can track the parent-child relationship.
  • Fast Data Entry: AZDO was designed to facilitate quick data entry to capture work items quickly, while still enabling detailed capture of acceptance criteria and item properties.
  • Excel Integration: AZDO stands out for its integration with MS Excel, which enables quick updates for bulk items.
Read full review
Cons
  • Ease of use - things like CircleCI or other tools are a bit easier to learn.
  • Ability to build from more sources.
Read full review
  • Need to make the changes so that it doesn't occupy most of the CPU utilization and memory
  • Execution of Bulky SQl Queries leads to either the SQl being out of exception or the VS being unresponsive
  • Integration with Microsoft products is easy, but with non-Microsoft products it is more difficult, and you have to make a lot of configuration changes to integrate
  • With every upgrade of the Visual Studio, like from VS 2010 to VS 2013 , we need to upgrade our hardware/machine, as the VS hardware requirement also increases
  • If code is getting compiled in one visual studio, like in VS 2010, that the same code could possibly give an error when compiled in VS 2013, due to certain changes in keyword, data format, etc., with the VS upgrade
Read full review
Likelihood to Renew
No answers on this topic
I don't think our organization will stray from using VSTS/TFS as we are now looking to upgrade to the 2012 version. Since our business is software development and we want to meet the requirements of CMMI to deliver consistent and high quality software, this SDLC management tool is here to stay. In addition, our company uses a lot of Microsoft products, such as Office 365, Asp.net, etc, and since VSTS/TFS has proved itself invaluable to our own processes and is within the Microsoft family of products, we will continue to use VSTS/TFS for a long, long time.
Read full review
Usability
Overall, I give AWS Codepipeline a 9 because it gets the job done and I can't complain much about the web interface as much of the action is taking place behind the scenes on the terminal locally or via Amazon's infrastructure anyway. It would be nicer to have a better flowing and visualizable web interface, however.
Read full review
Azure DevOps is a powerful, complex cloud application. As such there are a number of things it does great and something where there is room for improvement. One of those areas would be in usability. In my opinion it relies too much on search. There is no easy way to view all projects or to group them in a logical way. You need to search for everything.
Read full review
Performance
Our pipeline takes about 30 minutes to run through. Although this time depends on the applications you are using on either end, I feel that it is a reasonable time to make upgrades and updates to our system as it is not an every day push.
Read full review
No answers on this topic
Support Rating
We didn't need a lot of support with AWS CodePipeline as it was pretty straightforward to configure and use, but where we ran into problems, the AWS community was able to help. AWS support agents were also helpful in resolving some of the minor issues we encountered, which we could not find a solution elsewhere.
Read full review
When we've had issues, both Microsoft support and the user community have been very responsive. DevOps has an active developer community and frankly, you can find most of your questions already asked and answered there. Microsoft also does a better job than most software vendors I've worked with creating detailed and frequently updated documentation.
Read full review
Implementation Rating
No answers on this topic
Was not part of the process.
Read full review
Alternatives Considered
I felt that, out of the alternatives, AWS CodePipeline was the simplest to setup and most reliable. Since my client's infrastructure was already hosted in AWS, I felt it was a no-brainer. If a client needed a similar solution with on-prem or non-AWS infrastructure, I would probably evaluate a different solution. AWS CodePipeline is pretty tightly coupled with the rest of the AWS ecosystem.
Read full review
Jira is fantastic for project management and customer facing portal. It is not good for pure development (no integration with Git, pipeline management, automated testing features). If DevOps were to integrate and adopt the project features of Jira as well as the customer facing interfaces, I feel it would be a complete project management system.
Read full review
Return on Investment
  • AWS CodePipeline reduced CI/CD pipeline development time by 10% for AWS native application stacks.
  • AWS CodePipeline reduced response time to build failures by 3% through SNS integrations.
Read full review
  • Increased dev team efficiency through more streamlined development processes and task automation.
  • Improved quality of software deployments due to better source control, automated testing, and release management options available in DevOps.
  • Better collaboration between the dev team, business analysts, and agile project managers.
Read full review
ScreenShots