AI Assisted voice to code and full system control. A must have accessibility tool for programmers.
Use Cases and Deployment Scope
I had a back injury and broke my back and shoulder just before Covid. I was unable to sit at the desk or use my right arm for almost a year. I thought I was going to have to step back from my Software Engineer job here at TrustRadius. I was looking at the potential of being long term or permanently disabled and I needed a solution. Then I found Serenade.ai. Serenade.ai gave me full control over my Windows + WSL2 development environment. With it's tight integration with VS Code I was able to continue working right up to the week of my surgery without ever having to touch the mouse / keyboard. I delivered almost 10,000 lines of code for our project while working with complex JSON Config files. I was able to add, edit, and refactor code, build tests, control applications, and navigate my entire development environment with just my voice. Serenade.ai saved my job, sanity, and was truly an asset. Even better, it's an open source solution.
Pros
- Voice assisted programming
- Voice assisted computer navigation
- AI Assisted deveopment
Cons
- The voice recognition takes some getting used to. Just like using a new keyboard, you get used to what you need to over-enunciate or be really clear on. Being able to train the model / interpreter they are using on my voice, tonation, dictation, accent, etc would be a major benefit.
- Having to have a clear picture in your head about the code you want to write is a mental challenge. But this is more of a challenge of the process than the application. I found littering the code I wanted to refactor with #todo comments and then asking Serenade.ai to implement the series of comments to be the best method of planning and then implementing the code.
Likelihood to Recommend
I've met several engineers who have temporarily lost their ability to use the mouse / keyboard. But its more than an accessibility tool. Being able to simply say "Refactor this method to iterate over the collection as a collection of promises and await all promises after the iteration."... and then get that done, was amazing.
