TagUI — CLI tool for digital process automation

Rapidly automate your repetitive or time-critical tasks, using natural-language-like descriptions of your intentions

Ken Soh
Tebel Foundation
3 min readJul 10, 2017

--

EDIT — TagUI is now maintained by AI Singapore, a national initiative to build local artificial intelligence capabilities. The intention is to add AI features to TagUI while keeping it open-source and free to use.

TagUI converts your intentions in 21 different human languages into lines of working JavaScript code that perform UI automation. Under the hood, it uses Chrome DevTools Protocol, Sikuli, CasperJS, PhantomJS & SlimerJS.

For example, TagUI will instantly convert the automation flow above into 100+ lines of JavaScript code and automatically perform the steps to download a report. Conditions can also be written in natural language for making decisions or checking webpage.

No further backend coding or step definition is required. This makes it easy for rapid prototyping, deployment and maintenance of UI automation, whether you are a developer or not. The language engine supports over 20 languages and can be modified or extended easily by users to improve accuracy or add more languages.

Demo running automations directly from command line using natural language

The automation flow can be triggered from scheduling, command line, API URL, email. Everything happens headlessly in the background without seeing any web browser, so that you can continue using the computer or server uninterrupted. Running on a visible web browser is also supported using Chrome browser.

API or command calls can be made with a single line to integrate with other services or apps. Continuous integration with CI/CD tools is possible using CasperJS framework and TagUI’s Chrome integration.

Demo to automate mass account registrations in 3 steps (1. record, 2. edit, 3. play)

If you know JavaScript and want to be more expressive, you can even use JavaScript directly in the flow. If not, you will still enjoy friendly but powerful features such as repositories to store your reusable objects, flexible datatables for batch automation, and a Chrome extension which records automation flows.

For rapid prototyping, there’s also an interactive live mode for trying out TagUI steps or JavaScript code in real-time. TagUI has built-in integration with Chrome / headless Chrome directly, which also works in live mode.

Demo hybrid automation using both element identifiers and visual recognition

There is automatic waiting for web elements to appear + error-checking + nesting of JavaScript code blocks. Not forgetting the option to run automation flows hosted online or auto-upload run results online for sharing.

TagUI also supports visual automation of website and desktop through built-in integration with Sikuli. Instead of using element identifiers, images can be used to identify user interface elements to interact with.

TagUI has newly added integrations with R and Python for big data and machine learning capabilities. R and Python are popular languages with many frameworks and packages in this space.

TagUI is a full-feature and free open-source tool, so there’s nothing to upgrade to or any paid subscription. It was originally developed to avoid writing chunks of code when automating web interactions. More details at -

--

--