For an organization to excel at data analytics, the IT team needs to coordinate a number of different disciplines and personnel with experience in those disciplines. This usually includes data analysts, data engineers, and, increasingly, data scientists.
The data engineering discipline is sometimes thought of as the plumbing that, like pipes in a house, delivers data to business consumers. Data engineering breaks down into several critical sub disciplines; software development is one of them. Developers need to build the applications that help their data engineering teams deliver the data to their internal consumers – data analysts and data scientists, whose jobs are to find the data-driven insights that make the entire effort worthwhile.
So what is the responsibility of organizations that, themselves, provide tools to the software developer focused on data engineering? Rohit Amarnath, CTO for the Vertica team, believes there are five areas in particular – five pillars, he calls them – that define capabilities for software development tools that can enable success.
By addressing these five pillars effectively, data analytics tool providers (think everything from analytical databases like Vertica to data visualization, data preparation, and other software/SAAS offerings) can enable an improved developer experience, or DX. Just like user experience (UX) of the past, better DX keeps data engineering teams on the right path, helps them deliver the applications that the larger organization requires, and keeps them happier in their roles.
Take a look at how Rohit describes these requirements in his latest article, “The Five Pillars Of Developer Experience In Data Analytics,” on Forbes.com.