Vertica Bolsters Hadoop Integration

New connector ships data between two environments faster.

Vertica Systems, a provider of a massively parallel database platform that is specifically designed for column-based data warehouse applications, has extended its support for Hadoop.

According to Colin Mahony, Vertica vice president of products and business development, IT organizations are developing prototype applications in Hadoop that make use of “Big Data” constructs. But once they validate those applications, they want to be able to leverage the performance capabilities of a massively parallel database to support those applications in a production environment.

As an MPP database designed to support analytic applications that lend themselves to columns, rather than row-based presentations, the Vertica system is ideal for the type of analytic applications that most IT organizations are trying to build with Hadoop, said Mahony.

Vertica is releasing an update to the open source connector that it developed for Hadoop and Pig, another open source platform for analyzing large amounts of data. That new connector can transfer data in parallel to speed data transfer between Hadoop and the real-time Vertica database platform.

Vertica is also planning to add a backup option to Hadoop File System (HDFS), and promised to publish a set of libraries so Hadoop users can leverage Vertica's sorting, compression and encoding natively on the backup files in HDFS.