• LinkedIn

  • Follow via Facebook

  • Follow via Twitter

  • Submit RFP

  • Contact Us

Our IRI Voracity-powered Competencies Include

What is IRI Voracity?

Voracity is a full-stack data management platform product that gets you to informational and compliance outcomes faster, cheaper, and more easily than mega-vendors and specialty software providers can.

Why is that so?

First, Voracity is built on the proven leader in big data processing performance long before Hadoop… IRI CoSort. CoSort is the default engine (and 4GL) in Voracity for data definition and mapping, transformation and cleansing, migration and replication, reporting and subsetting, and even masking and test data generation. Driving those jobs is a free, rich Eclipse client for designing and managing data discovery, integration, migration, governance, and analytic operations … operations powered by CoSort, or seamless Hadoop engines for even more scalability without the need to re-design or code!

Second, Voracity is affordable because it’s developed by a company operated by its founders since 1978. IRI is not beholden to VCs or public investors who drive up prices to the tune our competitors are charging; in ETL alone, Voracity costs a fraction of what they do (while still running far faster). And in terms of value, the sheer number of built-in feature functions allows you to avoid the complexity and cost of multiple specialty software products (for DB admin, profiling, masking, DQ, test data, ETL, BI, etc.).

And third, Voracity is simpler to learn, use, and maintain than ETL tools, Apache projects, SQL and 3GL programs, and specialty data preparation tools. In a single pane-of-glass built on Eclipse, Voracity provides 1) intuitive end-to-end job wizards, workflow, and transform mapping diagrams; 2) an award-winning 4GL for data definition and manipulation supported in a syntax-aware editor, outline, and re-entrant dialogs; and 3) local, remote, shell, batch, SQL, and Hadoop execution.

Voracity time to value chart.

Voracity: Frequently Asked Questions

Strictly speaking, Voracity is the only total data management product on the market. With out-of-the-box data management and data protection functionality, it can tackle the vast majority of your data needs as-is. Plus, you can add custom integration as needed. Hadoop capabilities and analytics programs, for example, easily plug into the Voracity GUI and expand your capabilities as you need. With this system, you pay for what you need and not for what you don’t.

As far as speed and performance go, Voracity can’t be matched. Against competitors in the data management and data protection sectors, it consistently outperforms them with its CoSort engine, powered by the dynamic SortCL scripting language.

Voracity consistently outperforms on the speed, ease, versatility, and value metrics. It has the best Extract, Transform, and Load performance without Hadoop. The simple, open 4GL metadata nad familiar Eclipse GUI environment have more job design methods than any other tool on the market. Best of all, Voracity combines data discovery, integration, migration, governance, and analytic functionality so ETL architects, business users, and governance teams can work together and adapt to change.

To learn more about why Voracity is the best solution for ETL and big data preparation, and an innovative alternative to data and metadata administration tools and data discovery, masking, quality, and test data software products, see http://www.iri.com/products/voracity/why-is-voracity-better.

IRI Voracity is on Gartner’s radar, but, like Ab Initio, is not in the Magic Quadrant. Voracity is relatively new among ETL tools, even though its foundational CoSort product has been an ETL engine since 1999. Ask any Gartner data integration (core industry or GTP) analyst about Voracity; they have all been briefed and provided input into the platform’s technical development and commercial direction.

Voracity is perfect for any sized operation with any workflow. IRI Workbench, the Eclipse-based GUI that supports Voracity operations, allows BI/DW architects and information stewards to streamline their ETL, analytic, and compliance initiatives with simple job wizards, mapping diagrams, and job scripts that run in the GUI or on the command line.

For Hadoop grid users, Voracity’s “map once, deploy anywhere” capability provides seamless, turnkey operations for MR2, Spark, Spark Stream, Storm, and Tez execution.

SO, whether you’re a seasoned big data user or someone just getting into the field, Voracity will empower and accelerate your operations without costly plugins or complicated code. Simply put, Voracity is the easiest way into the world of big data.

Voracity runs on-premise or in the cloud, and its data sources and targets can be, too … meaning files, databases, or SaaS applications like Salesforce, Marketo, Eloquo, etc. See http://www.iri.com/products/workbench/data-sources for more information.

Unlike Talend and other ETL tools or those that rely on Java, database, or appliance engines to deal with large data volumes, IRI Voracity uses the task-consolidating, multi-threaded, and algorithmically-superior IRI CoSort engine by default. Nothing is faster in volume, in or out of memory, for high-volume transformations. Hundreds of millions of rows can be filtered, sorted, joined, aggregated, and otherwise transformed in seconds or minutes. And if that’s not scalable enough, many of the same jobs designed for CoSort processing in Voracity’s Eclipse GUI run with no changes in Hadoop MR2, Spark, Spark Stream, Storm, and Tez.

Available Voracity add-ons, like JuipterOne from Crossing Technologies and Nabu from Big Data System, connect to and process social media feeds on a big data backbone, and provide display and analytic options you have to see to believe, including streaming sentiment analysis.

Remember also that the Voracity base edition can be used to accelerate the production performance of DataStage, Informatica, Talend, Pentaho, and a range of other data integration (ETL) tools without having to abandon them. Published benchmarks at http://www.iri.com/blog/category/etl (including one performed by BigData Dimension with Talend) prove how much faster you can transform (filter, sort, transform, and aggregate) data in those tools by running a Voracity-prepared (CoSort SortCL) job to produce the same results. And if you have a lot of jobs, you can save time by automating the conversion of specific mappings to Voracity transform code via AnalytiX DS Code Automation Template frameworks (CATfx).

Right, you can use Voracity to design and run new ELT and ETL operations or accelerate existing ones by replacing any or all of their components. Regardless of what you want to do, everything is front-ended in the same Eclipse GUI for Voracity, IRI Workbench. That free GUI gives you direct access to all your source and target tables over JDBC connections, along with similarly direct access to data in files, BIRT sources, and your HDFS folders.

Step-by-step job wizards allow you to build partial or complete ELT and ETL tasking, which can then run schedule in or out of the GUI, on local or remote LUW servers. Seamless transforms in Hadoop are also possible, as you can “map once, deploy anywhere” with Voracity’s plug and play approach. Working with and team-managing metadata is also simplified by Voracity’s simple 4GL metadata that interacts dynamically with the GUI’s script editor, outlines, dialogs, transform mapping, and workflow diagrams.

The Voracity user community is on LinkedIn and there is a range of self-help materials both in the GUI and online, which feature step-by-step screen how-to articles with screenshots and YouTube videos. Support for any of the things you want to do is provided directly by IRI engineers who are easy to reach by phone and email, or by authorized service providers, like BigData Dimension, in 40 cities around the world.

Yes, and yes. Voracity is designed to manage the lifecycle of enterprise data from discovery to death, regardless of its source, all from a single Eclipse pane-of-glass. You can find the data sources and formats supported here, and lifecycle management (data curation) activities supported here.

Automation of any Voracity command-line data manipulation job (task or batch, including E, T and/or L, reporting or staging, masking, conversion, and test data generation) is possible via Tivoli or any third-party scheduler (see example here), as well as in the free IRI Workbench GUI’s task scheduler.

Voracity Express 360 Solution: Why Us?

BigData Dimension is well qualified to provide a full range of services around IRI Voracity, which is arguably the most robust and affordable full-stack solution platform for data management available. BigData Dimension is one of the few big-data- and ETL-savvy solution providers familiar with multiple Apache distributions and megavendor data integration tools, as well as the inter-workings of Voracity as a simpler, more affordable replacement, or performance enhancement to those platforms.

Our Voracity Solutions Enhance Data Management Across Industries


Expose Insurance Fraud


Optimize Loan Performance

Assess Credit Risk


Monetize CDRs

Anticipate Trends


Improve Traffic Flow

Capitalize on Data

Improve Treatments


Individualize Therapies


See the Whole Patient


Micro-Target Customers

Leverage Buyer Psychology


Price More Intelligently

Conserve via "Enernet"

Manage Power Grids


If you’ve already invested in Voracity and want to harness its full potential, our industry experts can tailor your experience to your needs.

BigData Dimension can help you through all of the stages of your data’s lifecycle with Voracity. Our globally-renowned team has cross-industry experience that keeps up with the cutting edge of Voracity. Let us put our expertise to use for you and help you create the best solution for your needs.

Voracity brochure

Our Voracity solutions help consolidate, profile, and cleanse social media and clickstream data.

Millions Emails per min
Million Facebook likes Per Min
Tweets Per Min
Search Queries Per Sec
Photos uploads per min
Video hours per minute

Don’t Implement Your Voracity Solution Without Us

Our Voracity 360 Solution


Voracity Assessment & Modernization

We first study and evaluate your processing and analytic infrastructure and any existing data warehouse implementations in order to collect your business requirements and understand the hardware, software, and data source landscape in place. This, of course, includes a “health assessment” and SWOT analysis of your existing databases, cloud sources or systems, data modeling, ETL and BI tools.

We will use combine those findings with your informational, SLA, and compliance objectives and work forward from there in Voracity’s open Eclipse front-end and proven IRI back-end technologies. The result will be a more modern, affordable, scalable, and self-maintaining data warehouse environment that can adapt to change.


Data Warehouse Roadmap

The successful roll-out of a data warehouse, data lake, or any big data analytic project with Voracity relies on an understanding of the multiple upstream and downstream systems and sub-systems which together contribute to Voracity’s operating ecosystem. BigData Dimension is facile with data architecture and disparate sources of data, as well as how Voracity connects to and manages that heterogeneous data through its lifecycle in order to leverage its integration, homogenization, governance, and commercial exploitation in the context of a data warehouse or these variations:

Before we can go down the path of implementing these environments, we have to address threshold and planning issues with you in a series of roadmap discussions. Questions to be considered will include:

  1. Should my enterprise opt for a Big Bang type initiative or a controlled implementation in a phased manner?
  2. How to plan and execute the data warehouse using Voracity for ETL, metadata governance, reporting or analytic data preparation, and other custom solutions.
  3. On what criteria can the success of each of the implementation stage be gauged?
  4. How to attract the focus of, and support from, the relevant stakeholders?
  5. How to gather the sponsorship and funding necessary to push and sustain the effort(s) and analysis of long-term impacts.

Design And Development Phase

During this stage, our team adheres to a sequential design, i.e., an iterative model where end businesses can get involved by adapting to newer business systems while still keeping their end goals within sight. BigData Dimension renders the following design and development services for Voracity:


  • Well-defined, tested, and trusted development technique cum methodology
  • Visible and quantified outcomes are delivered swiftly and regularly
  • Our Data Warehouse consultants work in tandem with enterprise workforces
  • Checks, tests, timely analysis and counter-programs are provided to deal with any adverse events or bottleneck that arise during (and may hamper) this phase
  • BigData Dimension’s top management gets involved with your project sponsors to provide solutions and monitor the progress of the Data Warehouse implementation

Solution Insights And Timely Upgrades

Our partnership with IRI is strengthened by our direct input into, and feedback from, the development of Voracity components and features. Having special access to Voracity engineers gives BigData Dimension unique insight and influence in the platform’s design and roadmap.


BigData Dimension adds this knowledge to our expertise in big data and data integration technologies — and your business requirements — so we can advise both you and IRI on the pros and cons of different solution approaches. This helps IRI optimize the ergonomics of development environments, and the price-performance of production environments … and thus keeps them, and you, ahead of the competition.

Our relationships with IRI and your firm also help us shed light on:

  1. the impacts of various Voracity upgrades in light of your business and enterprise activities;
  2. phasing and controlling updates to Voracity and other software, while also weighing the effects of regular vs. sporadic updates; and,
  3. the risks associated with each upgrade, and plans for rolling them back while keeping business processes consistent.

These are just more reasons why leading IT managers and enterprise solution architects trust BigData Dimension for their big data decisions.

Production Support

After the DW and any other data-centric point solutions in the IRI Voracity platform are developed, they are tested in multiple ways and under different data volume and variety conditions before they delivered. After delivery, the performance of production operations is monitored and gauged, and if necessary, alternative plans are formulated to address any outcome discrepancies, bottlenecks, etc.

BigData Dimension service and support crews, which represent the best and brightest in the data warehousing industry, are accessible 24x7x365 and can support any of the following objectives:

  • Design systems to be installed live, completed with mock drills
  • Prepare systems and verify configurations needed to examine deltas and loads
  • Evaluate the developed systems for unexpected behavior or data discrepancies
  • Revise and reinstall production systems after a system malfunction
  • Secure lost data and repair or examine erroneous coding
  • Detect and resolve performance standards, and re-verify them

Delivery Model

In the Data Warehouse domain, BigData Dimension has racked up several key technical milestones in recent years. Our architects have the experience and insight to use other tools or techniques alongside Voracity, which we can incorporate as part of our service.


Delivery Methodology

BigData Dimension has also garnered wide acclaim for its expertise in Data Warehouse methodologies, which reflects our years of devotion to learning them, and working with discerning businesses on their data management needs. And we use tested, trusted and standardized methods in all our Data Warehouse implementations.

Spearheading Premium Business Solution

BigData Dimension’s skills in Data Warehouse architecture and implementation come from years of implementing custom solutions and a plethora of minute coding clusters for solution and services accelerators … which are also uniquely part of Voracity … such as:


Speed and Scale Seamlessly … Map Once, Deploy in CoSort or Hadoop:

IRI has always been a leader in big data integration performance … long before the terms big data or data integration were even mainstreamed. Hyperion called the SortCL program in IRI CoSort (the default data transformation executable and back-end processor for Voracity) a powerful ETL engine in 1999. Since then, CoSort has been used as a “pushdown optimization” for sort, join, and aggregation transforms in other ETL tools like DataStage, Informatica, Pentaho, and Talend.

More recently however, with the development of Voracity, IRI provides data integration users with the ability to speed or convert (leave) existing ETL operations, or design and run new ones in Eclipse, powered by CoSort or Hadoop. Voracity combines critical data integration capabilities with “map once, deploy anywhere” options so you can fast-transform sources up to 10TB in LUW systems with CoSort, or scale above that in HDFS with MR2, Spark, Storm, or Tez.

No new metadata or code are needed for Hadoop. Just create your data transformation, masking, or test data generation jobs through any of Voracity’s job design options as you normally would, and click to indicate where they’ll deploy.

Secure Your Investment in Big Data with an Affordable Platform that Scales and Adapts to Change:

You don’t start a big data project to manage data, but you end up having to. It’s the dirty work that has to be done … getting the right data from the right sources,  blended and subsetted, cleansed and secured, updated and formatted … before data can be analyzed and the promise of big data is realized.

IRI’s comprehensive and cohesive Voracity platform is the only one built on a proven, organically grown data movement and manipulation foundation supported by the familiar and ever-more-versatile ergonomics of Eclipse, and the power of CoSort or Hadoop. This architecture is not only scalable enough to perform well with any data volume today or tomorrow, it is robust enough to manage change.

It’s hard enough to get a solution in place from the start, but as business requirements change, some tools make it harder to adapt to those dynamics. Today’s buyers want technology that will accommodate new data sources, structures, and business rules, and will not be painful to implement or maintain.

Voracity satisfies these desires — all in the same pane of glass — by:

  1. offering multiple data discovery and job design styles;
  2. supporting multiple workflow, execution, and metadata management paradigms;
  3. working with any sequential and ODBC-connected data source, plus a number of proprietary mainframe formats, Hadoop and cloud formats, and optimized native handling of JSON, LDIF and MongoDB BSON files;
  4. allow for unlimited functional expansions through free or commercial plug-ins for Eclipse, including BIRT, StetET for R, eGit, CDT, DTP, etc.

Finally, your investment is also protected by Voracity’s uniquely affordable and predictable commercial subscriptions that don’t care about your underlying hardware configurations, data volumes, users or uses, data variety or volume. Voracity pricing only looks at the aggregate number of executing server hostnames licensed, and doesn’t come close to the cost of megavendor ETL tools, multiple speciality software products, or commercial Hadoop distribution maintenance.

Exceptional Data Integration Guaranteed

IRI Voracity delivers faster time-to-solution, more ease-of-use, and lower TCO in the integration, protection, and visualization of data through an all-in-one, user-friendly job design, execution and management platform that can simultaneously and scalably: manipulate, migrate, mask and make multiple uses of both internal and external, structured, and unstructured, data sources.

Voracity combines: the data movement and transformation capabilities of CoSort, the processing power of Hadoop engines, the ergonomics of Eclipse, and seamless third-party technology integrations, to perform, consolidate and speed a full range of data-related activities, including:

  • data discovery and integration (ETL)
  • data cleansing and enrichment (data quality)
  • data and database migration
  • data federation and replication
  • database unload, reorg and load acceleration
  • batch and dimensional (CDC, SDC) reporting
  • BI, E-R and ETL workflow visualizations
  • immediate mash-up analytics and dashboard visualization (IRI Paques)
  • third-party BI tool data franchising (preparation)
  • data activity monitoring and forensics (pending third-party DLP integration)
  • data masking and synthetic test data generation
  • enterprise metadata and master data management
  • data and task lineage, sharing, and security

With Voracity, you have a cohesive, compliant, comprehensive platform that almost everyone in your enterprise can use collaboratively to acquire, analyze, and actionize your data, resulting in a freer “flow of information between business, people, and things” and more confidence and agility in the data value chain.\

Only with Voracity can You…

… Bend the Big Data Cost Curve by Eliminating Multi-Tool Complexity …

IRI Voracity is the all-in-one data manipulation and management platform that produces, protects, and presents information 3x cheaper, 6x faster, and 9x easier than megavendor alternatives.

… and Transform Your Company into a Competitive Digital Business! 

Only a unified data engagement platform can enable business users to work with IT to rapidly churn and leverage multiple data assets in the digital value chain. Only IRI Voracity is  such a platform.