JJ Burnam

Data quality is not a simple IT task that has global rules and there is not a packaged application that can fix all data quality problems. Data quality is as much of a domain issue, as it is a technology one.

This is an example of the introduction of interpolation bias into the sampling system. Without knowing why that interpolation method was chosen or how the stride was chosen, the results will be altered based on that information.

For example, automatically interpolating data to align it to a stride or fix gaps will cause an application that is attempting to identify a trend or a seasonal component somewhere in the analytical pipeline to decimate the data or smooth it using averaging, thus causing the analysis to be done on a dataset that was derived over two generations of computations rather than one.