Welcome to the World of Environmental Data Management


I've been working in the environmental and water resources consulting business for nearly 20 years and became interested in data management early on. Much of the business world has been driven by the information technology age, learning to make decisions from billions of records and terrabites of data. Sadly, the environmental industry remains generally content with spreadsheets and PDF files, losing the ability to interpret and understand our observations of the air, land and water. In 2011 I am going to maintain this blog with my observations and opinions relating to environmental data management and perhaps generate some dialogue on how we, as an industry, can do better.

Thursday, January 6, 2011

In a Perfect World, Environmental Data Management is a Continuous and Integrated Business Process

It's too bad that environmental data management systems are often considered purely as computational tools, best to remain in the hands (or computers) of the back-office scientist or engineer.  Any organization involved with the collection and reporting of environmental information is missing an opportunity by not integrating an environmental database management system with activities involving scheduling and planning, field data collection, laboratory analysis, and compliance and management reporting.
  

I've witnessed companies realize some pretty significant benefits after implementing a standardized environmental data management process, such as;
  1. Cost reductions.  Nearly every successful business on this planet has recognized the cost benefits associated with process or product standardization.  You don't have to look very hard though to find companies take great pride in the standardization of engineering, development or manufacturing processes and then pay little attention to the methods by which their consultants and laboratories collect, store and report environmental monitoring data.  Chris French, Remediation Manager with Honeywell, published one of the few papers illustrating the cost benefits of implementing a standardized environmental data management approach (Honeywell Data Management Case Study).  His pilot project suggested that a 65% cost savings could be realized by improving environmental data business processes.  I think that Chris's analysis underestimates cost savings as he didn't evaluate the potential cost reductions associated with tasks such as computer modeling and risk assessment when data is properly managed.
  2. Maximize Data Quality. Standardization improves quality.  Minimizing duplicate copies of information improves quality. Developing methods for people to report and analyze data improves quality.
  3. Enabled Informed Decision Making.  I've spoke with numerous environmental managers who feel powerless when they require background data to support decision making.  In some instances, environmental data remains in the possession of consultants who never really have a mandate to deliver raw data back to their client.  In many other situations, environmental data remains 'locked' deep inside pages and pages of tables of data printed at a 6 pt font.  Companies who develop standards to collect and maintain their data will be better able to understand their data and make better decisions for the future. 

Our industry needs to recognize that an environmental data management system is much more than just software.  To be most effective, environmental data management must address all environmental data business processes with firm objectives of reducing costs, maximizing data quality, and promoting flexible methods of data reporting and data analysis.



2 comments:

Anonymous said...

David,

Great post. I think you have "hit the nail on the head" (as we say in the UK).

So often I see the report as item that is considered to be the deliverable and the data is lost, forgotten about or unbelievable printed out and put in a box for future reference!

I shall be pointing people to this post and the Honeywell report. Many thanks.

I found your post from the Environmental Data Hub on LinkedIn - thanks for posting it there.

Looking forward to the next article....

Kind Regards,

Dr Roger Chandler
Keynetix Ltd, UK

Mitch Beard said...

Hi Dave,

Thanks for the blog, and EarthSoft has linked our social media. Our feeling is that every group in the environmental data management business these days has got a smile on their collective faces. It's a rising tide. I think all your readers agree we all see a continued flood of data.

However, I have one critique of the blog, and that is the first 3 words in the title: No More Spreadsheets! I'm sure you mean no more spreadsheets for those of us who aren't afraid of a little referential or relational integrity. But let's not malign the necessity of the lowly spreadsheet in the data workflows we see for many of our clients.

Many of the projects still have consultants and labs who continue to have trouble making consistent spreadsheet deliverables. Asking them for relational database deliverables is just not possible at this time. It would be nice, but we could just not make it stick with many of our projects. Unfortunately, many of our relational databases would starve for lack of data without spreadsheet "feeder systems" in the workflows.

Spreadsheets are still the predominant EDD format. And, spreadsheets are also perhaps consultants' most-often used export or report, along with various graphics reports.

The workflows frequently require both database and spreadsheet, working together, in peace and harmony. So, let's be nice to spreadsheets.

MKB