Wednesday, February 16, 2011

Air Quality in the Barnett Shale - Part 15: Dr. Sattler's Deposition - Critique of the Method

In my last post, I discussed a Deposition I received via email regarding Dr. Melanie Sattler's involvement with Alisa Rich of Wolf Eagle Environmental (Cause No. 236-236781-09, December 14, 2010).

I find myself in another sorry-but-I-gotta-call-you-out-on-this-one position.  You see Dr. Sattler is a professor over at UTA.  She's an Engineer.  She also taught and helped Alisa Rich - who then used this association and credentials - to prepare a number of reports that are misleading (see previous posts on this topic).

In the Deposition, Dr. Sattler states:
"I think my work stands up to anybody that has expertise in dispersion modeling. If anybody was criticizing it, they probably didn't have -- well, it wouldn't surprise me to see somebody without a scientific background criticize it, because they probably wouldn't understand it." (Page 158-159)
The use of dispersion modeling to determine an emission rate is fundamentally and categorically an incorrect use of the model - unless - the contaminants being "backed in" to the equation are solely from the source - or - background levels of the contaminants have been factored out.

Here is how Dr. Satller determined the emission rate for the oil & gas production site in the Town of Dish, Texas, that Alisa Rich used to model the potential one-hour and annual exposure for those living in and around that production location:



So Alisa Rich set up seven SUMMA canisters in and around the Oil & Gas production site.  This map is included in the ZIP file titled "Revised Air Study Documents" found here.


From this graphic you might not notice all the potential sources that could be contributing to the seven contaminants reported by Alisa Rich - and supported by Dr. Sattler's work - allowing for the following statement to be made:




See those numbers in columns 2 and 5?  Those are the maximum averaged concentrations the dispersion model calculated could come from the oil & gas production site there in Dish, Texas.  Those values reported in Table 2 are what a human or environmental receptor some distance from the production site could - according to Dr. Sattles' calculations - potentially be exposed to.

So when Dr. Sattler makes that statement:


She is eluding to the fact that her modeled concentrations are so high that any error inherent in the model's ability to calculate levels of contaminants in and around the source would have no bearing on the model's conclusion that ESLs were exceeded.

This argument would be valid if you knew the actual emission rate of the source and the results obtained were high enough to overcome the percent error inherent in the model.  But in the case of Dish, Texas, her maximum contaminant levels are dependent on calculating an emission rate based on levels found in SUMMA canisters placed in and around the area where the source is located.


Because her basic premise is wrong - that you can back in the contaminant levels that were detected some distance from the source to determine the actual emission rate of the source - all the values presented in Table 2 that come from the model are wrong as well.  There is nothing wrong with the model, it's how she is using it that is wrong.  Why she can't see this, or any of her peers have not questioned her on this, is any one's guess.

There seems to be a clear lack of understanding of just what a dispersion model is capable of telling you.  Yes, she knows how they work and she knows how to report them, but she seems to lack a connection to the number obtained and how it was calculated.  Which is probably why she responded in the Deposition:
Q. When you read through [t]his report, doesn't it give you the impression that, boy, this is really bad, the air out here is just horrible?
A. I don't know.  I don't read it that way.  I look at the numbers. (page 147)
And if all you do is look at the numbers, then you are going to miss the connection to what the numbers must mean. So what do the numbers tell you?  Well based on the dispersion modelling, the air significantly exceeds the short-term and long-term ESL for six compounds.

So what Dr. Sattler accepts as good scientific methodology, is to take the sample results obtained at a distance from the source (the natural gas production area) to figure out what the emission rate coming from this source is.  Once she has this emission rate, the model can now be run like it normally is intended to be run, using all the meteorological data for a year.

Makes perfect sense, as long as you are willing to ignore all the other possible sources of these seven pollutants.  In other words, the assumption - or premise - must be that the levels of contaminants in the SUMMA canisters were solely from the natural gas production site and from no where else. 

For example, by shoving every single bit of Benzene and Toluene detected in the seven canisters back into the model's equation, an emission rate from that source was derived for Benzene and Toluene.  With that emission rate and a years worth of meteorological data, dispersion models could be run and maximum modeled concentrations (see Table 2) derived.

For these two chemicals - Benzene and Toluene - they are everywhere.  They are part of BTEX which is part of fuel, which when burned, enters the atmosphere.  Benzene also comes from smoking cigarettes.  So is it possible that not every bit of Benzene and Toluene detected in the SUMMA canisters was produced by that particular oil & gas production site?  Lets look at a map of the area:


The white rectangle is where the production site is located.  Now go back to the map showing where the sample points were located.  Isn't it possible that these contaminants could have come from other sources?

Dr. Sattler is aware of this as a potential problem:


But the Dish, Texas samples were not collected in the middle of an open field.  They were sampling air from an area where commercial activity took place, people lived, and a major thoroughfare and roads were also nearby.  Isn't it reasonable that some of that Benzene and Toluene may have come from vehicles driving on the nearby streets and FM156?  Or is that just too small of a probability to be considered?

Now if her premise is correct - that outside contaminant sources of contamination can be ignored - would this methodology - the placing of seven SUMMA canisters - work in downtown Houston?  Could you take the analytical results collected over a 24-hour period and back in to the model to derive the emission rate for one of the nearby refineries?  If not, then why is this modeling method acceptable for the Town of Dish, Texas?  You cannot reasonably make the argument for Dish that there is some small probability that maybe a little bit of the compounds came from another source.

To say that all of those seven contaminants came from one source does not even pass a grammar school understanding of how experimentation is supposed to account for bias, noise, and background.  Then, to use that emission rate to build your model whereby you can make bold sweeping statements that ESLs are exceeded by factors of, say, a thousand, is inexcusable.  You see, if the premise is wrong, then the numbers obtained are wrong - or at the very least, inconclusive.  

All models produce numbers.  All models produce numbers that - all things considered - are within a statistically acceptable level of possibility.  But not all the possible numbers produced by a model are plausible.  Intellectual integrity and the scientific method demands one know the difference. 

The numbers produced by Dr. Sattler's model are correct in terms of a calculation.  The premise, however, is wrong, making those dispersion model numbers worthless in looking at short term and long term health effects from this specific natural gas production area.


Next Post: Air Quality in the Barnett Shale - Part 16: Dr. Sattler's Deposition - Those Seven Chemicals


.

No comments:

Post a Comment