Identify and fix the most important missing BA/Util geometries
See original GitHub issueMany of the historical geometries that are generated using the EIA 861 + US Census data are very consistent with HIFLD in 2017-2018. Many of them are also self-consistent across the years for which we have data (2001-2018). However, there are some big holes that we need to fill in order to have workable territories for the major FERC 714 planning areas at least back to 2010.
Alter Geometries:
MISO (2009-2010)
- MISO territory for 2010 is unreasonably small, and non-existent for 2009 and earlier years.
- However, MISO reports demand for 2009-2010 in FERC 714.
- However, based on this workshop report it looks like there’s essentially no difference between the 2011+ years and 2009-2010.
- Backfill 2009-2010 with the 2011 geometry.
Southwest Power Pool (2006-2013)
- SWPP has demand for all years but is missing geometry for 2006-2013
- SPS has demand and geometry for 2006-2013, but nothing later.
- SPS and SWPP merged in 2014.
- SWPP geometry grows a lot between 2014 & 2015, population and demand grows modestly.
- They expanded into SD, ND, MT.
- Seems legit, and unrelated to the SPS merger, which appears to have been handled.
- Need to backfill 2006-2013 geometries for SWPP… is the pre-expansion 2014 geometry likely to work?
- Demand is consistent as far back as 2010. 2009 is 10% lower, 2006-2008 another 15% lower.
- Incorporated Nebraska utilities in 2009 (April 1st, hence the middling demand)
- Backfill 2010-2013 with the 2014 geometry.
- Backfill 2006-2009 with 2014 map minus Nebraska.
Louisville Gas & Electric and Kentucky Utilities (2006-2012)
- Reports demand for all years, but lacks geometries in the early ones.
- Demand reported is consistent across all years.
- Population and service territory area in 2013 are almost 2x bigger than later years.
- Backfill 2006-2013 with the 2014 geometry.
American Electric Power Company (2011-2013)
- Identified as a BA
- Has geometries through 2010, but not thereafter.
- Appears in the BA assn table only as a BA.
- Makes sense that it’s only getting a geometry by virtue of its constituent utilities.
- Demand reported 2006-2013 is pretty constant.
- Big increase in territory (3x) and smaller increase in population (1.5x) between 2008 & 2009.
- Early geometries are in the midwest. Later geometries bring in a bunch of Texas, Arkansas, Louisiana.
- Appears that AEP really did expand into those areas.
- However, the FERC-714 demand doesn’t change when those areas are integrated, so it seems like the demand being reported probably just pertains to the original service territory in the midwest & appalachia.
- Limit service territory to counties in OH, IN, VA, WV, TN, KY, MI
Entergy Corporation/Services (2013)
- Reports demand consistent with past years in 2013
- However, geometry isn’t present.
- Forward fill 2013 with geometry from 2012
Treat as Utilities not Balancing Authorities:
PG&E (2006-2010)
- PG&E shows up as a BA in the EIA-861 only in 2002.
- It shows up in all years as a utility, with service territory, etc.
- As a utility, it shows up within CISO.
- Because it’s showing up as a BA that one time, we’re assuming it’s a BA. But it never gets any territory associated with it outside of 2002, or as a utility.
- This seems like a reporting irregularity.
- Force PG&E to be treated as a utility by replacing it in 2002 with CISO in the BA table during ETL.
- This should mean it gets categorized correctly across all years and gets a territory assigned automatically.
San Diego Gas & Electric Company (2011-2019)
- Has a geometry in earlier years (2006-2010), but it’s missing from 2011 forward.
- Reports consistent demand across all years in FERC-714
- EIA-861 service territory table shows it having the same counties for all years 2001-2019 (San Diego & Orange)
- Why isn’t it getting a service territory for the later years?
- It’s being identified as a BA because it shows up in the BA table from 2001-2010, but after that it’s gone.
- It also shows up in all the years of EIA 860 as a utility.
- Force it to be treated as a utility
Dayton Power & Light (2011-2019)
- Shows up as a BA in EIA-861 in 2001-2010
- Also shows up as a utility in EIA-861 in 2005-2019
- Has the same territory listed by its utility ID in all 19 years of service territory data.
- Force it to be treated as a utility
Consumers Energy Company
- Like PG&E it appears as a BA a few times (2003-2006) but really it appears to act like a utility.
- Has service territory (counties) in all years, and shows up in other utility tables as a utility.
- However, because it shows up at least once as a BA, we use the BA territory generation process, which doesn’t work if you’re really a utility. So it ends up getting no territory assigned (even though it’s got counties)
- Force Consumers Energy Company to be treated as a utility, not a BA
Unfixable Service Territories
Mid-Continent Area Power Pool (2006)
- No
eia_code
is provided for this respondent,and it’s unclear what it corresponds to. - Wikipedia suggests it’s the predecessor to the Midwest Reliability Organization which is a NERC region.
- Respondent only appears in 2002.
FirstEnergy (2006-2008)
- Ohio-based IOU with several different
utility_id_eia
values over the years. - OH based sales are reported in PJM for 2013 and later years via EIA-861.
- Listed as a Power Marketer / Retail Power Marketer in the EIA-861.
- Never shows up as a utility in the BA associations.
- Never shows up in the service territory table.
- Doesn’t appear to be fixable.
Westar Energy / KPL (2006-2008)
- Several utilities named Westar
- One in EIA-861 with complete geometries has sales that don’t track with the FERC-714 demand.
- No obvious reconciliation to be had.
Wholesalers Without Service Territories
There are 28 respondents that appear to be some kind of wholesale organization, mostly cooperative G&Ts and public power entities without their own service territories. They account for about 34% of the reported demand that’s not associated with any service territory. A few are listed below from early investigation. The others were excluded if they:
- Report demand in the FERC-714.
- Never appear in the EIA-861 service territory table (with counties).
- Are listed in EIA-860 or EIA-861 as a utility.
- Appear to have a parent BA in the EIA-861
balancing_authority_assn_eia861
table.
Oglethorpe Power Corp (2006-2019)
- Electricity supply cooperative in Georgia.
- Has no geometry for any year, and doesn’t show up in the EIA-861. Does appear in EIA-860.
- Is it maybe just a supplier with no customers or service territory of its own?
- Is it’s demand being included already with Southern Company (SOCO) which covers all of Georgia?
- In early years of EIA-861 which explicitly link utilities to the balancing authorities they are part of, Oglethorpe is associated with SOCO, but it has no counties associated with it in the service territory tables.
Northeast Utilities Service Company (2006-2014)
- No geometry for any year in which it appears in FERC-714.
- aka New England Hydro-Transmission Corp.
- Eventually got bought out by Eversource.
- Appears in early EIA-861 years in association with NE-ISO (in the BA table)
- Does not show up anywhere within the service territory table.
Central Electric Power Cooperative (2006-2019)
- Reports demand in all years, but never has a geometry.
Other Issues
- PJM territory gets much smaller as you go back in time. Is that right?
- Is the area near Houston being excluded from ERCOT?
- PACE & PACW are separate balancing areas but a single utility. Need to merge them somehow. See #616
Issue Analytics
- State:
- Created 3 years ago
- Reactions:2
- Comments:11 (11 by maintainers)
Top Results From Across the Web
Commanding Heights : Episode 1 | on PBS
NARRATOR: This is the story of how the new global economy was born, a century-long battle as to which would control the commanding...
Read more >Common Battle Drills for all Infantry Units
(1) Conducts a quick reconnaissance to determine enemy flanks. (2) Locates mutually supporting positions. (3) Locates any obstacles that impede the assault ...
Read more >a ORDINANCE NO. 2.l—Making an appro
he has, from time to time, received the most ... that the Administration had lost ground heav- ... seventy miles up the Humboldt,...
Read more >The Flat Hat February 7, 2017 by The Flat Hat - Issuu
CORRECTIONS The Flat Hat wishes to correct any fact printed incorrectly. ... “The most prominent thing that I like about Professor Hudley is ......
Read more >Inflammatory bowel disease therapeutic strategies by ...
A need to increase our knowledge on IBD pathophysiology is growing, to define preventive measures, to improve disease outcome, ...
Read more >Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start FreeTop Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
Top GitHub Comments
For 2013 and later, the list of counties for each territory is being compiled based on the utilities that show up in association with a given BA in the
sales_eia861
table (in earlier years, the utilities associated with a given BA were listed explicitly in thebalancing_authority_eia861
table). So what does it mean that a county shows up in one of these maps? I think it means that a utility that serves that county sold electricity to end users in the BA in question. Is that a good proxy here, or not? That makes these territories the union of all the counties served by all the utilities that participated in sales within the BA.I think there’s another level of geographic specificity available here if we want it, which is the state in which the sales took place – for 2013 and later we have the state, BA code, and utility available in the
sales_eia861
table, so rather than pulling in all of the counties associated with each utility, we could just pull in the counties associated with the utility that are inside the state(s) that show up in thesales_eia861
table.Presumably the same kind of utility - BA associations will show up in many of the other EIA 861 tables. Should things like energy efficiency, demand response, and advanced metering infrastructure also be used to infer which counties are included in a BA territory?
Hmm. I had not really looked into the potential for these multi-layered nesting relationships, and what to do about them, or really gone into detail on whether these relationships all made sense purely from the point of view of the EIA 861 data. I was chasing down big missing / bad territories in the FERC 714 data. I’m not sure what the right thing to do is in here.