question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Identify and fix the most important missing BA/Util geometries

See original GitHub issue

Many of the historical geometries that are generated using the EIA 861 + US Census data are very consistent with HIFLD in 2017-2018. Many of them are also self-consistent across the years for which we have data (2001-2018). However, there are some big holes that we need to fill in order to have workable territories for the major FERC 714 planning areas at least back to 2010.

Alter Geometries:

MISO (2009-2010)

  • MISO territory for 2010 is unreasonably small, and non-existent for 2009 and earlier years.
  • However, MISO reports demand for 2009-2010 in FERC 714.
  • However, based on this workshop report it looks like there’s essentially no difference between the 2011+ years and 2009-2010.
  • Backfill 2009-2010 with the 2011 geometry.

Southwest Power Pool (2006-2013)

  • SWPP has demand for all years but is missing geometry for 2006-2013
  • SPS has demand and geometry for 2006-2013, but nothing later.
  • SPS and SWPP merged in 2014.
  • SWPP geometry grows a lot between 2014 & 2015, population and demand grows modestly.
  • They expanded into SD, ND, MT.
  • Seems legit, and unrelated to the SPS merger, which appears to have been handled.
  • Need to backfill 2006-2013 geometries for SWPP… is the pre-expansion 2014 geometry likely to work?
  • Demand is consistent as far back as 2010. 2009 is 10% lower, 2006-2008 another 15% lower.
  • Incorporated Nebraska utilities in 2009 (April 1st, hence the middling demand)
  • Backfill 2010-2013 with the 2014 geometry.
  • Backfill 2006-2009 with 2014 map minus Nebraska.

Louisville Gas & Electric and Kentucky Utilities (2006-2012)

  • Reports demand for all years, but lacks geometries in the early ones.
  • Demand reported is consistent across all years.
  • Population and service territory area in 2013 are almost 2x bigger than later years.
  • Backfill 2006-2013 with the 2014 geometry.

American Electric Power Company (2011-2013)

  • Identified as a BA
  • Has geometries through 2010, but not thereafter.
  • Appears in the BA assn table only as a BA.
  • Makes sense that it’s only getting a geometry by virtue of its constituent utilities.
  • Demand reported 2006-2013 is pretty constant.
  • Big increase in territory (3x) and smaller increase in population (1.5x) between 2008 & 2009.
  • Early geometries are in the midwest. Later geometries bring in a bunch of Texas, Arkansas, Louisiana.
  • Appears that AEP really did expand into those areas.
  • However, the FERC-714 demand doesn’t change when those areas are integrated, so it seems like the demand being reported probably just pertains to the original service territory in the midwest & appalachia.
  • Limit service territory to counties in OH, IN, VA, WV, TN, KY, MI

Entergy Corporation/Services (2013)

  • Reports demand consistent with past years in 2013
  • However, geometry isn’t present.
  • Forward fill 2013 with geometry from 2012

Treat as Utilities not Balancing Authorities:

PG&E (2006-2010)

  • PG&E shows up as a BA in the EIA-861 only in 2002.
  • It shows up in all years as a utility, with service territory, etc.
  • As a utility, it shows up within CISO.
  • Because it’s showing up as a BA that one time, we’re assuming it’s a BA. But it never gets any territory associated with it outside of 2002, or as a utility.
  • This seems like a reporting irregularity.
  • Force PG&E to be treated as a utility by replacing it in 2002 with CISO in the BA table during ETL.
  • This should mean it gets categorized correctly across all years and gets a territory assigned automatically.

San Diego Gas & Electric Company (2011-2019)

  • Has a geometry in earlier years (2006-2010), but it’s missing from 2011 forward.
  • Reports consistent demand across all years in FERC-714
  • EIA-861 service territory table shows it having the same counties for all years 2001-2019 (San Diego & Orange)
  • Why isn’t it getting a service territory for the later years?
  • It’s being identified as a BA because it shows up in the BA table from 2001-2010, but after that it’s gone.
  • It also shows up in all the years of EIA 860 as a utility.
  • Force it to be treated as a utility

Dayton Power & Light (2011-2019)

  • Shows up as a BA in EIA-861 in 2001-2010
  • Also shows up as a utility in EIA-861 in 2005-2019
  • Has the same territory listed by its utility ID in all 19 years of service territory data.
  • Force it to be treated as a utility

Consumers Energy Company

  • Like PG&E it appears as a BA a few times (2003-2006) but really it appears to act like a utility.
  • Has service territory (counties) in all years, and shows up in other utility tables as a utility.
  • However, because it shows up at least once as a BA, we use the BA territory generation process, which doesn’t work if you’re really a utility. So it ends up getting no territory assigned (even though it’s got counties)
  • Force Consumers Energy Company to be treated as a utility, not a BA

Unfixable Service Territories

Mid-Continent Area Power Pool (2006)

  • No eia_code is provided for this respondent,and it’s unclear what it corresponds to.
  • Wikipedia suggests it’s the predecessor to the Midwest Reliability Organization which is a NERC region.
  • Respondent only appears in 2002.

FirstEnergy (2006-2008)

  • Ohio-based IOU with several different utility_id_eia values over the years.
  • OH based sales are reported in PJM for 2013 and later years via EIA-861.
  • Listed as a Power Marketer / Retail Power Marketer in the EIA-861.
  • Never shows up as a utility in the BA associations.
  • Never shows up in the service territory table.
  • Doesn’t appear to be fixable.

Westar Energy / KPL (2006-2008)

  • Several utilities named Westar
  • One in EIA-861 with complete geometries has sales that don’t track with the FERC-714 demand.
  • No obvious reconciliation to be had.

Wholesalers Without Service Territories

There are 28 respondents that appear to be some kind of wholesale organization, mostly cooperative G&Ts and public power entities without their own service territories. They account for about 34% of the reported demand that’s not associated with any service territory. A few are listed below from early investigation. The others were excluded if they:

  • Report demand in the FERC-714.
  • Never appear in the EIA-861 service territory table (with counties).
  • Are listed in EIA-860 or EIA-861 as a utility.
  • Appear to have a parent BA in the EIA-861 balancing_authority_assn_eia861 table.

Oglethorpe Power Corp (2006-2019)

  • Electricity supply cooperative in Georgia.
  • Has no geometry for any year, and doesn’t show up in the EIA-861. Does appear in EIA-860.
  • Is it maybe just a supplier with no customers or service territory of its own?
  • Is it’s demand being included already with Southern Company (SOCO) which covers all of Georgia?
  • In early years of EIA-861 which explicitly link utilities to the balancing authorities they are part of, Oglethorpe is associated with SOCO, but it has no counties associated with it in the service territory tables.

Northeast Utilities Service Company (2006-2014)

  • No geometry for any year in which it appears in FERC-714.
  • aka New England Hydro-Transmission Corp.
  • Eventually got bought out by Eversource.
  • Appears in early EIA-861 years in association with NE-ISO (in the BA table)
  • Does not show up anywhere within the service territory table.

Central Electric Power Cooperative (2006-2019)

  • Reports demand in all years, but never has a geometry.

Other Issues

  • PJM territory gets much smaller as you go back in time. Is that right?
  • Is the area near Houston being excluded from ERCOT?
  • PACE & PACW are separate balancing areas but a single utility. Need to merge them somehow. See #616

Issue Analytics

  • State:closed
  • Created 3 years ago
  • Reactions:2
  • Comments:11 (11 by maintainers)

github_iconTop GitHub Comments

1reaction
zaneselvanscommented, Jun 3, 2020

For 2013 and later, the list of counties for each territory is being compiled based on the utilities that show up in association with a given BA in the sales_eia861 table (in earlier years, the utilities associated with a given BA were listed explicitly in the balancing_authority_eia861 table). So what does it mean that a county shows up in one of these maps? I think it means that a utility that serves that county sold electricity to end users in the BA in question. Is that a good proxy here, or not? That makes these territories the union of all the counties served by all the utilities that participated in sales within the BA.

I think there’s another level of geographic specificity available here if we want it, which is the state in which the sales took place – for 2013 and later we have the state, BA code, and utility available in the sales_eia861 table, so rather than pulling in all of the counties associated with each utility, we could just pull in the counties associated with the utility that are inside the state(s) that show up in the sales_eia861 table.

Presumably the same kind of utility - BA associations will show up in many of the other EIA 861 tables. Should things like energy efficiency, demand response, and advanced metering infrastructure also be used to infer which counties are included in a BA territory?

0reactions
zaneselvanscommented, Jan 11, 2021

Hmm. I had not really looked into the potential for these multi-layered nesting relationships, and what to do about them, or really gone into detail on whether these relationships all made sense purely from the point of view of the EIA 861 data. I was chasing down big missing / bad territories in the FERC 714 data. I’m not sure what the right thing to do is in here.

Read more comments on GitHub >

github_iconTop Results From Across the Web

Commanding Heights : Episode 1 | on PBS
NARRATOR: This is the story of how the new global economy was born, a century-long battle as to which would control the commanding...
Read more >
Common Battle Drills for all Infantry Units
(1) Conducts a quick reconnaissance to determine enemy flanks. (2) Locates mutually supporting positions. (3) Locates any obstacles that impede the assault ...
Read more >
a ORDINANCE NO. 2.l—Making an appro
he has, from time to time, received the most ... that the Administration had lost ground heav- ... seventy miles up the Humboldt,...
Read more >
The Flat Hat February 7, 2017 by The Flat Hat - Issuu
CORRECTIONS The Flat Hat wishes to correct any fact printed incorrectly. ... “The most prominent thing that I like about Professor Hudley is ......
Read more >
Inflammatory bowel disease therapeutic strategies by ...
A need to increase our knowledge on IBD pathophysiology is growing, to define preventive measures, to improve disease outcome, ...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found