Open Power Quality

Open Power Quality

  • Documentation
  • Opportunities
  • News

›All Blog Posts

All Blog Posts

  • OPQ Study published in Energies
  • Serge Negrashov completes Ph.D. dissertation
  • Anthony Christe completes Ph.D. dissertation
  • University of Hawaii releases video on OPQ
  • OPQ collaborates with Electric Power Research Institute (EPRI)
  • OPQ's transient classification system published in Energy 2019
  • OPQ Ph.D. proposals now available
  • OPQ T-Shirts
  • OPQ wins runner up prize in Electromaker Connectivity Contest
  • Negrashov wins ARCS Fellowship
  • OPQ at VIP
  • OPQ wins UH President's Green Award
  • OPQ presents at Kyushu University's Energy Week
  • OPQ Fall 2017 Update
  • 2016 Year in Review
  • OPQBox engineering samples now running!
  • Google groups is dead; long live Slack!
  • OPQBox2 Design, V3
  • OPQBox2 Design, V2
  • OPQBox2 design available for review
  • Pipeline pilot published!
  • Pipeline pilot begins!
  • Technical Report: Enabling active participation in the Smart Grid through crowdsourced power quality data
  • OPQ at the Energy Excelerator

OPQ Study published in Energies

August 4, 2020

Philip Johnson

The OPQ team is happy to announce the publication of an article in the journal Energies entitled : "Design, Implementation, and Evaluation of Open Power Quality".

Here's the abstract:

Modern electrical grids are transitioning from a centralized generation architecture to an architecture with significant distributed, intermittent generation. This transition means that the formerly sharp distinction between energy producers (utility companies) and consumers (residences, businesses, etc.) are blurring: end-users both produce and consume energy, making energy management and public policy more complex. The goal of the Open Power Quality (OPQ) project is to design and implement a low cost, distributed power quality sensor network that provides useful new forms of information about modern electrical grids to producers, consumers, researchers, and policy makers. In 2019, we performed a pilot study involving the deployment of an OPQ sensor network at the University of Hawaii microgrid for three months. Results of the pilot study validate the ability of OPQ to collect accurate power quality data in a way that provides useful new insights into electrical grids.

The full paper is available at: https://www.mdpi.com/1996-1073/13/15/4032

Serge Negrashov completes Ph.D. dissertation

March 10, 2020

Philip Johnson

The OPQ team is delighted to announce that Serge Negrashov has successfully completed his Ph.D. dissertation: "Design, Implementation, and Evaluation of Napali: A novel distributed sensor network for improved power quality monitoring". The complete dissertation is available at http://csdl.ics.hawaii.edu/techreports/2020/20-02/20-02.pdf.

Here's the abstract:

Today's big data world heavily relies upon providing precise, timely, and actionable intelligence, while being burdened by the ever increasing need for data cleaning and preprocessing. While in the case of ingesting large quantity of unstructured data this problem is unavoidable, when it comes to sensor networks built for a specific purpose, such as anomaly detection, some of that computation can be moved to the edge of the network. This thesis concerns the special case of sensor networks tailored for monitoring the power grid for anomalous behavior. These networks monitor power delivery infrastructure with the intent of finding deviations from the nominal steady state, across multiple geographical locations. Aforementioned deviations, known as power quality anomalies, may originate, and be localized to the location of the sensor, or may affect a sizable portion of the power grid. The difficulty of evaluating the extent of a power quality anomaly stems directly from their short temporal and variable geographical impact. I present a novel distributed power quality monitoring system called Napali which relies on extracted metrics from individual meters and their temporal locality in order to intelligently detect anomalies and extract raw data within temporal window and geographical areas of interest.

The claims of this thesis are that Napali outperforms existing power quality monitoring gridwide event detection methods in resource utilization and sensitivity. Furthermore, Napali residential monitoring is capable of power grid monitoring without deployment on the high voltage transmission lines. Final claim of this thesis is that Napali capability of extracting portions of the events which did not pass the critical thresholds used in other detection methods allows for better localization of power quality disturbances. Napali claim validation was performed through deployment at the University of Hawaii. Fifteen OPQ Box devices, designed specifically to operate with Napali were located in various locations on campus. Data collected from these monitors was compared with smart meters already deployed across the University. Additionally, Napali was compared with standard methods of power quality event detection running along side the Napali systems.

Napali methodology outperformed the standard methods of power quality monitoring in resource consumption, event quality and sensitivity. Additionally, I was able to validate that residential utility monitoring is capable of event detection and localization without monitoring higher levels of the power grid hierarchy. Finally, as a demonstration of Napali capabilities, I showed how data collected by my framework can be used to partition the power delivery infrastructure without prior knowledge of the power grid topology.

Anthony Christe completes Ph.D. dissertation

February 24, 2020

Philip Johnson

The OPQ team is delighted to announce the Anthony Christe has successfully completed his Ph.D. dissertation: "LAHA: A framework for adaptive optimization of distributed sensor frameworks". The complete dissertation is available at http://csdl.ics.hawaii.edu/techreports/2020/20-01/20-01.pdf.

Here's the abstract:

Distributed Sensor Networks (DSNs) face a myriad of technical challenges. This dissertation examines two important DSN challenges.

One problem is converting "primitive" sensor data into actionable products and insights. For example, a DSN for power quality (PQ) might gather primitive data in the form of raw voltage waveforms and produce actionable insights in the form of the ability to predict when PQ events are going to occur by observing cyclical data. For another example, a DSN for infrasound might gather primitive data in the form of microphone counts and produce actionable insight in the form of determining what, when, and where the signal came from. To make progress towards this problem, DSNs typically implement one or more of the following strategies: detecting signals in the primitive data (deciding if something is there), classification of signals from primitive data (deciding what is there), and localization of signals (when and from where did the signals come). Further, DSNs make progress towards this problem by forming relationships between primitive data by finding correlations between spatial attributes, temporal attributes, and by associating metadata with primitive data to provide contextual information not collected by the DSN. These strategies can be employed recursively. As an example, the result of aggregating typed primitive data provides a new higher level of typed data which contains more context than the data from which is was derived from. This new typed data can itself be aggregated into new, higher level types and also participate in relationships.

A second important challenge is managing data volume. Most DSNs produce large amounts of (increasingly multimodal) primitive data, of which only a tiny fraction (the signals) is actually interesting and useful. The DSN can utilize one of two strategies: keep all of the information and primitive data forever, or employ some sort of strategy for systematically discarding (hopefully uninteresting and not useful) data. As sensor networks scale in size, the first strategy becomes unfeasible. Therefore, DSNs must find and implement a strategy for managing large amounts of sensor data. The difficult part is finding an effective and efficient strategy deciding what data is interesting and must be kept and what data to discard.

This dissertation investigates the design, implementation, and evaluation of the Laha framework, which provides new insight into both of these problems. First, the Laha framework provides a multi-leveled representation for structuring and processing DSN data. The structure and processing at each level is designed with the explicit goal of turning low-level data into actionable insights. Second, each level in the framework implements a "time-to-live" (TTL) strategy for data within the level. This strategy states that data must either "progress" upwards through the levels towards more abstract, useful representations within a fixed time window, or be discarded and lost forever. The TTL strategy is useful because when implemented, it allows DSN designers to calculate upper bounds on data storage at each level of the framework and supports graceful degradation of DSN performance.

There are several smaller, but still important problems that exist within the context of these two larger problems. Examples of the smaller problems that Laha hopes to overcome in transit to the larger goals include optimization of triggering, detection, and classification, building a model of sensing field topology, optimizing sensor energy use, optimizing bandwidth, and providing predictive analytics for DSNs.

Laha provides four contributions to the area of DSNs. First, the Laha design, a novel abstract distributed sensor network that provides useful properties relating to data management. Second, an evaluation of the Laha abstract framework through the deployment of two Laha-compliant reference implementations, validated data collection, and several experiments that are used to either confirm or deny the benefits touted by Laha. Third, two Laha-compliant reference implementations, OPQ and Lokahi, which can be used to form DSNs for the collection of distributed power quality signals and the distributed collection of infrasound signals. Fourth, a set of implications for modern distributed sensor networks as a result of the evaluation of Laha.

The major claim of this dissertation is that the Laha Framework provides a generally useful representation for real-time high-volume DSNs that address several major issues that modern DSNs face.

University of Hawaii releases video on OPQ

October 27, 2019

Philip Johnson

As part of the 2019 University of Hawaii Future Focus Conference, the University developed a short video on the Open Power Quality project which was shown to attendees. This video is now publicly available here:

https://www.youtube.com/watch?v=cGrQcyEZ5GI

OPQ collaborates with Electric Power Research Institute (EPRI)

October 7, 2019

Philip Johnson

The OPQ Team is pleased to announce its collaboration with EPRI (Electric Power Research Institute). For the past six months, EPRI has been evaluating OPQ technology to assess its ability to support the evaluation of advanced power quality analytics under development by EPRI. Bill Howe, Program Manager for Power Quality at EPRI, said, "The Open Power Quality project has produced novel hardware and software technology for power quality collection and analysis, and made it available to the community as open source. We are excited to evaluate its potential to help us address important power quality problems in industry."

For more information about EPRI's Power Quality Program, see http://mypq.epri.com/.

OPQ's transient classification system published in Energy 2019

June 1, 2019

Philip Johnson

We are pleased to announce the publication of "A transient classification system implementation on an open source distributed power quality network", by Charles Dickens, Anthony J. Christe, and Philip M. Johnson, in the Ninth International Conference on Smart Grids, Green Communications and IT Energy-aware Technologies.

Abstract: Capturing and classifying power quality phenomena is important for the smooth functioning of electrical grids. This paper presents methods for classifying the four types of transients (impulsive, arcing, oscillatory, and periodic notching) specified in the IEEE 1159 Power Quality standard. Our methods implement a tractable algorithm, which applies well understood signal processing methods and statistical inference for feature extraction and decision making. We tested our methods on simulated power quality disturbances in order to demonstrate the capabilities of the system. The results of this research include an operational implementation of a transient classifier for Open Power Quality, an open source distributed power quality network. Additional functionality can be easily incorporated into the system to extend the utility of our methods, such as a meta-analysis to capture higher level network wide events.

The paper is available here, and we have also published a screencast on the paper.

OPQ Ph.D. proposals now available

November 30, 2018

Philip Johnson

We are delighted to announce the publication of two Ph.D. proposals related to Open Power Quality. These proposals provide you with an nice overview of the major innovations we intend to implement within OPQ during 2019. Enjoy!

Design, implementation, and evaluation of Napali: A novel distributed sensor network for improved power quality monitoring, Serge Negrashov.

Abstract: Today’s big data world is heavily relied on to bring precise, timely, and actionable intelligence, while being burdened by the ever increasing need for data cleaning and preprocessing. While in the case of ingesting large quantity of unstructured data this problem is unavoidable, when it comes to sensor networks built for a specific purpose, such as anomaly detection, some of that computation can be moved to the edge of the network. This thesis concerns the special case of sensor networks tailored for monitoring the power grid for anomalous behavior. These networks consist of meters connected to the grid across multiple geographically separated locations, while monitoring the power delivery infrastructure with the intent of finding deviations from the nominal steady state. These deviations, known as power quality anomalies, may originate, and be localized to the location of the sensor, or may affect a sizable portion of the power grid. The difficulty of evaluating the extent of a power quality anomaly stems directly from their short temporal and variable geographical impact. I propose a novel distributed power quality monitoring system called Napali which relies on extracted metrics from individual meters and their temporal locality in order to intelligently detect anomalies and extract raw data within temporal window and geographical areas of interest. The results of this research should be useful in other disciplines, such as general sensor network applications, IOT, and intrusion detection systems.

Available at: http://csdl.ics.hawaii.edu/techreports/2018/18-03/18-03.pdf

Laha: A framework for adaptive optimization of distributed sensor networks, Anthony Christe.

Abstract: Distributed Sensor Networks (DSNs) are faced with a myriad of technical challenges. This dissertation examines two important DSN challenges. One problem that is apparent in any DSN is converting “primitive” sensor data into actionable products and insights. For example, a DSN for power quality (PQ) might gather primitive data in the form of raw voltage waveforms and produce actionable insights in the form of classified power quality events such as voltage sags or frequency swells or provide the ability to predict when PQ events are going to occur by observing cyclical data. For another example, a DSN for infrasound might gather primitive data in the form of microphone counts and produce actionable insight in the form of determining what, when, and where the signal came from.

To make progress towards this problem, DSNs typically implement one or more of the following strategies: detecting signals in the primitive data (deciding if something is there), classification of signals from primitive data (deciding what is there), localization of signals (when and where did the signals come from), and by forming relationships between primitive data by finding correlations between spatial attributes, temporal attributes, and by associating metadata with primitive data to provide contextual information not collected by the DSN. These strategies can be employed recursively. As an example, the result of aggregating typed primitive data provides a new higher level of types data which contains more context than the data from which is was derived from. This new typed data can itself be aggregated into new, higher level types and also participate in relationships. A second important challenge is managing data volume. Most DSNs produce large amounts of (increasingly multimodal) primitive data, of which only a tiny fraction (the signals) is actually interesting and useful. The DSN can either utilize one of two strategies: keep all of the information and primitive data forever, or employ some sort of strategy for systematically discarding (hopefully uninteresting and not useful) data. As sensor networks scale in size, the first strategy becomes unfeasible. Therefore, DSNs must find and implement a strategy for managing large amounts of sensor data. The difficult part is finding an effective and efficient strategy deciding what data is interesting and must be kept and what data to discard.

This dissertation investigates the design, implementation, and evaluation of the Laha framework, which is intended to address both of these problems. First, the Laha framework provides a multi-leveled representation for structuring and processing DSN data. The structure and processing at each level is designed with the explicit goal of turning low-level data into actionable insights. Second, each level in the framework implements a “time-to-live” (TTL) strategy for data within the level. This strategy states that data must either “progress” upwards through the levels towards more abstract, useful representations within a fixed time window, or be discarded and lost forever. The TTL strategy is interesting because when implemented, it allows DSN designers to calculate upper bounds on data storage at each level of the framework and supports graceful degradation of DSN performance.

Available at: http://csdl.ics.hawaii.edu/techreports/2018/18-02/18-02.pdf

OPQ T-Shirts

November 20, 2018

Philip Johnson

OPQ finally has t-shirts thanks to the design efforts of Camelia Lai! From left, Charles Dickens, Kaila Foltz, Anthony Christe, and Philip Johnson doing a group selfie at the 2018 Fall Vertically Integrated Projects demonstration.

The back of the shirt (not pictured) says, "Power Quality To The People!".

OPQ wins runner up prize in Electromaker Connectivity Contest

June 20, 2018

Serge Negrashov

We are delighted to announce that the Open Power Quality project was selected as a "runner up" in the Electromaker Connectivity Contest. We will be receiving an Electromaker swag bag in recognition for our efforts.

Negrashov wins ARCS Fellowship

April 12, 2018

Serge Negrashov

In part due to his work on Open Power Quality, ICS Ph.D. student Serge Negrashov is the 2018 recipient of the Martin Award for Information and Computer Science from the ARCS Foundation--Honolulu. We are very proud of Serge!

Next →
Open Power Quality
Documentation Quick Links
OverviewOPQ Box User GuideOPQ View User GuideAgile Power Monitoring for UHRoadmap
Community
SlackTwitterNewsPublic OPQ CloudContact Us
Development
GitHubProject BoardsDeveloper TeamOpportunities

Open Power Quality is sponsored by:
Collaborative Software Development Laboratory, University of Hawaii
Department of Information and Computer Sciences, University of Hawaii
Department of Electrical Engineering, University of Hawaii