Tomonori Sadamoto

Online Reinforcement Learning Control of Large Networks using Data-based Dimensionality Reduction

Reinforcement Learning (RL) is an effective way of designing model-free linear quadratic regulator (LQR) controller for linear time-invariant (LTI) networks with unknown state-space models. However, when the network size is large, the usual RL method results in an unacceptably large amount of learning time. In this paper we resolve this problem by developing an alternative approach for RL-based LQR that combines dimensionality reduction with RL theory. The approach is to construct a reduced-dimensional compressed state vector by projecting the measured state through a projective matrix that is also constructed from the state data. Next, a RL- based controller is learned using the reduced-dimensional state instead of the original state such that the resultant cost is as close to the optimal LQR cost as possible. Numerical benefits of the proposed approach are verified using illustrative examples including an example of wide-area control of large-dimensional power system benchmark models.

Yasuaki Wasa

Contract theory based control/incentive synthesis in dynamic power networks

We focus on a new research topic in electricity market mechanism, balancing market after gate closure toward ensuring market-based ancillary services, which are a quality assurance of electric energy including frequency, voltage and power control in dynamic power network. To achieve such a fast market contract, we propose a novel control/incentive synthesis based on dynamic principal-agent (PA) problem in contract theory. To apply the analytical solutions to simple engineering problems, we also discuss the performance of the proposed control/incentive architecture.

Toru Namerikawa

Passivity-Short-based Plug and Play Operation of Dynamic Electricity Pricing with Power Flow

This talk deals with a distributed decision method for determining the electricity price with communication delay among market participants in the real-time market. We analyze the stability and convergence properties for the market trading system using the concept of passivity-short. A trading system is proposed based on dynamic pricing considering negative price and plug and play operation that each market participant intermittently participates in market trading. Regarding this system, especially, even when there is a power flow among each area and communication delay among market participants, we show that the stability of market trading system is guaranteed. Finally, the effectiveness of the proposed method is confirmed by numerical simulations.

Yohei Yamaguchi

Activity-based community/urban-scale modeling of building energy demand

(TBA)

Shinya Yoshizawa

Evaluation of Energy Management System Scheme in High PV and EV Penetration using Hardware Testbed

Energy management systems (EMSs) for power grids and homes are important for supplying reliable power and saving power and energy in homes. Recently, a coordinated EMS scheme between power grids and homes based on demand response requests have been developed, and Waseda University has developed a hardware testbed, in order to develop and evaluate the EMS schemes. In this presentation, I would like to introduce features and benefits for our hardware testbed and show some experimental results of the coordinated EMS schemes on the testbed.

Hideaki Ishii

Securing Power Grids Through Outlier Detections and Removals

In this poster, we discuss system theoretic approaches for detection of cyber attacks in the context of power systems. The attacks considered are in the form of data manipulation in the measurements. A common point in the approaches is to focus on outliers in the data. We first introduce the problem of static state estimation at the transmission grid level. In particular, we study the scenario of coordinated attacks on the data of grid topology and transmission line parameters. We approach this problem based on robust estimation techniques. Second, we discuss the impact of cyber attacks on voltage regulation at the distribution grid level. We employ a centralized control scheme that utilizes voltage measurements from sectionizing switches. Through simulation case studies, it is demonstrated that falsified measurements can cause voltage violation in the system, whose effect can be significantly reduced by robustifying the controller.

Masaaki Nagahara

Activities toward Society 5.0 in Japan

Society 5.0 is proposed in the 5th Science and Technology Basic Plan by the Cabinet Office in Japan, as a future society that Japan should aspire to. Society 5.0 is technologically defined as a system of systems (SoS), where many systems (e.g. energy management systems, road transport systems, etc) are connected via the Internet to achieve some global requirements (e.g. reducing carbon emissions). In this presentation, we will review the concept of Society 5.0 and introduce a research project of Society 5.0 in Kitakyushu, Japan, with the financial support by JST Mirai Program.

Sarasij Das

Data Markets for Smart Grids

Conventional power grids are being transformed into smart grids with the help of computer technologies. This has led to the generation of huge amount of data. Management of enormous amount of smart grid data poses significant challenge to the data owners. Currently, there are not much incentives available to encourage better data management among data owners. Generated smart grid data mostly stay with the owner of the data. Lack of a proper data exchange platform often prohibits the flow of data across various entities of smart grids. Exchange of data is necessary for efficient utilization of smart grid data. To address these issues, this work proposes data markets for smart grids. The advantages of Smart Grid Data Market (SGDM) are outlined in this work. Smart grid data and related services are the tradable commodities in the SGDMs. A market model is proposed for SGDM. Market structure, participants, commodities, attributes of data pricing, data licensing, data authenticity and other aspects of the proposed SGDMs are discussed.