video overview

IIr Associates, Inc.
Publisher of The Virginia Engineer

Print-Publishing Services
Web Site Design-Coding-Hosting
Business Consulting

Phone: (804) 779-3527

Safer, Quicker Data Processing Method Developed
May 22, 2020

A novel algorithm to solve big data resource sharing problems over large networks, developed by researchers in the Penn State College of Engineering, may also have implications for energy savings and data security.

The recent work led by Necdet Serhat Aybat, associate professor of industrial engineering, was published in the Society for Industrial and Applied Mathematics Journal on Optimization.

“Sometimes, when you minimize cost in one part of a network that has common resource constraints, it may skyrocket the cost in another part,” Prof. Aybat said. “Through this algorithm, we found a new way to efficiently minimize cost across the whole system in a decentralized manner.”

According to information, to improve the process of analyzing big data, Prof. Aybat’s algorithm efficiently computes optimal resource sharing over a decentralized system that interacts over a communication network. Rather than compiling all of the data in one location, the system breaks out the information into various agents, or independent computing modules. Each agent is responsible for solving one task that affects the whole system.

To heighten the privacy of the information in the system, the agents are only aware of their own task and their teammates’ messages, meaning that they are unaware of a neighbor’s task. Once an agent solves its job, the agent only passes on the answer to its neighbors. This process repeats itself until every agent agrees on a common optimal resource allocation decision.

Decentralized optimization over communication networks has garnered attention for its use in a range of areas such as coordination and control in drones, bandwidth estimation in wireless sensor networks, machine learning data analysis and power control in cellular networks.

“The complication arises when neighbors are changing,” Prof. Aybat said. “If agents are moving, it could possibly cause the communications network to change over time. Since the agents can talk to only certain [other] agents at any given time, and you want to minimize the system cost, it becomes a difficult problem. You’re trying to carefully steer the information exchange among agents to share the scarce common resources while collectively minimizing the total system cost.”

The proposed algorithm, utilizing the decentralized optimization method involving multiple rounds of communication at each repetition, enables these agents to appropriately divvy out the common resource among them in such a way that accomplishes the goal.

The National Science Foundation’s Directorate for Engineering within the Division of Civil, Mechanical and Manufacturing Innovation, and the Army Research Office supported this work.

  ------   News Item Archive  -----  
The Virginia Engineer on facebook
The Virginia Engineer RSS Feed