News & Events > Army advances learning capabilities of drone swarms

Army advances learning capabilities of drone swarms

  • Aug 11, 2020
  • Categories: Counter Drone News

 

ADELPHI, Md. — Army researchers developed a reinforcement learning approach that will allow swarms of unmanned aerial and ground vehicles to optimally accomplish various missions while minimizing performance uncertainty.

Swarming is a method of operations where multiple autonomous systems act as a cohesive unit by actively coordinating their actions.

Army researchers said future multi-domain battles will require swarms of dynamically coupled, coordinated heterogeneous mobile platforms to overmatch enemy capabilities and threats targeting U.S. forces.

The Army is looking to swarming technology to be able to execute time-consuming or dangerous tasks, said Dr. Jemin George of the U.S. Army Combat Capabilities Development Command’s Army Research Laboratory.

“Finding optimal guidance policies for these swarming vehicles in real-time is a key requirement for enhancing warfighters’ tactical situational awareness, allowing the U.S. Army to dominate in a contested environment,” George said.

Reinforcement learning provides a way to optimally control uncertain agents to achieve multi-objective goals when the precise model for the agent is unavailable; however, the existing reinforcement learning schemes can only be applied in a centralized manner, which requires pooling the state information of the entire swarm at a central learner. This drastically increases the computational complexity and communication requirements, resulting in unreasonable learning time, George said.

In order to solve this issue, in collaboration with Prof. Aranya Chakrabortty from North Carolina State University and Prof. He Bai from Oklahoma State University, George created a research effort to tackle the large-scale, multi-agent reinforcement learning problem. The Army funded this effort through the Director’s Research Award for External Collaborative Initiative, a laboratory program to stimulate and support new and innovative research in collaboration with external partners.

The main goal of this effort is to develop a theoretical foundation for data-driven optimal control for large-scale swarm networks, where control actions will be taken based on low-dimensional measurement data instead of dynamic models.

The current approach is called Hierarchical Reinforcement Learning, or HRL, and it decomposes the global control objective into multiple hierarchies – namely, multiple small group-level microscopic control, and a broad swarm-level macroscopic control.

“Each hierarchy has its own learning loop with respective local and global reward functions,” George said. “We were able to significantly reduce the learning time by running these learning loops in parallel.”

CONTINUE READING > 

Article Courtesy of ARMY.MIL

Related Posts

  • FAA Evaluates Drone Detection Systems Around Denver

      November 16– Unmanned Aircraft Systems (UAS) that enter the protected airspace around airports can pose serious threats to safety. The FAA is coordinating with our government and industry partners to evaluate technologies that can be used safely to detect drones near airports. This week, the FAA and the Department of Homeland Security (DHS) are […]

  • Implementing Combat Lessons with C-UAV Capabilities

    Determined to meet the challenge of hostile Unmanned Aerial Systems (UAS), the US Army acquired a number of countermeasures able to defeat such threats using electronic warfare. The Islamic State in Iraq and Syria pioneered the use of commercially available micro drones armed for attack or suicide missions. These weapons were used on a large […]

  • ORBITAL ATK CREATES INTEGRATED, COUNTER UAS CAPABILITY

    At DSEI, Orbital ATK showcases Tactical-Robotic Exterminator (T-REX), a mounted and integrated version of the combat-proven Liteye AUDS non-lethal Electronic Attack (EA) capability combined with the lethal defeat capability of the Orbital ATK XM914 30mm BUSMASTER Chain Gun. This new mounted system integrated with tactical radar detection and electro-optical infrared (EO/IR) sensors, provides great Unmanned Aerial System (UAS) identification […]

This website uses cookies to ensure you get the best experience on our website. Visit our Privacy & Terms of Use here.