1

Random Forest Classification of Finger Movements using Electromyogram (EMG) Signals

One of the fundamental problems in the development of prosthetic fingers is the recognition of finger movements using surface electrocardiogram (EMG) data. Most of the previous studies have proposed the classification of EMG signals using features …

Quick Question: Interrupting Users for Microtasks with Reinforcement Learning

Human attention is a scarce resource in modern computing. A multitude of microtasks vie for user attention to crowdsource information, perform momentary assessments, personalize services, and execute actions with a single touch. A lot gets done when …

How to miss data? Reinforcement learning for environments with high observation cost

We present a self-tuning RL agent that learns to adjust the accuracy of the samples when the observation cost is an intrinsic part of the environment.

DEEP Reinforcement Learning Based Energy Beamforming for Powering Sensor Networks

We focus on a wireless sensor network powered with an energy beacon, where sensors send their measurements to the sink using the harvested energy. The aim of the system is to estimate an unknown signal over the area of interest as accurately as …

Nurture: Notifying Users at the Right Time Using Reinforcement Learning

User interaction is an essential part of many mobile devices such as smartphones and wrist bands. Only by interacting with the user can these devices deliver services, enable proper configurations, and learn user preferences. Push notifications are …

Optimization vs. Reinforcement Learning for Wirelessly Powered Sensor Networks

We consider a sensing application where the sensor nodes are wirelessly powered by an energy beacon. We focus on the problem of jointly optimizing the energy allocation of the energy beacon to different sensors and the data transmission powers of the …

Battery-powered AUV network lifetime under energy constraints

With the recent advances in autonomous underwater vehicle (AUV) technology, it has become feasible to deploy AUV fleets as ad hoc networks for coordinated missions such as remote intelligence, area mapping, and tactical surveillance. In these …

Performance analysis of small data transmission schemes for cellular M2M communications

Channel access procedures of the state-of-the-art cellular standards create a significant overhead for small messages transmitted by Internet of Things (IoT) devices. As IoT becomes a major source of traffic for next-generation wireless …

Connectivity analysis of an AUV network with OFDM based communications

Autonomous underwater vehicle (AUV) networks play a crucial role in tactical, commercial, and scientific applications, where reliable and robust communication protocols are needed due to the challenging characteristics of the channel. With this …

Probabilistic broadcast for dense AUV networks

As the technology behind autonomous underwater vehicles (AUV) becomes more feasible, it is possible to use fleets of AUVs for coordinated missions such as area mapping, surveillance, etc. The AUVs are typically sent by a central node such as a …