Signal recognition is a spectrum sensing problem that jointly requires detection, localization in time and frequency, and classification. This is a step beyond most spectrum sensing work which involves signal detection to estimate "present" or "not present" detections for either a single channel or fixed sized channels or classification which assumes a signal is present. We define the signal recognition task, present the metrics of precision and recall to the RF domain, and review recent machine-learning based approaches to this problem. We introduce a new dataset that is useful for training neural networks to perform these tasks and show a training framework to train wideband signal recognizers.
Wideband Signal Localization with Spectral Segmentation
Signal localization is a spectrum sensing problem that jointly detects the presence of a signal and estimates a center frequency and bandwidth. This is a step beyond most spectrum sensing work which estimates "present" or "not present" detections for either a single channel or fixed sized channels. We define the signal localization task, present the metrics of precision and recall, and establish baselines for traditional energy detection on this task. We introduce a new dataset that is useful for training neural networks to perform this task and show a training framework to train signal detectors to achieve the task and present precision and recall curves over SNR. This neural network based approach shows an 8 dB improvement in recall over the traditional energy detection approach with minor improvements in precision.
A Semester Like No Other: Use of Natural Language Processing for Novice-Led Analysis on End-of-Semester Responses on Students’ Experience of Changing Learning Environments Due to COVID-19
Sreyoshi Bhaduri, Michelle Soledad, Tamoghna Roy, and 2 more authors
In 2021 ASEE Virtual Annual Conference Content Access, 2021
In response to campus closures due to COVID-19, the learning environment in a foundational engineering course unexpectedly shifted from hands-on, collaborative work to remote delivery, accomplished within a short period of time. Through end-of-semester course surveys, students were asked open-ended questions to get feedback about their experience with the goal of using student feedback for curriculum planning and improvement should there be continued need to facilitate the course remotely in subsequent semesters. However, with 1,170 responses, the volume of data made it challenging to analyze, interpret and use the feedback for decision-making for following semesters. To address this challenge, we utilized Natural Language Processing (NLP) based techniques - algorithmic ways to analyze, interpret, and present words and sentiments from student responses visually, to inform a novice-led analysis to ultimately help with course planning for future semesters.
2020
MSE Analysis of Bi-scale LMS Used for Narrowband Interference Cancellation
Tamoghna Roy, Takeshi Ikuma, and AA Louis Beex
In 2020 IEEE Latin-American Conference on Communications (LATINCOM), 2020
Adaptive LMS (Least Mean Square) equalizers are widely used in digital communication systems for their simplicity of implementation. Conventional adaptive filtering theory suggests that the upper bound on performance of such an equalizer is determined by the performance of a Wiener filter of the same structure. However, in the presence of a narrowband interferer the performance of the (normalized) LMS equalizer can be better than that of its Wiener counterpart. The Bi-scale NLMS (BLMS) algorithm enhances this NLMS (Normalized LMS) characteristic by simultaneously using two instantiations of NLMS that run at very different time scales. In this paper, the derivation of a predictive model for the MSE (Mean Square Error) performance of the BLMS equalizer as narrowband interference canceler is shown. The predictive model can be used to adjust canceler parameters on the fly without the delay needed for time-consuming simulations. Simulation results validate the proposed MSE model, which is shown to predict performance of the BLMS equalizer over a wide range of parameters.
2019
Generative adversarial radio spectrum networks
Tamoghna Roy, Tim O’Shea, and Nathan West
In Proceedings of the ACM Workshop on Wireless Security and Machine Learning, 2019
Simulating and imitating RF communications signals and systems is a core function of jammers, spoofers, and other attacks in wireless radio environments which seek to confuse spectrum users as to what is occurring in the spectrum around them. Replay attacks and "DRFMs" have long been commonly used to deceive and probe radio systems, however generative models introduce an interesting new angle wherein generative replay can now produce examples of signals of similar structure and properties to arbitrary signals which are not verbatim replays and which may be varied in an infinite number of ways. Further, as GANs have demonstrated a strong ability to learn distributions from complex scenes and datasets, we consider the task of full-band spectral generation in addition to single signal generation to validate and demonstrate the feasibility of such an approach, to refine the algorithmic approach, and to quantify and illustrate the capabilities of such an approach on modern day signal sets.
Approximating the void: Learning stochastic channel models from observation with variational generative adversarial networks
Timothy J O’Shea, Tamoghna Roy, and Nathan West
In 2019 International Conference on Computing, Networking and Communications (ICNC), 2019
Channel modeling is a critical topic when considering accurately designing or evaluating the performance of a communications system. Most prior work in designing or learning new modulation schemes has focused on using simplified analytic channel models such as additive white Gaussian noise (AWGN), Rayleigh fading channels or other similar compact parametric models. In this paper, we extend recent work training generative adversarial networks (GANs) to approximate wireless channel responses to more accurately reflect the probability distribution functions (PDFs) of stochastic channel behaviors. We introduce the use of variational GANs to provide appropriate architecture and loss functions which accurately capture these stochastic behaviors. Finally, we illustrate why prior GAN-based methods failed to accurately capture these behaviors and share results illustrating the performance of such as system over a range of complex realistic channel effects.
2018
SigMF: The signal metadata format
Ben Hilburn, Nathan West, Tim O’Shea, and 1 more author
The Signal Metadata Format (SigMF) specifies a way to describe sets of recorded digital signal samples with metadata written in JSON. SigMF can be used to describe general information about a collection of samples, the characteristics of the system that generated the samples, and features of the signal itself. It is designed to be a simple and portable format that is easily used by memory-limited applications with real-time requirements and minimal dependencies.
Demonstrating deep learning based communications systems over the air in practice
Timothy J O’Shea, Tamoghna Roy, Nathan West, and 1 more author
In 2018 IEEE International Symposium on Dynamic Spectrum Access Networks (DySPAN), 2018
Several novel approaches to wireless communications system design have recently been introduced which use deep learning to synthesize and adapt a new class of signal processing systems to the actual data and effects present in the radio environment. Both the autoencoder-based communications system and the feature learning-based radio signal sensor represent significant progress in the ability of radio systems to optimize directly on real-world data samples and distributions. As part of this demonstration, we will show two real-world systems operating over-the-air using these approaches, which we are rapidly maturing at DeepSig to bring theory into practice.
Power Measurement Based Code Classification for Programmable Logic Circuits
Tamoghna Roy, and AA Louis Beex
In 2018 IEEE International Symposium on Signal Processing and Information Technology (ISSPIT), 2018
Traditional cyber security and monitoring systems rely on prior knowledge about possible attacks, which renders them ineffective against novel schemes (zero-day attacks). Moreover, intruders are targeting different types of devices (e.g. Programmable Logic Circuits/Controllers (PLC)) for which traditional security systems are unavailable. A solution to this problem is provided by analysis of the power consumption behavior of a system and relating power consumption characteristics to behavior internal to the device. In this work, a detection system is developed which is capable of discriminating between different codes executed by the target device, a PLC, based on passive measurement at the external power supply point; this is unlike previous methods, which relied on a specific sensor located directly over the chip. Results show that for a PLC, which is executing four different codes, the classification system can discriminate with very high accuracy (> 99%).
Over-the-air deep learning based radio signal classification
Timothy James O’Shea, Tamoghna Roy, and T Charles Clancy
IEEE Journal of Selected Topics in Signal Processing, 2018
We conduct an in depth study on the performance of deep learning based radio signal classification for radio communications signals. We consider a rigorous baseline method using higher order moments and strong boosted gradient tree classification, and compare performance between the two approaches across a range of configurations and channel impairments. We consider the effects of carrier frequency offset, symbol rate, and multipath fading in simulation, and conduct over-the-air measurement of radio classification performance in the lab using software radios, and we compare performance and training strategies for both. Finally, we conclude with a discussion of remaining problems, and design considerations for using such techniques.
Physical layer communications system design over-the-air using adversarial networks
Timothy J O’Shea, Tamoghna Roy, Nathan West, and 1 more author
In 2018 26th European Signal Processing Conference (EUSIPCO), 2018
This paper presents a novel method for synthesizing new physical layer modulation and coding schemes for communications systems using a learning-based approach which does not require an analytic model of the impairments in the channel. It extends prior work published on the channel autoencoderto consider the case where the stochastic channel response is not known or can not be easily modeled in a closed form analytic expression. By adopting an adversarial approach for learning a channel response approximation and information encoding, we jointly learn a solution to both tasks applicable over a wide range of channel environments. We describe the operation of the proposed adversarial system, share results for its training and validation over-the-air, and discuss implications and future work in the area.
Non-Wiener Characteristics of LMS Adaptive Equalizers: A Bit Error Rate Perspective
We introduce a new method for radio signal detection and localization within the time-frequency spectrum based on the use of convolutional neural networks for bounding box regression. Recently, this class of approach has surpassed human-level performance on computer vision benchmarks for object detection, but similar techniques have not yet been adopted for radio applications. We introduce the basic approach explain how labeled training data containing wideband spectrum annotated with masks and bounding boxes can be used to train a highly effective radio signal detector which achieves higher levels of contextual understanding and improved sensitivity performance when compared with more traditional nave energy thresholding based signal detection schemes. We extend prior work from the computer vision field, employing a variation of the You Only Look Once (YOLO) architecture which is a fast and accurate visual object detector. Results are shown from illustrating the effectiveness from our entry into the DARPA Battle-of-the-ModRecs competition and over the air datasets
Spectral detection and localization of radio events with learned convolutional neural features
Timothy J O’Shea, Tamoghna Roy, and Tugba Erpek
In 2017 25th European Signal Processing Conference (EUSIPCO), 2017
We introduce a method for detecting, localizing and identifying radio transmissions within wide-band time-frequency power spectrograms using feature learning using convolutional neural networks on their 2D image representation. By doing so we build a foundation for higher level contextual radio spectrum event understanding, labeling, and reasoning in complex shared spectrum and many-user environments by developing tools which can rapidly understand and label sequences of events based on experience and labeled data rather than signal-specific detection algorithms such as matched filters.
A word-space visualization approach to study college of engineering mission statements
Sreyoshi Bhaduri, and Tamoghna Roy
In 2017 IEEE Frontiers in Education Conference (FIE), 2017
Most higher education institutions have a mission statement that is developed strategically by the institutions and often reflect the college’s unique mission which sets it apart from peer institutions. Through this study, we describe the use of a Machine Learning and Natural Language Processing based textual data analytics to understand the word choices in the mission statements of U.S. based colleges of engineering. Our purpose is to understand the key similarities and differences between the choice of words used in the mission statements of the two groups: public colleges and private colleges of engineering. We were specifically interested in studying the terms related to diversity and inclusion and see the trends in the use of specific terms relating to diverse communities, intersections, minority populations, and the like. In this research study, we used a Word2Vec approach to visualize the words from mission statements for 59 colleges of engineering in the United States. The contribution of this research is in the form of a visualization mapping the vector space model for word usage and complete vocabulary of pertinent words from the statements analyzed. The preliminary results of this study will help inform current state of vocabulary used in mission statements in the colleges of engineering across the United States. Ultimately, such analyses can help administrators in the development of strategies on the formation of mission and vision statements for universities by allowing insight into vocabulary currently used, to understand what words/terms may not be adequately addressed. Additionally, we are excited to present a contemporary textual data analytical technique of Natural Language Processing using a word vector representation tool such as word2vec for analyzing textual data in the field of engineering education.
Demonstrating use of natural language processing to compare college of engineering mission statements
Most higher education institutions have a mission and/or vision statement that is designed to communicate with a variety of audiences. These statements are developed strategically by organizations and often reflect the college’s unique vision which sets it apart from peer institutions. Analytical techniques which rely on word usage, semantic information, and metadata information can be used to generate powerful descriptive models with allow us to obtain relevant information from text-based data. This work-in-progress study presents a Natural Language Processing based textual data analytical approach to study the mission and vision statements with the purpose of understanding the key similarities and differences between the choice of words used in them. We analyzed a total of 59 engineering colleges: 29 public, and 30 private, across the United States. Results of this study indicate that there is indeed a difference in word frequencies for public versus private engineering colleges. The contribution of this research is in the form of charts quantitatively summarizing the comparative word usage and a descriptive overview of the complete vocabulary of pertinent words from the statements analyzed. Topical clustering based on words seen in prior literature was also conducted to analyze comparative categories across the institutions. This study can help inform strategies on the formation of mission and vision statements for universities by allowing administrators insight into vocabulary used across colleges.
2015
Non-Cooperative Localization Using Differential RSS and Link Loss Parameter Estimation
Tamoghna Roy, and A. A. (Louis) Beex
In 2015 Wireless Innovation Forum Conference on Communications Technologies and Software Defined Radio (WInnComm 2015), 2015
The performance of a narrowband interference canceling FIR Wiener equalizer is analyzed. While mean squared error (MSE) relates to bit error rate (BER), their connection is not necessarily a direct one when the detector output noise is not Gaussian. We show that BER can be increasing for increasing signal power (or decreasing noise power) even though MSE is decreasing. A Gaussian BER model may not be accurate then. For digital modulation schemes using FIR Wiener equalizers in a narrowband interference dominated environment, a Gaussian sum model is derived for the Wiener filter output. The analytical evaluation of the probability of bit error based on the Gaussian sum model produces a BER prediction that is shown to provide a close match with observed/estimated BER, in particular for lower order equalizers.