42
EDIT and novel links:
Deep Learning and Its Applications to Signal and Information Processing, IEEE Signal Processing Magazine, January 2011
Deep learning: the final frontier for signal processing and time series analysis? "In this article, I want to show several areas where signals or time series are vital"
I just come back (2018/04/23) from the yearly ...
20
First, there is nothing wrong with doing grad work in image processing or computer vision and using deep learning. Deep learning is not killing image processing and computer vision, it is merely the current hot research topic in those fields.
Second, deep learning is primarily used in object category recognition. But that is only one of many areas of ...
14
By long shot it is doable - to what extend? You will see. This task of environmental sound classification is not very well studied. Also choice of machine learning paradigm is crucial - statistical approach or maybe binary classifier? You can start with GMM's, ANN's and SVM's - I opt for GMM's and ANN's.
Yes, most of people are using MFCC's because they are ...
11
Today we had a discussion with a friend of mine. It was a rainy day here in Munich, while a large portion of Europe was having a kind of sunny atmosphere. People were sharing photographs in social media, where they were in nice summer dresses, wandering around the seas. She was annoyed with this situation and turned to me and asked: "Could you write a ...
10
No Deep Learning isn't killing Image Processing. You need huge datasets and lots of computational resources to do deep learning. There are plenty of applications where it is desirable to be able to do image processing with less computational load and smaller memory footprints and without having access to huge databases. Some examples are mobile phones, ...
8
Some Features:
Mean.
Variance.
Skewness.
Kurtosis.
Dominant 3 frequencies in the DFT.
Energy of the 3 dominant frequencies.
Max Value.
Min Value.
Median.
Usually I'd compute them in running windows.
Another great information is the Histogram of the Derivative.
Or just all the above of the Derivative.
6
The short answer is, No. DL can recognize a mug in a photo, but this doesn't kill signal processing in anyway. That said, your question is quite relevant in these troubled days. There is a nice panel discussion on the subject, featuring Stephane Mallat, etc., here.
5
It can be done very easily with the scikit-learn. Examples are easy to find on their website, i.e. here. In my opinion it is the best way to go.
Modified code example from the above link:
import numpy as np
import matplotlib.pyplot as plt
from sklearn.cluster import KMeans
from sklearn.datasets.samples_generator import make_blobs
########################...
5
Data engineering is still used in machine learning to preprocess and select the data fed to DNNs to improve their learning time and their evaluation efficiency. Image processing (the stuff between the camera sensor and the RGB/etc. bitmaps fed to the DNNs), a form of data engineering, is still needed.
5
There are, a few discrepancies that might be making a difference here. My suggestion would be to edit the question for clarity. There are quite a few assumptions that lead to non-straightforward thinking about the problem which I have tried to address to an extent and I would be happy to modify the response in light of more information.
In machine ...
4
Non-verbal Audio (let alone environmental) seems to be the little brother to main stream machine learning media types like images, speech, text.
To answer your question is it possible to train a network to identify a given sound? Yes, it is! But it's hard for all the same reasons machine learning is hard.
However what's really holding Audio back, and why ...
4
In addition to the features mentioned so far I would like to mention measures of complexity such as:
Shannon Entropy
LZ Complexity
Fractal Dimension
There are also Fourier Descriptors (as hinted by Drazick already) and their equivalent in Wavelet Analysis and of course simple histogram bins which would return how frequently each gear is engaged en route.
...
4
A thorough understanding of signal processing (along with linear algebra, vector calculus, mathematical statistics etc.) is imo indispensable for non-trivial work in the field of deep learning, especially in computer vision.
Some of the high impact papers in deep learning (now that most of the low hanging fruit have been picked) evince a good understanding ...
4
I really don't do much image processing but I worked for an organization (US Navy) that did and funded research in signal classification the last time Neural Nets were a hot topic, the mid to late 80's. I had to sit through a large number of essentially marketing stuff. The arguments were along the lines of:
It's Neural, like your brain and since it ...
4
From feature extraction to learning the desired result, deep learning algorithms can act as full pipelines for solving tasks at hand. End-to-end learning usually refers to omitting any hand-crafted intermediary algorithms and directly learning the solution of a given problem from the sampled dataset. This could involve concatenation of different networks ...
4
Types of signals:
According to their range set (values): Real Valued, Complex valued ;
According to their dimensions: Scalar, Vector ;
According to their values: Continuous Amplitude, Quantized ;
According to their domain set (arguments): Continuous-time, Discrete-time :
According to their mappings: Deterministic, Stochastic (Random) ;
According to their ...
4
in my opinion
your question seems based on a combination of thoughtful reflection and possibly, pre Alzheimer’s cognitive biases. ;)
There was an article in the WSJ not too long ago , I’m outside the paywall so I can’t provide a link, that looked at IBM’s efforts using Watson at major Cancer research centers.
The conclusion was that Watson wasn’t ...
3
The idea underlying the k-means algorithm is to find clusters that minimize the intra-cluster variance and maximize the inter-cluster sum-of-square. Note that the total variance is fixed so minimization of intra-cluster variance is equivalent to maximization of inter-cluster sum of square. Basically various methods aim to achieve such minimization.
However, ...
3
Labelling a missing value as -1000 (assuming a non-missing value is much smaller in absolute value) will not cause problems with anything based on decision trees/stumps (bagged/boosted). You might also have some success with mixture models, for example a GMM - the learning algorithm will allocate some components to cover the missing data. Same for non-...
3
What you are asking is called 'page layout analysis' in OCR. Take a look at https://en.wikipedia.org/wiki/Document_layout_analysis.
3
My perspective from university was that many signal processing people were a bit hostile toward ML, I suspect because they felt threatened that it was encroaching on their domain. But recently there's been a lot of research into benefits of complex valued deep neural networks, which may suggest that the golden ticket is really a solid understanding of both ...
3
This is a concept in supervised machine learning.
Train data: Used to train your supervised ML model. This data contains both the input and the desired output, which is compared with the output from your model. Your model is hence trained to reduce the prediction error or cost function.
Test data: The data for which you want to predict the outcome. The ...
3
Is there a script / tutorial / demo for penis detection?
[...]
Fairly serious quesion, future of internet memes is at stake
Yes, there is.
Common Pattern Recognition techniques will be able to spot one even with what would be considered today "traditional" approach (i.e. without "Deep Learning").
There already is a sub-category of the subject ...
2
Some tips that might help:
Your FFT should be shorter than the features you are trying to detect. An FFT will be calculated for a specific number of samples. This represents a certain length of time (1024 samples at 1kHz sampling rate is 1024 milliseconds.) If the time period of your FFT is longer than your signal features then they will all be smeared ...
2
Here is a solution for sound classification for 10 classes: dog barking, car horn, children playing etc. It is based on tensorflow library using neural networks. Features are extracted by converting sound clips to spectrogram
2
At your first stage, which classifier to use is not that important, you may need to make your code run first. There was a very famous paper on Face Recognition and Gender Determination, in which a very complex transform was implemented to represent each node on the face. The used gabor kernal based wavelet transform to get set of coefficients for each node(...
2
I think you've got the point, but that you are getting confused by the additional tables that you think should be used to implement buckets.
Let's rephrase the quote from the tutorial first:
In LSH, you create a partition of the entire space. If you use a large
bucket width $w$, then obviously you need less buckets to span the
entire space and thus ...
2
So you basically have a noisy speech signal and want to analyze only the noise without speech? This seems like a task for a voice activity detector (VAD). Assuming it works properly it should give you the parts of the signal containing speech and the parts of the signal containing noise. This approach is often used in speech enhancement where an estimate of ...
2
The Lyons book is gold for someone in your situation. Have patience with the topic of audio DSP -- the more time you spend trying to learn it, the less you will know that you know. :)
2
This is called novelty detection. One-Class SVM is used, where the test data is classified only with regard to membership to the training data. The separating hyperplane lies around the training data and thereby implicitly divides the training data from the rejection class. The advantage is that the rejection class is not defined explicitly, which is ...
Only top voted, non community-wiki answers of a minimum length are eligible
