CODEWITHSUNDEEP
pythondeep-learningcluster-analysisdata-science
John Jefferson Bautista
John Jefferson Bautista

Reputation: 302

Clustering structured data in Deep learning

Are there any Deep Learning literature/references where they performed clustering in structured data? I know it can be done using Kmeans, GMM etc. But is there any chance that cluster analysis to be done using Deep Neural Nets and the like? Thanks.

Upvotes: 0

Views: 799

Answers (4)

Jeereddy
Jeereddy

Reputation: 1082

Two other Potential Methods:

  1. KMeans + Autoencoder (a simple deep learning architecture with kmeans and reducing the dimensionality of the data using autoencoders).
  2. Deep Embedded Clustering algorithm (advanced deep learning)

Upvotes: 0

Has QUIT--Anony-Mousse
Has QUIT--Anony-Mousse

Reputation: 77454

Yes.

If you do a little bit of literature research yourself you will find that people have repeatedly published clustering with deep neural networks.

Except that it doesn't seem to work anywhere but on MNIST data...

Upvotes: 0

Martin Thoma
Martin Thoma

Reputation: 136379

Neural networks can be used in a clustering pipeline. For example, you can use Self-organizing maps (SOMs) for dimensionality reduction and k-means for clustering. Also, auto-encoders directly pop to my mind. But then, again, it is rather compression / dimensionality reduction than clustering. The real clustering is done by something else.

The problem with clustering is the missing optimization goal. The problem is not well-defined.

Upvotes: 2

anand_v.singh
anand_v.singh

Reputation: 2838

Deep learning refers to the depth of the neural nets in and the huge number of parameters applied to learn how to recognize features related to a certain object, and neural nets in essence need a loss function to learn, and the loss should be in the form of an equation that can by applying calculus give an estimate of how much each parameter we need to correct to get better result (Basically forward propogation to predict and backward propogation to update parameters), and such a loss function as of now does not exist, so we don't use neural nets for clustering. And if no neural nets, no deep learning.

If any part of that seems confusing comment below.

To read more about clustering algorithm have a look at this https://towardsdatascience.com/the-5-clustering-algorithms-data-scientists-need-to-know-a36d136ef68

Again you will find no neural nets. :)

Upvotes: 1

Related Questions