CODEWITHSUNDEEP
powershellpowershell-2.0
vineel
vineel

Reputation: 3683

Windows PowerShell to find duplicate lines in a file

I need to find the duplicate values in a text file using power shell let's say if the file content is 

Apple
Orange
Banana
Orange
Orange

Desired output should be

Orange
Orange

Upvotes: 14

Views: 21537

Answers (2)

Nasir
Nasir

Reputation: 11401

You can also use the Group-Object cmdlet to see if any lines occur more than once:

e.g.

Get-Content test.txt | Group-Object | Where-Object { $_.Count -gt 1 } | Select -ExpandProperty Name

Upvotes: 33

vineel
vineel

Reputation: 3683

Used the Commands mentioned below and it worked.

PS C:\Projects> $OriginalContent, $UniqueContent = (Get-Content .\File.txt), (Get-Content .\File.txt | Sort-object -unique)
PS C:\Projects> compare-object $originalcontent $uniquecontent

or to print the text and the count use the following command

PS C:\Projects> Get-Content .\File.txt | group-object

Upvotes: 3

Related Questions