aceminer
Reputation: 4295
Finding if a set of lines exists in a large text file
How do i find out the intersection of 2 files in windows?
TextFile A: 100GB TextFile B: 10MB
All i can think of is using python
I would read the lines in textfile B into memory in python and compare with each line in text file A.
I was wondering if there is any way to do it via the command prompt in linux/windows.
Upvotes: 1
Views: 43
Answers (1)
Niklas Rosencrantz
Reputation: 26681
If repetition doesn't matter, then this command will do it:
sort <(sort file1 | uniq) <(sort file2 | uniq) | uniq -d
Upvotes: 1
Related Questions
- Shell script to to check if a line exist in a file
- Check if a line exists in a file
- Python: Check if a specific line of text is in a file
- Checking if a text file has another line Python
- Searching for lines in a text file using python
- Fast way to check if a string is in a huge text file
- Search if line exists from one file to another file
- python search through text files composed of lines
- If line not present in the text file - python
- File iteration, checking line existence