CODEWITHSUNDEEP
pythonlistposition
Dani M
Dani M

Reputation: 25

How to stop having duplicate words in the list when using a list of positions in python

I have code which saves all the words in the sentence to a text file and saves the list of positions in to another textfile.

Rather than saving all the words in to the list I'm trying to find a method so that it will only save each word once to avoid duplication.

Additionally for my list of positions it will see if the word appears more than once and if it does it saves it as the first position which appears in the word which is fine but then it skips a position e.g [1,2,3,2,5] rather than the last position be 5 it should be 4 as there's no position 4 if that makes sense.

I don't expect anyone to do this for me but is there a method I should be using e.g if word in sentence do x or using enumerate()?

Here is my code:

#SUBROUTINES
def saveItem():
    #save an item into a new file
    print("creating a text file with the write() method")
    textfile=open("positions.txt","w")
    textfile.write(positions)
    textfile.write("\n")
    textfile.close()
    print("The file has been added!")

#SUBROUTINES
def saveItem2():
    #save an item into a new file
    print("creating a text file with the write() method")
    textfile=open("words.txt","w")
    textfile.write(str(words))
    textfile.write("\n")
    textfile.close()
    print("The file has been added!")

#mainprogram

sentence = input("Write your sentence here ")
words = sentence.split()
positions = str([words.index(word) + 1 for word in words])
print (sentence)
print (positions)




#we have finished with the file now.
a=True
while a:
    print("what would you like to do?:\n\
    1.Save a list of words?\n\
    2.Save a list of positions?\n\
    3.quit?\n\:")
    z=int(input())

    if z == 1:
        saveItem()
    elif z==2:
        saveItem2()

    elif z ==3:
        print("Goodbye!!!")
        a=False        

    else:
        print("incorrect option")

Sample input sentence: Programming is great Programming is so much fun

Sample list of words stored in text file: ['Programming','is','great','Programming','is','so','much','fun']

(the words are repeated)

Sample positions: [1,2,3,1,2,6,7,8]

Instead I'd like the list to be stored like: ['Programming','is','great','so,'much','fun']

and the list of positions like: [1,2,3,1,2,4,5,6]

Upvotes: 0

Views: 94

Answers (1)

coder
coder

Reputation: 12972

Haven't tested it but I think this should work:

from collections import Counter
sentence = raw_input(">>> ")

words, positions, d = [], [], {}
for i,word in enumerate(sentence.split(' ')):
    if word not in d.keys():
        d[word]=i
        words.append(word)
    positions.append(d[word])

# To further process the list
c, new_positions = Counter(positions), []
cnt = list(i for i in range(len(positions)+1) if not(i in c and c[i]>1))
new_positions = [p if c[p]>1 else cnt.pop(0) for p in positions]

# store the positions result
with open('positions.txt','w') as f:
    f.write(' '.join(map(str,new_positions)))

# store the words result
with open('words.txt','w') as w:
    w.write(' '.join(words))

Output:

$ ./test.py
>>> Programming is great Programming is so much fun
Words list:  ['Programming', 'is', 'great', 'so', 'much', 'fun']
Positions list:  [0, 1, 2, 0, 1, 5, 6, 7]
New Positions list:  [0, 1, 2, 0, 1, 3, 4, 5]

Upvotes: 1

Related Questions