CODEWITHSUNDEEP
pythonscikit-learnlogistic-regression
haneulkim
haneulkim

Reputation: 4928

sklearn logistic regression loss value during training

Is there a way to obtain loss value at each iteration while training a logistic regression?

Python sklearn show loss values during training has an working example for SGDRegressor however not working for logistic regression.

Upvotes: 5

Views: 2541

Answers (2)

neverreally
neverreally

Reputation: 65

As mentioned in the comments, the workaround using sys.stdout unfortunately does not work for the LogisticRegression() class, although it does for SGDClassifier().

I did get this to work by running the Python file from the terminal and piping the output to a file directly:

python3 logreg_train.py > terminal_output.txt

Then one can parse the output to extract the change in training loss.

Upvotes: 0

Eddy Piedad
Eddy Piedad

Reputation: 366

I think you should change the parameter verbose or remove it. It works for me when you remove it, by default, "verbose=0".

old_stdout = sys.stdout
sys.stdout = mystdout = StringIO()
clf = LogisticRegression()
clf.fit(X_tr, y_tr)
sys.stdout = old_stdout
loss_history = mystdout.getvalue()
loss_list = []
for line in loss_history.split('\n'):
    if(len(line.split("loss: ")) == 1):
        continue
    loss_list.append(float(line.split("loss: ")[-1]))
plt.figure()
plt.plot(np.arange(len(loss_list)), loss_list)
plt.savefig("warmstart_plots/pure_LogRes:"+".png")
plt.xlabel("Time in epochs")
plt.ylabel("Loss")
plt.close()

Upvotes: 2

Related Questions