Maëva LC
Maëva LC

Reputation: 323

AttributeError: 'Tensor' object has no attribute '_keras_history'

I looked for all the "'Tensor' object has no attribute ***" but none seems related to Keras (except for TensorFlow: AttributeError: 'Tensor' object has no attribute 'log10' which didn't help)...

I am making a sort of GAN (Generative Adversarial Networks). Here you can find the structure.

Layer (type)                     Output Shape          Param #         Connected to                     
_____________________________________________________________________________
input_1 (InputLayer)             (None, 30, 91)        0                                            
_____________________________________________________________________________
model_1 (Model)                  (None, 30, 1)         12558           input_1[0][0]                    
_____________________________________________________________________________
model_2 (Model)                  (None, 30, 91)        99889           input_1[0][0]                    
                                                                       model_1[1][0]                    
_____________________________________________________________________________
model_3 (Model)                  (None, 1)             456637          model_2[1][0]                    
_____________________________________________________________________________

I pretrained model_2, and model_3. The thing is I pretrained model_2 with list made of 0 and 1, but model_1 return approached values. So i considered rounding the model1_output, with the following code : the K.round() on model1_out.

import keras.backend as K
[...]
def make_gan(GAN_in, model1, model2, model3):
    model1_out = model1(GAN_in)
    model2_out = model2([GAN_in, K.round(model1_out)])
    GAN_out = model3(model2_out)
    GAN = Model(GAN_in, GAN_out)
    GAN.compile(loss=loss, optimizer=model1.optimizer, metrics=['binary_accuracy'])
    return GAN
[...]

I have the following error :

AttributeError: 'Tensor' object has no attribute '_keras_history'

Full traceback :

Traceback (most recent call last):
  File "C:\Users\Asmaa\Documents\BillyValuation\GFD.py", line 88, in <module>
GAN = make_gan(inputSentence, G, F, D)
  File "C:\Users\Asmaa\Documents\BillyValuation\GFD.py", line 61, in make_gan
GAN = Model(GAN_in, GAN_out)
  File "C:\ProgramData\Anaconda3\lib\site-packages\keras\legacy\interfaces.py", line 88, in wrapper
return func(*args, **kwargs)
  File "C:\ProgramData\Anaconda3\lib\site-packages\keras\engine\topology.py", line 1705, in __init__
build_map_of_graph(x, finished_nodes, nodes_in_progress)
  File "C:\ProgramData\Anaconda3\lib\site-packages\keras\engine\topology.py", line 1695, in build_map_of_graph
layer, node_index, tensor_index)
  File "C:\ProgramData\Anaconda3\lib\site-packages\keras\engine\topology.py", line 1695, in build_map_of_graph
layer, node_index, tensor_index)
  File "C:\ProgramData\Anaconda3\lib\site-packages\keras\engine\topology.py", line 1665, in build_map_of_graph
layer, node_index, tensor_index = tensor._keras_history
AttributeError: 'Tensor' object has no attribute '_keras_history'

I'm using Python 3.6, with Spyder 3.1.4, on Windows 7. I upgraded TensorFlow and Keras with pip last week. Thank you for any help provided !

Upvotes: 20

Views: 25710

Answers (6)

Aytekin Yıldızhan
Aytekin Yıldızhan

Reputation: 1

I also have faced the same problem. When I use x = relu(x) then I got same error. Overcome this problem, I define a function and use Lambda layer.

def relu_func(x):
  
    return relu(x)

    x = layers.Lambda(relu_func)(x)

Upvotes: 0

Daniel M&#246;ller
Daniel M&#246;ller

Reputation: 86600

Try this:

def make_gan(GAN_in, model1, model2, model3):
    model1_out = model1(GAN_in)
    model1_out = Lambda(lambda x: K.round(x), output_shape=...)(model1_out)
    model2_out = model2([GAN_in, model1_out])
    GAN_out = model3(model2_out)
    GAN = Model(GAN_in, GAN_out)
    GAN.compile(loss=loss, optimizer=model1.optimizer, 
                metrics=['binary_accuracy'])
    return GAN

Upvotes: 1

Abhishek
Abhishek

Reputation: 131

This is supported in tensorflow versions 1.x You are using version 2.x probably.

%tensorflow_version 1.x
use the above tensorflow_version magic before importing tensorflow in google colab.

This is not valid in jupyter-notebook. Please do use Google Colab

Upvotes: 0

peikuo
peikuo

Reputation: 665

My problem was using '+' instead of 'Add' on keras

Upvotes: 23

YC_
YC_

Reputation: 329

Since the error comes directly from here:

Traceback (most recent call last):
  File "C:\Users\Asmaa\Documents\BillyValuation\GFD.py", line 88, in <module>
GAN = make_gan(inputSentence, G, F, D)
  File "C:\Users\Asmaa\Documents\BillyValuation\GFD.py", line 61, in make_gan
GAN = Model(GAN_in, GAN_out)

, and the inputs of your models depend on the outputs from previous models, I believe the bug lies in the codes in your model.

In you model code, please check line by line whether or not you apply a non-Keras operation, especially in the last few lines. For example ,for element-wise addition, you might intuitively use + or even numpy.add, but keras.layers.Add() should be used instead.

Upvotes: 13

陈家胜
陈家胜

Reputation: 758

@'Maëva LC': I can't post a comment, this answers your None issue.

but the code is working fine without the line

model1_out = (lambda x: K.round(x), output_shape=...)(model1_out)

and not anything else. Anyway, thank you for trying.

Function round() is not differentiable, hence the gradient is None. I suggest you just remove the line.

Upvotes: 4

Related Questions