A few questions about add_graph

Hi @lanpa , thanks for this amazing tool. I’m trying to use add_graph in my own project, where I met these questions:

1. How to use add_graph in the training iteration? Am I supposed to initialize the SummaryWriter outside the main training loop and call w.add_graph inside the loop? If so how do I get the model output? Or this feature is only possible for dummy input and being called only once? Why it’s necessary to feed input to the model? It would be nice if you can provide an example with add_graph used in a complete project(instead of demo_graph.py).
2. Does it support custom CUDA layer? I tried with a custom correlation layer, and no matter what kind of data is fed into the model(random or image) the custom correlation failed for unknown reason.

Thanks for your time!

[kunguang]

如果我的graph里有embedding层，是不是graph就读取不了

[lanpa]

@JiamingSuen There is a hacky solution. Since you only need to draw once, and result is don’t care. You can replace the GPU module with the following.

class Correlation(nn.Module):
    def __init__(self):
        super(Correlation, self).__init__()

    def forward(self, x):
        # implement a fake correlation 
        #(as long as the output size is the same as real correlation) 
        return 

I will give a shot on the real GPU code in the weekend.