CODEWITHSUNDEEP
pytorchdistributed
leaf_love
leaf_love

Reputation: 1

I obtained the graph using torch.fx. How to split the graph and place it on different GPUs?

how to auto split the graph.For example Resnet?

I have got the graph of Resnet traced by torch.fx.How can i get the subgraphs and place them in different gpus. What should I learn to solve the Problem.

I'm a newbie, please give me some advice.Thanks.

Upvotes: 0

Views: 271

Answers (1)

siahuat0727
siahuat0727

Reputation: 26

Automatically deciding which node to cut off can be challenging. I think a practical way is to manually decide the split points based on experience or trial-and-error. For splitting a graph, you can refer to this blog. Although the demo uses torch.export, the process is similar for torch.fx. Hope this helps!

Upvotes: 0

Related Questions