Can I use more than one Computational Graph in different threads?

[liu946]

When I run my program with one thread, it works fine and there is always one computation graph at a time. However, I want to run it with multi-threads then I get the "Attempt to create >1 CG" error. Could you please tell me the reason assuming one CG, and if there is any chance to use more CG in different threads. I think it is safe since the model is not changed in my predict program. Thank you very much.

[neubig]

You can use DyNet's multi-processing functionality, which may solve your problem (http://dynet.readthedocs.io/en/latest/multiprocessing.html). Using multiple threads within a single is not supported at the moment. I've heard that there are people interested in this and potentially working on it, so if things go well we might be able to push a thread-safe version.

[dlwh]

Hi,

We (Semantic Machines) are interested in making this happen. It seemingly interacts (a bit) with multigpu support, since it involves removing global variables and such.

Anyway, please let me know if you'd like to discuss or if you already have efforts in this direction.

Thanks!

[neubig]

Will be fixed by #1064