Source code

[nkatzz]

Source code

[bereczdaniel]

Hello, thanks for reaching out.
You can find the source code for the PS here: https://github.com/FlinkML/flink-parameter-server.
We also have another implementation which uses Kafka to overcome some of the problems of the Flink Iteration API: https://github.com/bereczdaniel/flink-kafka-parameter-server
We also gave a talk about it at Flink Forward, I think it can help: https://www.youtube.com/watch?v=4JEciJxJ5to

[nkatzz]

Hi again, thank you very much for the quick reply. I'm referring to tutorial code that does not exist in the PS implementation (this one: https://github.com/FlinkML/flink-parameter-server). Stuff that appear in imports in the tutorial like

import hu.sztaki.ilab.ps.matrix.factorization.sinks._

methods like "psOnlineLearnerAndGeneratorWithModelLoad", things like that. My intention is to load it in Intellij and go through the execution to try and understand what's going on while looking at the code, so being able to run it independently of the notebook, add breakpoints etc would be very helpful (currently, if I add the flink-ps_2.11-0.1.0.jar in a project the sources in the jar appear as compiled code only).

Thanks again!

[bereczdaniel]

Unfortunately the development was a bit hectic at that time and I don't have the source code for the tutorial ATM, but I will try to dig it up.
However I think all the relevant functions can be found in the current implementation, maybe under a slightly different name. If you could share your use-case with me, I think we could figure out some solution.

[nkatzz]

I understand, and thank you for taking the time to look into this. The project that we've put together is nothing special really, just a main method (from the tutorial) and flink-ps_2.11-0.1.0.jar added as a library. The project is here:

https://github.com/VagelisN/ParameterServerExample

Best regards,
Nikos