pavel/fedavg_mpi
1
0 Fork 0
Code Issues Pull Requests Releases Wiki Activity
18 Commits 1 Branch 0 Tags
bc6d34e2535fc5cf330fcc7b7dff3003563f1cc2
Commit Graph
18 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
pavel bc6d34e253 now it kinda learns again and code is kinda clean 2019-12-01 15:44:34 -08:00
pavel 5d14171631 for some two other files weren't added to commit 2019-12-01 15:05:48 -08:00
pavel a2ef842ef8 take a more windowed approach 2019-12-01 15:04:59 -08:00
pavel 4bf66bf85e network trains and tests but slow? -- investigate 2019-12-01 11:26:54 -08:00
pavel b115077c3b now slave correctly gets data 2019-12-01 10:21:58 -08:00
pavel 569bbf7397 tokenize FASTER 2019-12-01 09:44:40 -08:00
pavel 7409eca38b added batcher and even made it twice as fast 
as it was a minute ago
 2019-11-30 22:40:23 -08:00
pavel 101248965c tokenizer and batcher are sane and work 
i wonder how much pain it's gonna cause me to change
something in the code
 2019-11-30 22:16:42 -08:00
pavel 04c35ed9b6 after literally hours of pain, keras learns mnist 2019-11-29 22:10:25 -08:00
pavel 87208d599d switched to meson, let's see if it's gonna bite me 2019-11-28 16:04:00 -08:00
pavel c4a21b6be8 reached some mildly amusing result 
of slaves having "independent" data sources and master still
training through them
 2019-11-27 17:37:40 -08:00
pavel 5af90383f0 commiting halfways because i'm feeling stuck 2019-11-26 22:11:54 -08:00
pavel 9727499f4d set up synchronous comm for many slaves 
and also abusing the c preprocessor
 2019-11-26 21:20:40 -08:00
pavel 725130e51f implemented a very smooth frankenstein function 2019-11-25 22:37:34 -08:00
pavel 76f8d7dcb6 a great work has been done here 
now there is no mentioning python in c code (except for the
boilerplate at the beginning, but the rest is nice clean c).
all the bridging is being done in cython (where it belongs).
and no memory leaks so there's that!
 2019-11-25 22:01:39 -08:00
pavel 253c833b5b commit small improvements before going craZy 2019-11-25 20:54:27 -08:00
pavel 04e0b9829c well done sending a network over mpi, pat pat 
now do a lot of nets in parallel and then we'll talk
 2019-11-25 20:23:33 -08:00
pavel a80a3de4fa it started working so commit it 2019-11-24 22:14:26 -08:00