5abe7bb413
a lot of small stuff
2019-12-07 19:56:23 -08:00
997d3a7618
the pipeline kinda works, you can even demo it
2019-12-01 22:04:57 -08:00
b2a4681fb2
implemented some kind of dispatching
2019-12-01 17:49:09 -08:00
bc6d34e253
now it kinda learns again and code is kinda clean
2019-12-01 15:44:34 -08:00
a2ef842ef8
take a more windowed approach
2019-12-01 15:04:59 -08:00
4bf66bf85e
network trains and tests but slow? -- investigate
2019-12-01 11:26:54 -08:00
b115077c3b
now slave correctly gets data
2019-12-01 10:21:58 -08:00
569bbf7397
tokenize FASTER
2019-12-01 09:44:40 -08:00
7409eca38b
added batcher and even made it twice as fast
...
as it was a minute ago
2019-11-30 22:40:23 -08:00
101248965c
tokenizer and batcher are sane and work
...
i wonder how much pain it's gonna cause me to change
something in the code
2019-11-30 22:16:42 -08:00
04c35ed9b6
after literally hours of pain, keras learns mnist
2019-11-29 22:10:25 -08:00
c4a21b6be8
reached some mildly amusing result
...
of slaves having "independent" data sources and master still
training through them
2019-11-27 17:37:40 -08:00
5af90383f0
commiting halfways because i'm feeling stuck
2019-11-26 22:11:54 -08:00
9727499f4d
set up synchronous comm for many slaves
...
and also abusing the c preprocessor
2019-11-26 21:20:40 -08:00
725130e51f
implemented a very smooth frankenstein function
2019-11-25 22:37:34 -08:00
76f8d7dcb6
a great work has been done here
...
now there is no mentioning python in c code (except for the
boilerplate at the beginning, but the rest is nice clean c).
all the bridging is being done in cython (where it belongs).
and no memory leaks so there's that!
2019-11-25 22:01:39 -08:00
253c833b5b
commit small improvements before going craZy
2019-11-25 20:54:27 -08:00
04e0b9829c
well done sending a network over mpi, pat pat
...
now do a lot of nets in parallel and then we'll talk
2019-11-25 20:23:33 -08:00
a80a3de4fa
it started working so commit it
2019-11-24 22:14:26 -08:00
