05480606b0
small refactoring and kicked the visualizer again
2019-12-15 09:51:22 -08:00
79e8b9874b
for some reason I dockerized it and it works
2019-12-13 17:35:06 -08:00
4a9e328884
visualizer kinda working, more work needs done
2019-12-13 11:05:38 -08:00
1338df9db2
very nice scalability curve up to 12 procs
...
parameters: wiki, BPE 250, BS 32, TARGET 8.3, the rest is commited
also it might be that more pipelines would work if there were
MANY more pipelines, but that remains to be seen until i buy
myself a Ryzen 3700x and destroy the world with it i guess i
should go to sleep now
2019-12-12 22:26:50 -08:00
2bbb1d243c
stop refactoring and get some stuff huggin' done
2019-12-12 21:10:41 -08:00
7043b65532
this is the baseline for evaluation
2019-12-11 10:31:16 -08:00
5abe7bb413
a lot of small stuff
2019-12-07 19:56:23 -08:00
997d3a7618
the pipeline kinda works, you can even demo it
2019-12-01 22:04:57 -08:00
b2a4681fb2
implemented some kind of dispatching
2019-12-01 17:49:09 -08:00
bc6d34e253
now it kinda learns again and code is kinda clean
2019-12-01 15:44:34 -08:00
5d14171631
for some two other files weren't added to commit
2019-12-01 15:05:48 -08:00
4bf66bf85e
network trains and tests but slow? -- investigate
2019-12-01 11:26:54 -08:00
b115077c3b
now slave correctly gets data
2019-12-01 10:21:58 -08:00
569bbf7397
tokenize FASTER
2019-12-01 09:44:40 -08:00
7409eca38b
added batcher and even made it twice as fast
...
as it was a minute ago
2019-11-30 22:40:23 -08:00
101248965c
tokenizer and batcher are sane and work
...
i wonder how much pain it's gonna cause me to change
something in the code
2019-11-30 22:16:42 -08:00