Rewriting Bash to Ruby (cont.)
This morning I was able to finish up the re-write of the summary script and I was very pleased with the results: the processing of the pipeline log dropped from 4+ min to less than 5 sec - even with jruby, and the other two are in the sub-2 sec range. The latter are really dominated by the jruby startup time, and if we can move to an RMI ruby in deployment, that will help here too.
In short - fantastic success! Now I need to come up with a better queueing and processing scheme in bash - or re-write that in ruby as well…