Sort:  

To be honest, I will use plug and play libs. I should prove it first, then I can optimize it.

Still, most libs like Tensorflow allow you to choose the Classifier, you should test which works best!