Making Lines

• The canonical way to make lines (or hyperplaner separators) is to use quadratic programming.
• I still haven't been able to find a good description of that.
• Support Vector Machines Succinctly has a good an explanation of it all and pointers to some code.
• A simpler way is to use the old perceptron learning rule.
• This just starts out with a separator, and then moves it until it classifies correctly.
• These are hard margin separators, and don't work well with categories that aren't linearly separable.
• For these, you want to use a soft margin separator, with error tolerance specified.