Error/ Ceiling Analysis

Error analysis

Manually examine the examples (in cross validation set) that your algorithm made errors on. See if you spot any systematic trend in what type of examples it is making errors on.

Ceiling analysis

Estimate the errors due to each component to decide what part of the pipeline should spend the most time trying to improve.