How to search in rails from two models?

What are the good ways of measuring the success of a textual caption in search engines?

• I am interested in knowing if there are models and metrics for measuring the success of a caption (or textual snippets) in a search engine. For example let's say I have two models that generate two different types of captions. How can I know that model 1 is producing better captions than model 2.

• Answer:

  Measuring the success of classification is based on two phases. The first one is deciding whether the prediction matches the classification. The second is to aggregate the pairs of prediction-classification into a certain measure (e.g, accuracy, recall, mutual information). Deciding whether a caption fits the page belongs to the first phase and it is actually subjective. It will require going over captions and pages and deciding whether they fit. You can reduce the amount of subjectivity by letting some people to do the classification and require a consensus. After you will have an initial classified data set you will be able to evaluate your classifiers. Later you will be able to extend your data set while focusing in samples whose classification will contribute to you more by choosing samples on which the classifiers disagree.