Cohere Reranker
The Cohere Reranker is a postprocessor that uses the Cohere API to rerank the results of a search query.
Setup
Firstly, you will need to install the llamaindex
package.
pnpm install llamaindex
Now, you will need to sign up for an API key at Cohere. Once you have your API key you can import the necessary modules and create a new instance of the CohereRerank
class.
import {
CohereRerank,
Document,
OpenAI,
VectorStoreIndex,
Settings,
} from "llamaindex";
Load and index documents
For this example, we will use a single document. In a real-world scenario, you would have multiple documents to index.
const document = new Document({ text: essay, id_: "essay" });
Settings.llm = new OpenAI({ model: "gpt-3.5-turbo", temperature: 0.1 });
const index = await VectorStoreIndex.fromDocuments([document]);
Increase similarity topK to retrieve more results
The default value for similarityTopK
is 2. This means that only the most similar document will be returned. To retrieve more results, you can increase the value of similarityTopK
.
const retriever = index.asRetriever();
retriever.similarityTopK = 5;
Create a new instance of the CohereRerank class
Then you can create a new instance of the CohereRerank
class and pass in your API key and the number of results you want to return.
const nodePostprocessor = new CohereRerank({
apiKey: "<COHERE_API_KEY>",
topN: 4,
});
Create a query engine with the retriever and node postprocessor
const queryEngine = index.asQueryEngine({
retriever,
nodePostprocessors: [nodePostprocessor],
});
// log the response
const response = await queryEngine.query("Where did the author grown up?");