IBM watsonx.ai 리랭크

IBM watsonx.ai 리랭크 (Rerank)

watsonx.ai의 리랭크(재정렬) 기능을 LiteLLM의 rerank() API로 사용하는 방법을 알아봐요. 검색 결과를 재정렬할 때 유용해요.

출처: 문서

본문

개요

빠른 시작

LiteLLM SDK

import os
from litellm import rerank

os.environ["WATSONX_APIKEY"] = "YOUR_WATSONX_APIKEY"
os.environ["WATSONX_API_BASE"] = "YOUR_WATSONX_API_BASE"
os.environ["WATSONX_PROJECT_ID"] = "YOUR_WATSONX_PROJECT_ID"

query="Best programming language for beginners?"
documents=[
    "Python is great for beginners due to simple syntax.",
    "JavaScript runs in browsers and is versatile.",
    "Rust has a steep learning curve but is very safe.",
]

response = rerank(
    model="watsonx/cross-encoder/ms-marco-minilm-l-12-v2",
    query=query,
    documents=documents,
    top_n=2,
    return_documents=True,
)

print(response)

LiteLLM Proxy

model_list:
  - model_name: cross-encoder/ms-marco-minilm-l-12-v2
    litellm_params:
      model: watsonx/cross-encoder/ms-marco-minilm-l-12-v2
      api_key: os.environ/WATSONX_APIKEY
      api_base: os.environ/WATSONX_API_BASE
      project_id: os.environ/WATSONX_PROJECT_ID

더 알아보기 (Learn more)

• IBM WatsonX.ai 공식 문서
• LiteLLM 리랭크 API