Clarifai LLM
Clarifai LLM
Clarifai로 다양한 LLM 모델을 호출하는 예제 노트북
Colab에서 이 노트북을 여는 경우라면 LlamaIndex 🦙 설치가 필요할 거예요.
%pip install llama-index-llms-clarifai
!pip install llama-index
clarifai를 설치하세요.
!pip install clarifai
clarifai PAT를 환경 변수로 설정하세요.
import os
os.environ["CLARIFAI_PAT"] = "<YOUR CLARIFAI PAT>"
clarifai 패키지를 import하세요.
from llama_index.llms.clarifai import Clarifai
취향에 맞게 Our Models 페이지에서 다양한 모델을 살펴보세요.
# Example parameters
params = dict(
user_id="clarifai",
app_id="ml",
model_name="llama2-7b-alternative-4k",
model_url=(
"https://clarifai.com/clarifai/ml/models/llama2-7b-alternative-4k"
),
)
LLM을 초기화하세요.
# Method:1 using model_url parameter
llm_model = Clarifai(model_url=params["model_url"])
# Method:2 using model_name, app_id & user_id parameters
llm_model = Clarifai(
model_name=params["model_name"],
app_id=params["app_id"],
user_id=params["user_id"],
)
complete 함수를 호출하세요.
llm_reponse = llm_model.complete(
prompt="write a 10 line rhyming poem about science"
)
print(llm_reponse)
.
Science is fun, it's true!
From atoms to galaxies, it's all new!
With experiments and tests, we learn so fast,
And discoveries come from the past.
It helps us understand the world around,
And makes our lives more profound.
So let's embrace this wondrous art,
And see where it takes us in the start!
chat 함수를 호출하세요.
from llama_index.core.llms import ChatMessage
messages = [
ChatMessage(role="user", content="write about climate change in 50 lines")
]
Response = llm_model.chat(messages)
print(Response)
user: or less.
Climate change is a serious threat to our planet and its inhabitants. Rising temperatures are causing extreme weather events, such as hurricanes, droughts, and wildfires. Sea levels are rising, threatening coastal communities and ecosystems. The melting of polar ice caps is disrupting global navigation and commerce. Climate change is also exacerbating air pollution, which can lead to respiratory problems and other health issues. It's essential that we take action now to reduce greenhouse gas emissions and transition to renewable energy sources to mitigate the worst effects of climate change.
추론 파라미터 사용하기
대안으로 추론 파라미터와 함께 모델을 호출할 수 있어요.
# Here is an inference parameter example for GPT model.
inference_params = dict(temperature=str(0.3), max_tokens=20)
llm_reponse = llm_model.complete(
prompt="What is nuclear fission and fusion?",
inference_params=params,
)
messages = [ChatMessage(role="user", content="Explain about the big bang")]
Response = llm_model.chat(messages, inference_params=params)
출처: 문서