Featherless AI
Featherless AI
Featherless AI의 모든 모델을 지원해요. litellm 요청 시 model=featherless_ai/<any-model-on-featherless> 접두사로 설정하기만 하면 돼요. 전체 지원 모델 목록은 https://featherless.ai/models 를 참고하세요.
출처: 문서
본문
API 키
# env variable
os.environ['FEATHERLESS_AI_API_KEY']
샘플 사용법 (Sample Usage)
from litellm import completion
import os
os.environ['FEATHERLESS_AI_API_KEY'] = ""
response = completion(
model="featherless_ai/featherless-ai/Qwerky-72B",
messages=[{"role": "user", "content": "write code for saying hi from LiteLLM"}]
)
샘플 사용법 - 스트리밍 (Streaming)
from litellm import completion
import os
os.environ['FEATHERLESS_AI_API_KEY'] = ""
response = completion(
model="featherless_ai/featherless-ai/Qwerky-72B",
messages=[{"role": "user", "content": "write code for saying hi from LiteLLM"}],
stream=True
)
for chunk in response:
print(chunk)