Featherless AI | liteLLM (original) (raw)

https://featherless.ai/

tip

**We support ALL Featherless AI models, just set model=featherless_ai/<any-model-on-featherless> as a prefix when sending litellm requests. For the complete supported model list, visit https://featherless.ai/models **

API Key​

# env variable
os.environ['FEATHERLESS_AI_API_KEY']

Sample Usage​

from litellm import completion
import os

os.environ['FEATHERLESS_AI_API_KEY'] = ""
response = completion(
    model="featherless_ai/featherless-ai/Qwerky-72B", 
    messages=[{"role": "user", "content": "write code for saying hi from LiteLLM"}]
)

Sample Usage - Streaming​

from litellm import completion
import os

os.environ['FEATHERLESS_AI_API_KEY'] = ""
response = completion(
    model="featherless_ai/featherless-ai/Qwerky-72B", 
    messages=[{"role": "user", "content": "write code for saying hi from LiteLLM"}],
    stream=True
)

for chunk in response:
    print(chunk)

Chat Models​