turbo ai下載turbo ai源代碼下載

turbo ai

其他源碼

0.3.11

下載

渦輪茶

使用python中的異步生成器構建chatgpt應用的慣用方法

關於

CHATGPT API使用稱為ChatMl的新輸入格式。在Openai的Python客戶端中，該格式被使用類似：

 messages = [
    { "role" : "system" , "content" : "Greet the user!" },
    { "role" : "user" , "content" : "Hello world!" },
]

這裡的想法是使用異步生成器逐步構建消息，然後使用它來生成完成。異步發電機對於做這種事情的多功能和簡單抽象。它們也可以很容易地組成。

 # Equivalent turbo-chat generator
async def example ():
    yield System ( content = "Greet the user!" )
    yield User ( content = "Hello World!" )

    # To run generation, just yield Generate(),
    # the lib will take care of correctly running the app, and
    # return the value back here.
    output = yield Generate ()
    print ( output . content )

請參閱下面的更多詳細示例。

安裝

pip install turbo-chat

例子

 from typing import AsyncGenerator , Union

from turbo_chat import (
    turbo ,
    System ,
    User ,
    Assistant ,
    GetInput ,
    Generate ,
    run ,
)

# Get user
async def get_user ( id ):
    return { "zodiac" : "pisces" }

# Set user zodiac mixin
# Notice that no `@turbo()` decorator used here
async def set_user_zodiac ( user_id : int ):

    user_data : dict = await get_user ( user_id )
    zodiac : str = user_data [ "zodiac" ]

    yield User ( content = f"My zodiac sign is { zodiac } " )


# Horoscope app
@ turbo ( temperature = 0.0 )
async def horoscope ( user_id : int ):

    yield System ( content = "You are a fortune teller" )

    # Yield from mixin
    async for output in set_user_zodiac ( user_id ):
        yield output

    # Prompt runner to ask for user input
    input = yield GetInput ( message = "What do you want to know?" )

    # Yield the input
    yield User ( content = input )

    # Generate (overriding the temperature)
    value = yield Generate ( temperature = 0.9 )

# Let's run this
app : AsyncGenerator [ Union [ Assistant , GetInput ], str ] = horoscope ({ "user_id" : 1 })

_input = None
while not ( result := await ( app . run ( _input )). done :
    if result . needs_input :
        # Prompt user with the input message
        _input = input ( result . content )
        continue

    print ( result . content )

# Output
# >>> What do you want to know? Tell me my fortune
# >>> As an AI language model, I cannot predict the future or provide supernatural fortune-telling. However, I can offer guidance and advice based on your current situation and past experiences. Is there anything specific you would like me to help you with?
#

自定義內存

您還可以在執行之間自定義如何在執行之間持續存在。

 from turbo_chat import turbo , BaseMemory

class RedisMemory ( BaseMemory ):
    """Implement BaseMemory methods here"""

    async def setup ( self , ** kwargs ) -> None :
        ...

    async def append ( self , item ) -> None :
        ...

    async def clear ( self ) -> None :
        ...


# Now use the memory in a turbo_chat app
@ turbo ( memory_class = RedisMemory )
async def app ():
    ...

直接獲取對內存對象的訪問（只需聲明附加參數）

 @ turbo ()
async def app ( some_param : Any , memory : BaseMemory ):

    messages = await memory . get ()
    ...

產生對內部使用的響應，但不要屈服於下游

 @ turbo ()
async def example ():
    yield System ( content = "You are a good guy named John" )
    yield User ( content = "What is your name?" )
    result = yield Generate ( forward = False )

    yield User ( content = "How are you doing?" )
    result = yield Generate ()

b = example ()
results = [ output async for output in b ]

assert len ( results ) == 1

添加一個簡單的內存中緩存

您還可以子類BaseCache類以創建自定義緩存。

 cache = SimpleCache ()

@ turbo ( cache = cache )
async def example ():
    yield System ( content = "You are a good guy named John" )
    yield User ( content = "What is your name?" )
    result = yield Generate ()

b = example ()
results = [ output async for output in b ]

assert len ( cache . cache ) == 1