How to Get Started With Dell Pro AI Studio Using Code Samples

Dell Pro AI Studio is a comprehensive toolkit designed to simplify and accelerate the development, deployment, and management of AI applications on Dell AI PCs.

Affected Products:

• Dell Pro AI Studio

My program currently uses OpenAI APIs and is set up to use cloud services. How can I transition to using Dell Pro AI Studio local models and compute?

Dell Pro AI Studio was designed to lift and shift certain workloads to local compute. If your current AI application is using an OpenAI API configuration, you probably have some code that looks like the code below:

Python code example:

client = OpenAI(
base_url="https://your-custom-endpoint",
api_key="your-api-key",
)

Once you have installed Dell Pro AI Studio, you can change your application configuration from the above to the below.

Python code example:

client = OpenAI(
    base_url="http://localhost:8553/v1/openai",
    api_key="dpais"
)

My app requires streaming functionality, does Dell Pro AI Studio Framework support streaming?

Absolutely! Usually, your code needs the Stream keyword argument added in a function call.

Http code example using Phi 3.5:

{
        "model": "phi3.5",
        "messages": [
            {"role": "system", "content": "You are a helpful assistant."},
            {"role": "user",   "content": "Hello"},
        ],
        "stream": "true"
    }

Python code example:

messages=[{"role": "system", "content": "You are concise."},
                {"role": "user",   "content": "Say hi"}]
resp = client.chat.completions.create(
            model=Phi3.5,
            messages=messages,
            stream=True,
        )