Make openai_organization Optional in OpenAI plugins

[Future-Outlier]

Tracking issue

flyteorg/flyte#3936

Why are the changes needed?

It's optional now.

How was this patch tested?

chatgpt agent: unit test, local execution, and single binary remote execution
batch agent: unit test

Help

I can't run the batch agent task in my local execution.
It will start an infinite event loop.

import os
from typing import Iterator

from flytekit import Secret, workflow
from flytekit.types.file import JSONLFile
from flytekit.types.iterator import JSON
from flytekitplugins.openai import BatchResult, create_batch



def jsons():
    for x in [
        {
            "custom_id": "request-1",
            "method": "POST",
            "url": "/v1/chat/completions",
            "body": {
                "model": "gpt-3.5-turbo",
                "messages": [
                    {"role": "system", "content": "You are a helpful assistant."},
                    {"role": "user", "content": "What is 2+2?"},
                ],
            },
        },
        {
            "custom_id": "request-2",
            "method": "POST",
            "url": "/v1/chat/completions",
            "body": {
                "model": "gpt-3.5-turbo",
                "messages": [
                    {"role": "system", "content": "You are a helpful assistant."},
                    {"role": "user", "content": "Who won the world series in 2020?"},
                ],
            },
        },
    ]:
        yield x

#
#
# iterator_batch = create_batch(
#     name="gpt-3.5-turbo-iterator",
#     # openai_organization="your-org",
#     secret=Secret(group="openai", key="api_key"),
# )
#
#
#
# @workflow
# def json_iterator_wf(json_vals: Iterator[JSON] = jsons()) -> BatchResult:
#     return iterator_batch(jsonl_in=json_vals)
#
#
# if __name__ == "__main__":
#     print(f"Running {__file__} main...")
#     print(f"Running json_iterator_wf() {json_iterator_wf()}")

it_batch = create_batch(
    name="gpt-3.5-turbo",
    secret=Secret(group="openai", key="api_key"),
)

file_batch = create_batch(

    name="gpt-3.5-turbo",
    openai_organization="org-NayNG68kGnVXMJ8Ak4PMgQv7",
    secret=Secret(group="openai", key="api_key"),
    is_json_iterator=False,

)


@workflow
def json_iterator_wf(json_vals: Iterator[JSON] = jsons()) -> BatchResult:

    return it_batch(jsonl_in=json_vals)


@workflow
def jsonl_wf(jsonl_file: JSONLFile = "build/data.jsonl") -> BatchResult:

    return file_batch(jsonl_in=jsonl_file)

if __name__ == "__main__":
    print(f"Running {__file__} main...")
    print(f"Running json_iterator_wf() {json_iterator_wf()}")
    print(f"Running jsonl_wf() {jsonl_wf()}")

Screenshots

chatgpt local execution and remote execution

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 45.40%. Comparing base (097e9e8) to head (047d2e2).
Report is 4 commits behind head on master.

Additional details and impacted files

@@             Coverage Diff             @@
##           master    #2585       +/-   ##
===========================================
- Coverage   76.22%   45.40%   -30.82%     
===========================================
  Files         187      217       +30     
  Lines       18938    20295     +1357     
  Branches     3706     3705        -1     
===========================================
- Hits        14435     9215     -5220     
- Misses       3870    10971     +7101     
+ Partials      633      109      -524     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.