chat with image_url bug

[kobotis]

this is sample format from Openai Docs messages=[ { "role": "user", "content": [ {"type": "text", "text": "What’s in this image?"}, { "type": "image_url", "image_url": { "url": "https://placehold.co/600x400", }, }, ], } ], is sample must be {"type": "imageurl" , "image_url" : { "url": " "https://placehold.co/600x400"}

but dart_openai generates {"type":"image_url","image_url":"https://placehold.co/600x400"}

so OpenAI api says error Unhandled Exception: RequestFailedException(message: Invalid type for 'messages[2].content[1].image_url': expected an object, but got a string instead., statusCode: 400

dart_openai version is 5.1.0

[kobotis]

// ignore_for_file: public_member_api_docs, sort_constructors_first
/// {@template openai_chat_completion_choice_message_content_item_model}
/// This represents the content item of the [OpenAIChatCompletionChoiceMessageModel] model of the OpenAI API, which is used in the [OpenAIChat] methods.
/// {@endtemplate}
class OpenAIChatCompletionChoiceMessageContentItemModel {
  /// The type of the content item.
  final String type;

  /// The text content of the item.
  final String? text;

  /// The image url content of the item.
  final Map<String, String>? imageUrl;

  @override
  int get hashCode => type.hashCode ^ text.hashCode ^ imageUrl.hashCode;

  /// {@macro openai_chat_completion_choice_message_content_item_model}
  OpenAIChatCompletionChoiceMessageContentItemModel._({
    required this.type,
    this.text,
    this.imageUrl,
  });

  /// This is used to convert a [Map<String, dynamic>] object to a [OpenAIChatCompletionChoiceMessageContentItemModel] object.
  factory OpenAIChatCompletionChoiceMessageContentItemModel.fromMap(
    Map<String, dynamic> asMap,
  ) {
    return OpenAIChatCompletionChoiceMessageContentItemModel._(
      type: asMap['type'],
      text: asMap['text'],
      imageUrl: asMap['image_url'] != null ? {"url": asMap['image_url']} : null,
    );
  }

  /// Represents a text content item factory, which is used to create a text [OpenAIChatCompletionChoiceMessageContentItemModel].
  factory OpenAIChatCompletionChoiceMessageContentItemModel.text(String text) {
    return OpenAIChatCompletionChoiceMessageContentItemModel._(
      type: 'text',
      text: text,
    );
  }

  /// Represents a image content item factory, which is used to create a image [OpenAIChatCompletionChoiceMessageContentItemModel].
  factory OpenAIChatCompletionChoiceMessageContentItemModel.imageUrl(
    String imageUrl,
  ) {
    return OpenAIChatCompletionChoiceMessageContentItemModel._(
      type: 'image_url',
      imageUrl: {"url": imageUrl},
    );
  }

  /// This method used to convert the [OpenAIChatCompletionChoiceMessageContentItemModel] to a [Map<String, dynamic>] object.
  Map<String, dynamic> toMap() {
    return {
      "type": type,
      if (text != null) "text": text,
      if (imageUrl != null) "image_url": imageUrl,
    };
  }

  @override
  bool operator ==(
    covariant OpenAIChatCompletionChoiceMessageContentItemModel other,
  ) {
    if (identical(this, other)) return true;

    return other.type == type &&
        other.text == text &&
        other.imageUrl == imageUrl;
  }

  @override
  String toString() => switch (type) {
        'text' =>
          'OpenAIChatCompletionChoiceMessageContentItemModel(type: $type, text: $text)',
        'image_url' =>
          'OpenAIChatCompletionChoiceMessageContentItemModel(type: $type, imageUrl: $imageUrl)',
        _ => 'OpenAIChatCompletionChoiceMessageContentItemModel(type: $type)',
      };
}

i changed \lib\src\core\models\chat\sub_models\choices\sub_models\sub_models\content.dart and it works

[hfranco346]

Any update under this issue?

[reedmi]

The latest version 5.1.0 still has this issue. When is the next version expected to be updated?

https://pub.dev/packages/dart_openai/versions

[aiviapp]

I have met this issue when I use model 'gpt-4o'.

[razyalov]

any update on this issue? Seems like the changes from pr 166 didn't make it to the released version

[untitledappseu]

please @anasfik release this to pub.dev

[untitledappseu]

For anyone needing encountering this problem, the temporary fix is to fork the package and then apply this fix Link. Has to be done sadly.

[missionnowin]

For anyone needing encountering this problem, the temporary fix is to use to "gpt-4-vision-preview". Using that model it works for me.

This temprorary fix now not working for anyone who intersted in it. It return error 404 and error message "The model gpt-4-vision-preview has been deprecated, learn more here: https://platform.openai.com/docs/deprecations"

[untitledappseu]

For anyone needing encountering this problem, the temporary fix is to use to "gpt-4-vision-preview". Using that model it works for me.

This temprorary fix now not working for anyone who intersted in it. It return error 404 and error message "The model gpt-4-vision-preview has been deprecated, learn more here: https://platform.openai.com/docs/deprecations"

Updated my reply

[bhavika-mamtora]

Is there any solution for this issue ?

[franboladoruiz]

I migrated to https://pub.dev/packages/openai_dart

[novalain]

How is this not fixed yet, the fix is simple? Also they deprecated the working model gpt-4-vision-preview so now there is no workaround. Will migrate to the package mentioned above

[anasfik]

Thanks to the community and you.

Resolved a while ago, please update to latest versions.