Class: RubyLLM::Providers::GPUStack

Inherits:
OpenAI show all
Includes:
Chat, Media, Models
Defined in:
lib/ruby_llm/providers/gpustack.rb,
lib/ruby_llm/providers/gpustack/chat.rb,
lib/ruby_llm/providers/gpustack/media.rb,
lib/ruby_llm/providers/gpustack/models.rb

Overview

GPUStack API integration based on Ollama.

Defined Under Namespace

Modules: Chat, Media, Models

Constant Summary

Constants included from OpenAI::Tools

OpenAI::Tools::EMPTY_PARAMETERS_SCHEMA

Instance Attribute Summary

Attributes inherited from RubyLLM::Provider

#config, #connection

Class Method Summary collapse

Instance Method Summary collapse

Methods included from Media

format_content, format_image

Methods included from OpenAI::Media

format_audio, format_content, format_image, format_pdf, format_text, format_text_file

Methods included from Models

models_url, parse_list_models_response

Methods included from Chat

format_messages, format_role

Methods inherited from OpenAI

capabilities, #maybe_normalize_temperature

Methods included from OpenAI::Transcription

encode_speaker_references, parse_transcription_response, render_transcription_payload, response_format_for, supports_chunking_strategy?, transcription_url

Methods included from OpenAI::Images

images_url, parse_image_response, render_image_payload

Methods included from OpenAI::Tools

format_tool_calls, param_schema, parameters_schema_for, parse_tool_call_arguments, parse_tool_calls, schema_from_parameters, tool_for

Methods included from OpenAI::Streaming

build_chunk, parse_streaming_error, stream_url

Methods included from OpenAI::Moderation

moderation_url, parse_moderation_response, render_moderation_payload

Methods included from OpenAI::Models

models_url, parse_list_models_response

Methods included from OpenAI::Embeddings

embedding_url, parse_embedding_response, render_embedding_payload

Methods included from OpenAI::Chat

#completion_url, format_messages, format_role, parse_completion_response, render_payload

Methods inherited from RubyLLM::Provider

#capabilities, capabilities, #complete, #configuration_requirements, configured?, #configured?, configured_providers, configured_remote_providers, #embed, for, #format_messages, #format_tool_calls, #initialize, #list_models, #local?, local_providers, #moderate, #name, name, #paint, #parse_error, #parse_tool_calls, providers, register, remote?, #remote?, remote_providers, resolve, slug, #slug, #transcribe

Methods included from Streaming

handle_stream, stream_response

Constructor Details

This class inherits a constructor from RubyLLM::Provider

Class Method Details

.configuration_requirements ⇒ Object 



28
29
30
 
# File 'lib/ruby_llm/providers/gpustack.rb', line 28

def configuration_requirements
  i[gpustack_api_base]
end

.local? ⇒ Boolean

Returns:

  • (Boolean) 


24
25
26
 
# File 'lib/ruby_llm/providers/gpustack.rb', line 24

def local?
  true
end

Instance Method Details

#api_base ⇒ Object 



11
12
13
 
# File 'lib/ruby_llm/providers/gpustack.rb', line 11

def api_base
  @config.gpustack_api_base
end

#headers ⇒ Object 



15
16
17
18
19
20
21
 
# File 'lib/ruby_llm/providers/gpustack.rb', line 15

def headers
  return {} unless @config.gpustack_api_key

  {
    'Authorization' => "Bearer #{@config.gpustack_api_key}"
  }
end