Class: RubyLLM::Providers::GPUStack

Inherits:
OpenAI show all
Includes:
Chat, Media, Models
Defined in:
lib/ruby_llm/providers/gpustack.rb,
lib/ruby_llm/providers/gpustack/chat.rb,
lib/ruby_llm/providers/gpustack/media.rb,
lib/ruby_llm/providers/gpustack/models.rb,
lib/ruby_llm/providers/gpustack/capabilities.rb

Overview

GPUStack API integration based on Ollama.

Defined Under Namespace

Modules: Capabilities, Chat, Media, Models

Constant Summary

Constants included from OpenAI::Tools

OpenAI::Tools::EMPTY_PARAMETERS_SCHEMA

Instance Attribute Summary

Attributes inherited from RubyLLM::Provider

#config, #connection

Class Method Summary collapse

Instance Method Summary collapse

Methods included from Media

format_content, format_image

Methods included from OpenAI::Media

format_audio, format_content, format_image, format_pdf, format_text, format_text_file

Methods included from Models

build_capabilities, build_modalities, determine_model_type, models_url, parse_list_models_response

Methods included from Chat

format_messages, format_role

Methods inherited from OpenAI

#maybe_normalize_temperature

Methods included from OpenAI::Transcription

encode_speaker_references, parse_transcription_response, render_transcription_payload, response_format_for, supports_chunking_strategy?, transcription_url

Methods included from OpenAI::Images

images_url, parse_image_response, render_image_payload

Methods included from OpenAI::Tools

build_tool_choice, extract_tool_call_thought_signature, format_tool_calls, param_schema, parameters_schema_for, parse_tool_call_arguments, parse_tool_calls, schema_from_parameters, tool_for

Methods included from OpenAI::Streaming

build_chunk, parse_streaming_error, stream_url

Methods included from OpenAI::Moderation

moderation_url, parse_moderation_response, render_moderation_payload

Methods included from OpenAI::Models

models_url, parse_list_models_response

Methods included from OpenAI::Embeddings

embedding_url, parse_embedding_response, render_embedding_payload

Methods included from OpenAI::Chat

#completion_url, extract_content_and_thinking, extract_text_from_blocks, extract_think_tag_content, extract_thinking_from_blocks, extract_thinking_signature, extract_thinking_text, extract_thinking_text_from_block, format_messages, format_role, format_thinking, parse_completion_response, render_payload, resolve_effort

Methods inherited from RubyLLM::Provider

assume_models_exist?, #assume_models_exist?, #capabilities, #complete, #configuration_requirements, #configured?, configured?, configured_providers, configured_remote_providers, #embed, for, #format_messages, #format_tool_calls, #initialize, #list_models, #local?, local_providers, #moderate, #name, name, #paint, #parse_error, #parse_tool_calls, providers, register, remote?, #remote?, remote_providers, resolve, slug, #slug, #transcribe

Methods included from Streaming

build_on_data_handler, build_stream_error_response, error_chunk?, faraday_1?, handle_data, handle_error_chunk, handle_error_event, handle_failed_response, handle_json_error_chunk, handle_parsed_error, handle_sse, handle_stream, json_error_payload?, parse_error_from_json, parse_streaming_error, process_stream_chunk, stream_response

Constructor Details

This class inherits a constructor from RubyLLM::Provider

Class Method Details

.capabilities ⇒ Object 



36
37
38
 
# File 'lib/ruby_llm/providers/gpustack.rb', line 36

def capabilities
  GPUStack::Capabilities
end

.configuration_options ⇒ Object 



24
25
26
 
# File 'lib/ruby_llm/providers/gpustack.rb', line 24

def configuration_options
  %i[gpustack_api_base gpustack_api_key]
end

.configuration_requirements ⇒ Object 



32
33
34
 
# File 'lib/ruby_llm/providers/gpustack.rb', line 32

def configuration_requirements
  %i[gpustack_api_base]
end

.local? ⇒ Boolean

Returns:

  • (Boolean) 


28
29
30
 
# File 'lib/ruby_llm/providers/gpustack.rb', line 28

def local?
  true
end

Instance Method Details

#api_base ⇒ Object 



11
12
13
 
# File 'lib/ruby_llm/providers/gpustack.rb', line 11

def api_base
  @config.gpustack_api_base
end

#headers ⇒ Object 



15
16
17
18
19
20
21
 
# File 'lib/ruby_llm/providers/gpustack.rb', line 15

def headers
  return {} unless @config.gpustack_api_key

  {
    'Authorization' => "Bearer #{@config.gpustack_api_key}"
  }
end