KtorHuggingFaceGenerationApi

class KtorHuggingFaceGenerationApi(val httpClient: HttpClient, val apiBaseUrl: String, val inferenceBaseUrl: String, val json: Json = defaultNetworkJson) : HuggingFaceGenerationApi(source)

Ktor implementation of Hugging Face generation requests with counted inference traffic.

Dmitriy Moroz

httpClient

Configured Ktor client used to send provider requests.

apiBaseUrl

Hugging Face API base URL used for model validation.

inferenceBaseUrl

Hugging Face inference base URL used for generation requests.

json

JSON codec used for counted request/response payloads.

Constructors

constructor(httpClient: HttpClient, apiBaseUrl: String, inferenceBaseUrl: String, json: Json = defaultNetworkJson)

constructor(apiBaseUrl: String, inferenceBaseUrl: String)

private object Companion

Exposes the apiBaseUrl value used by the SDAI network layer.

private val httpClient: HttpClient

Exposes the httpClient value used by the SDAI network layer.

Exposes the inferenceBaseUrl value used by the SDAI network layer.

private val json: Json

Exposes the json value used by the SDAI network layer.

open suspend override fun generate(apiKey: String, model: String, request: HuggingFaceGenerationRequest): ByteArray

Executes the generate step in the SDAI network layer.

private suspend fun <T> retryServiceUnavailable(block: suspend () -> T): T

open suspend override fun validateBearerToken(apiKey: String)

Executes the validateBearerToken step in the SDAI network layer.