Package edu.tufts.hrilab.llm.azure

Class AzureClient

java.lang.Object

edu.tufts.hrilab.llm.azure.AzureClient

All Implemented Interfaces:

LLMClient

public class AzureClient
extends Object
implements LLMClient

Field Summary

Fields

Modifier and Type	Field	Description
String	modelType

Constructor Summary

Constructors

Constructor	Description
AzureClient()

Method Summary

Modifier and Type	Method	Description
Completion	chatCompletion(Chat chat)
Completion	chatCompletion(Chat chat, String model)
Completion	chatCompletion(String userPrompt)
Completion	chatCompletion(String userPrompt, String model)
Completion	chatCompletion(String userPrompt, String model, String systemPrompt)
Completion	chatCompletion(List<Message> messages)
Completion	completion(String userPrompt)
Completion	completion(String userPrompt, String model)
Completion	completion(String userPrompt, String model, String systemPrompt)
LlamaHFChatCompletionResponse	llamaAzureChatCompletion(LlamaAzureCompletionRequestBody requestBody)
LlamaHFChatCompletionResponse	llamaAzureChatCompletion(LlamaAzureCompletionRequestBody requestBody, String model)
void	setEndpoint(String endpoint)
void	setMaxNewTokens(int maxNewTokens)	Sets the max number of tokens included in the response (Not including the provided prompt)
void	setModel(String model)
void	setStopWords(String[] stopWords)
void	setTemperature(float temperatureFloat)	Sets the temperature of the model.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

modelType

public String modelType

Constructor Details

AzureClient

public AzureClient()

Method Details

setEndpoint

public void setEndpoint(String endpoint)

Specified by:

setEndpoint in interface LLMClient

setModel

public void setModel(String model)

Specified by:

setModel in interface LLMClient

setStopWords

public void setStopWords(String[] stopWords)

Specified by:

setStopWords in interface LLMClient

setMaxNewTokens

public void setMaxNewTokens(int maxNewTokens)

Sets the max number of tokens included in the response (Not including the provided prompt)

Parameters:

maxNewTokens - - The number of tokens to set

setTemperature

public void setTemperature(float temperatureFloat)

Sets the temperature of the model.

Specified by:

setTemperature in interface LLMClient

Parameters:

temperatureFloat - - The temperature value to set

completion

public Completion completion(String userPrompt)

Specified by:

completion in interface LLMClient

completion

public Completion completion(String userPrompt,
 String model)

Specified by:

completion in interface LLMClient

completion

public Completion completion(String userPrompt,
 String model,
 String systemPrompt)

Specified by:

completion in interface LLMClient

chatCompletion

public Completion chatCompletion(String userPrompt)

Specified by:

chatCompletion in interface LLMClient

chatCompletion

public Completion chatCompletion(String userPrompt,
 String model)

Specified by:

chatCompletion in interface LLMClient

chatCompletion

public Completion chatCompletion(String userPrompt,
 String model,
 String systemPrompt)

Specified by:

chatCompletion in interface LLMClient

chatCompletion

public Completion chatCompletion(List<Message> messages)

Specified by:

chatCompletion in interface LLMClient

chatCompletion

public Completion chatCompletion(Chat chat)

Specified by:

chatCompletion in interface LLMClient

chatCompletion

public Completion chatCompletion(Chat chat,
 String model)

Specified by:

chatCompletion in interface LLMClient

llamaAzureChatCompletion

public LlamaHFChatCompletionResponse llamaAzureChatCompletion(LlamaAzureCompletionRequestBody requestBody)

llamaAzureChatCompletion

public LlamaHFChatCompletionResponse llamaAzureChatCompletion(LlamaAzureCompletionRequestBody requestBody,
 String model)