Model
GGUF.Model
— TypeGGUF.open
— Functionopen(file::String)
Opens a GGUF model file and returns a Model
object.
GGUF.tensorn
— FunctionReturns the number of tensors in the model.
GGUF.tensors
— Functiontensors(m::Model)
Returns the Tensors for the given model.
GGUF.tensorsinfo
— Functiontensorsinfo(m::Model)
Returns the tensor information for the given model.
GGUF.metadatan
— FunctionReturns the number of metadata entries in the model.
GGUF.metadata
— Functionmetadata(m::Model)
Returns the metadata of the given model.
The metadata is a dictionary with the keys being the metadata keys and the values being the metadata values.
The metadata values can be of the following types:
- UInt8
- UInt16
- UInt32
- UInt64
- Int8
- Int16
- Int32
- Int64
- Float32
- Float64
- Bool
- String
- Array of the above types
Types are defined in the MetadataValueType
enum.
GGUF.MetadataValueType
— TypeRepresents the type of a metadata value.
See metadata
for more information.
GGUF.version
— FunctionReturns the version of the model.
GGUF.magic
— FunctionReturns the magic number of the model.