Model Information
We will just need a few more details...
Batch Size
Expected Format
Format should be an integer. If the model uses a variable batch size, input a negative number for the maximum batch size (e.g., -4 for a variable batch size with a maximum of 4).
A few examples are shown below:
-16 # Batch size can be anywhere between 1 to 16
1 # Batch size is fixed at 1
⚠️ Warning: Fixed batch sizes greater than 1 are not supported.
Please ensure your batch size is either1
or a negative number (e.g.,-2
for dynamic batching).
Input & Output Size
Refers to the shape of input/output data of the uploaded model.
Expected Format
Format should be comma-delimited integers. Use negative integers for variable dimensions (e.g., -5000
for a Wav2Vec2 model with a max input length of 5000).
A few exmaples are shown below:
8,8 # Fixed 2D shape of size 8 each
-16,32 # 2D shape, 1st dimension is variable (max. 16), 2nd dimension is fixed size of 16
-5000,32 # for a Wav2Vec2 model with variable output length and 32 classification options
Input & Output Type
Refers to the expected data type for input and/or output of the uploaded model.
Expected Format
Please select from the dropdown to select the expected data type. If the data type is not found in the dropdown, please contact us to assist you.