Skip to main content

Model Information

We will just need a few more details...

Batch Size​

Expected Format​

Format should be an integer. If the model uses a variable batch size, input a negative number for the maximum batch size (e.g., -4 for a variable batch size with a maximum of 4).

A few examples are shown below:

-16     # Batch size can be anywhere between 1 to 16
1 # Batch size is fixed at 1

⚠️ Warning: Fixed batch sizes greater than 1 are not supported.
Please ensure your batch size is either 1 or a negative number (e.g., -2 for dynamic batching).

Input & Output Size​

Refers to the shape of input/output data of the uploaded model.

Expected Format​

Format should be comma-delimited integers. Use negative integers for variable dimensions (e.g., -5000 for a Wav2Vec2 model with a max input length of 5000).

A few exmaples are shown below:

8,8        # Fixed 2D shape of size 8 each
-16,32 # 2D shape, 1st dimension is variable (max. 16), 2nd dimension is fixed size of 16
-5000,32 # for a Wav2Vec2 model with variable output length and 32 classification options

Input & Output Type​

Refers to the expected data type for input and/or output of the uploaded model.

Expected Format​

Please select from the dropdown to select the expected data type. If the data type is not found in the dropdown, please contact us to assist you.