Milvus Create an Index on the Vector

Milvus indexing refers to the process of organizing and structuring the high-dimensional data in a way that enables an efficient similarity search operations.

What Is a Vector in Milvus?

A Milvus vector is a numerical representation of an entity or data point in a high-dimensional space. It is a fundamental concept that is used in similarity search and vector databases.

A vector is represented as an array of numerical values where each value corresponds to an entity’s specific feature or attribute.

Milvus allows you to store efficiently, index, and search the high-dimensional vectors by leveraging the advanced indexing techniques such as the approximate nearest neighbor (ANN) search algorithms to achieve a fast and accurate similarity matching.

Milvus Vector Index

Vector indexes in Milvus work as an organizational unit that organizes the vector metadata to enhance the vector similarity search. Without a vector index, Milvus performs a brute-force search on the specified data upon a search operation.

Let us learn how we can create a vector index to enhance the search operations on a vector.

Prepare the Parameter Index

Unlike a scalar index, we need to specify the index parameters for vector indexes. The following are the supported parameters for a vector index in Milvus.

1. Metric_type – This parameter specifies the metric that is used to determine the similarity of vectors. The supported values include:
   1. L2 – Euclidean Distance
   2. IP – Inner Product
   3. JACCARD – Jaccard Distance
   4. TANIMOTO – Tanimoto Distance
   5. HAMMING – Hamming Distance
   6. SUPERSTRUCTURE – Superstructure distance
   7. SUBSTRUCTURE – Substructure distance.
2. Index_type – This specifies the index type that is used to accelerate the vector search. The accepted values include:
   1. FLAT
   2. IVF_FLAT
   3. IVF_SQ8
   4. IVF_PQ
   5. HNSW
   6. ANNOY
   7. DISKANN*
   8. BIN_FLAT
   9. BIN_IVF_FLAT
3. Params – It specifies the specific parameters for the index.

Create a Vector Index in the Milvus CLI

The following demonstrates how to create a vector index on the film collection using the create index command in the Milvus CLI.

Once you run the previous command, Milvus will prompt the step-by-step process of creating a vector index as shown in the following queries:

The name of the field to create an index for (vector): vector

From the previous prompts and outputs, we create a vector index on the “film” collection on the vector field.

In the previous example, we provide the name of the index as vector_data_index of type IVF_FLAT using the L2 metric.

The resulting output is as follows:

Create a Vector Index in Milvus Using Python

To create a vector index on a Milvus collection in Python, we can use the PyMilvus package and the create_index method.

The code is as follows:

This should set up a similar vector index on the server.

NOTE: Ensure that another vector index does not exist on the target film. If so, Milvus will fail to create the new index and return an error.

Create a Vector Index in Milvus Using cURL

You can also use cURL to create a vector index on a target collection as shown in the following command:

In this case, we use cURL with a POST request to index the endpoint and pass the data of the vector index as JSON data.

Conclusion

We learned how we can use the Milvus CLI, cURL, and Python to create a vector index in simple steps.