Apache Atlas incorrect results caused by bad pagination/offset

[#1]

Hi, I am running this query in Apache Atlas, but sometimes the results are incorrect. When it returns the second page of results it repeat some of the results from the previous page but the total number of structures yielded are correct. For example: there are 15.000 structures that fit the query, the first page recovers 10.000 structures, the second recovers 5.000. but sometimes that 5000 structures are repeated from the first page.

The query:

{

    "excludeDeletedEntities": true,

    "includeSubClassifications": true,

    "includeSubTypes": true,

    "includeClassificationAttributes": true,

    "entityFilters": {

        "condition": "AND",

        "criterion": [

            {

                "attributeName": "qualifiedName",

                "operator": "STARTSWITH",

                "attributeValue": "nameOfDatabase."

            },

            {

                "attributeName": "__isIncomplete",

                "operator": "eq",

                "attributeValue": "0"

            }

        ]

    },

    "tagFilters": null,

    "attributes": [

        "name",

        "position",

        "type",

        "typeName"

    ],

    "limit": 10000,

    "offset": 0,

    "typeName": "hive_column",

    "classification": null,

    "termName": null

}

the URL: atlasURI/api/atlas/v2/search/basic

[#2]

@atlas-question, Welcome to our community! To help you get the best possible answer, I have tagged our Atlas experts @xsmehul @Maggycloudera  who may be able to assist you further.

Please feel free to provide any additional information or details about your query, and we hope that you will find a satisfactory solution to your question.