Is It Possible to Retrieve More Than 10,000 Records from the advanced search API?

[gentushnik]

Good day,

We want to use the Company House API to obtain information about dissolved companies through advanced search for a given day, once a day. However, we encounter a problem on days when there are more than 10,000 records. Due to the API’s limit, we cannot retrieve all the data.

Could you please advise on a solution to handle this limitation?

Thank you.

[voracityemail]

As far as I know it’s not possible to retrieve results beyond a certain limit and that’s by design. See e.g. these threads:

/advanced-search/companies responds with 500 after 10000 items

Hey folks! thanks for the great service and API! we’re trying to get a local copy of the UK companies by crawling the items from the advanced-search/companies endpoint, 5000 per page with something similar to: https --auth MY_KEY: https://api.company-information.service.gov.uk/advanced-search/companies start_index==10000 size==5000 e.g. https://capture.dropbox.com/qWEOsW4RepiyhA6w?src=ss but the 3rd page always returns 500 Internal Server Error we’re using a live api key can you guide me…

Need to Page through advanced-search/companies, but fails after start_index 10000

I’ve been trying to figure out a good way to page through all company numbers. Best option I see is to use the Advance Search API. However it seems to throw an error after start_index reaches 10000. Is this expected behavior? or is this an error? command curl -u 801932d9-9bdc-4428-b413-61ef40f0e791: https://api.company-information.service.gov.uk/advanced-search/companies?start_index=10000&size=1 result {"timestamp":"2023-09-22T22:08:47.822+00:00","status":500,"error":"Internal Server Error"…

There may be other ways to do this e.g. you could perhaps use the streaming API and record when companies are dissolved. Or get this via the bulk data:

No dissolved companies in live data?

The description for the company data product notes that it contains the status of a company “such as ‘live’ or ‘dissolved’” but the bulk download does not actually report any dissolved companies. Dissolved companies in a given month do appear in the advanced search, but why are these not included in the bulk download? Can this information be included in the monthly snapshot? [Screenshot 2023-05-02 at 13.11.01]