Hi @MArkWilliams,
I am currently undertaking an internship and need specific bulk data for my research. I am looking for datasets related to women entrepreneurs and women holding leadership positions in the tech industry within the West Midlands. This data is essential for analyzing the representation and impact of women in these areas. Could you please provide guidance on how I can obtain the data? I would appreciate it if anyone could share the dataset that I mentioned above.
I would suggest using two of the bulk data products provided by companies house: companies csv and persons with significant control json files. They are both free.
You’ll need a tool to analyse and filter them, eg load them into a database/search engine or find a command line tool that works directly with the source file. Apache Spark would work.
Filter the companies CSV by SIC codes contains relevant tech industry codes (exact codes depends on what you define as “tech industry”). Also filter the CSV by registered office address in the West Midlands (you could base that on post code for example).
For the resulting list of companies, find all entries in the persons with significant control JSON file to get a list of people. This file also contains what nature of control they have, such as are they an owner of shares.
Male/female is not provided by companies house in that file, but you might be able to estimate it using open source tools based on title and first name possibly combined with nationality.
For the first step of filtering the companies by sic code and location, you could do this yourself as described or use a pre-existing tool such as one I’ve made called https://companiesware.house which would allow you to export a XLSX file of matching companies and directors.
I have a full copy of the Company House, and can give an access to the BI interface of it for free.
You will able to do all researches yourself.
Let me know, I’ll share the link