Building web scraper or doing marketing research you face a problem of obtaining domain lists for crawling. We collected and update them regularly for one of our projects and are happy to share. gTLD, ccTLD, and newgTLDs, everything in one place.
According to Q2 2016 Domain Name Industry Brief, today approximately 344MM domain names registered worldwide in ccTLD, gTLD, and newGTLD zones. We have about 90% domains in our registered domains dataset.
0
