Gain valuable information with web crawling
Innovative web crawling technologies can be used to automatically collect data from the Internet. The majority of this collected data usually brings only a small gain in knowledge at the beginning. However, in combination with expertise and know-how on the individual business context, high-quality information can be obtained from data and, in turn, value-adding insights can be gained
To extract data from the web, Wunderlich Analytics works together with the Datenbutler, one of the leading German experts in web crawling. Behind the brand Datenbutler is the company mindUp from Konstanz, Germany, which offers services in the areas of web analysis, machine learning and artificial intelligence and has been successfully represented on the market for 20 years.
In a joint project for lead management, Wunderlich Analytics and mindUp have successfully analysed data from business online platforms and obtained meaningful information from it. The focus of interest was on contact data of small and medium-sized companies that are now presenting themselves and their companies on the web. These "start-ups" were selected because the target product is particularly suitable and valuable for their business model and for this point in time.
Using Datenbutler's technology, the companies' address data is read from the respective imprint by means of web crawling and further additional information is extracted from the web content, such as opening hours and product categories, or keywords are searched for selected industries. On this basis Wunderlich Analytics then carries out environment analyses. This allows, among other things, to determine how many restaurants are located in the vicinity of a company headquarters and whether there is a high proportion of retail outlets in the immediate vicinity. This data can be used to create scoring models for evaluating lead affinity, but also for competitive analyses as well as assessments of a company's reach or customer potential. Wunderlich Analytics checks the collected data and applies data refinements through the following steps:
- Configuration of the web crawling search with professional know-how
- Segmentation of the companies according to target groups
- Development of meaningful scores
In the present project, the knowledge gained was used for lead qualification in the B2B environment. Scores are developed from the data, which provide information on duplicate cleansing or affinity for the provider's products. This results in the following possible applications:
- Development of efficient marketing and sales strategies
- Addressing the right people interested in the products
- Enrichment of data of an existing customer base in B2B business
Data privacy plays a very important role in web crawling. Only data that is publicly available on the Internet is collected - websites that contradict a use and have their contents marked accordingly are not included. Personal data is also not collected, even if it were available. The collection of data and its refinement thus fully complies with the requirements of the European General Data Protection Regulation (EU-DSGVO).
Are you looking for new sales strategies and the right prospects for your products? Web crawling and data refinement can provide you with significant support and make you even more successful!
Back to news overview
