Ability to Crawl and Extract Data from Very Complex Websites

• Having a very complex page navigation structure
• Having a complex JavaScript menu and/or paging implementation
• Having strong anti-bot protection (sites that do not want to be crawled) – for example, Amazon
• Capturing multiple product variations shown on the same product page
• Having huge amounts of products
• Requiring browser interaction before scraping data

Crawl Size/Location

• We can crawl websites in any language and in any country
• Crawling entire website or crawling only specific product categories or brands (e.g. it doesn’t make much sense to crawl the whole of Amazon. However, crawling several specific product categories on Amazon can be done)
• Web Crawling websites that are location-sensitive (showing different results depending on the visitor’s IP address and ZIP code) (e.g. Amazon.com will show different results depending on whether you are an international or US visitor. This applies to other Amazon websites)

• Large (more than 10 000 000 product pages) or small (less than 1000 product pages) – it is up to you
• Web crawling and web scraping content in any language and script (Latin, Arabic, Chinese, Cyrillic, etc.)

Data Extraction Results

• We have the ability to capture data fields that are not shown on the product page itself 

(e.g. fields shown on the category page, shown before reaching the product page)

• Extraction results can be delivered in a list (Excel, CSV, XML). Let us know if you need a custom format
• Extraction results can be run against automated translation services (so you get results in your preferred language)
• Data can be stored either on your or on our server, or even on cloud storage
• The default format is CSV – easy for data processing on your side

One-off or Repetitive

• Price2Spy’s Product Extraction service can be used as a one-off data source, or as a repetitive process
• If you go for a repetitive crawl/extraction, you will be able to determine the recrawl frequency

Product Matching

• Products that have been extracted can be matched (automatically or manually) to your own products

Data Privacy

• Data crawled for you will be shared with no other clients

Customizability

• You are welcome to define specific rules on what needs to be scraped 

(e.g. combining data from Category Page and data from the product page into a single result set)

Online Retailers

• Extracting complete competitor’s assortment (to be used as a data source for adding new products on own store)
• Extracting delta’s in competitor’s assortment
• Knowing which products have been added to a competitor’s website
• Knowing which products have been discontinued by your competitor

Brands & Distributors

• Extracting product reviews from retail websites, in order to determine consumer sentiment towards the product (this service is sometimes combined with automated review translation)
• Extracting newly released products from competitor brands
• Data science – providing product (or user review) data for in-house data science projects. Data can be provided in the original language, or machine-translated

Marketing Agencies

• Extracting products from eCommerce sites (online stores) on behalf of its clients
• Extracting products and reviews from Review websites (e.g. Capterra, G2)
• Data science – providing product (or user review) data for data science projects performed on behalf of agency clients. Data can be provided in the original language or machine-translate