Best Web Datasets, Databases & APIs

What is Web Data?

Web data comprises information about users' online habits and preferences as well as analytics about a website or app's online performance. Marketers use this to accurately tailor advertising campaigns to consumers. Datarade helps you find the best web datasets.Learn more

50+ Results

ShipsDNA: Global Maritime Companies Data (including company IMO, full name, address, email, phone, website)

by ShipsDNA
Our database include various company types - ship-breakers, owners, commercial managers, technical managers, operators, financial institutes, government entities etc. Full contact details and co...
Available for 249 countries
20K maritime companies data
2 years of historical data
97% accuracy
Starts at
$5,000 / purchase
10% Datarade discount
Free sample available
10% revenue share

China - 🏢 B2B Firmographic data and Corporate websites - Chinese companies

by Octobot
prospects in China or realize market study with this dataset of corporate websites and firmographic data ... All our data is updated regularly and includes only active companies, allowing you to reach the most
Available for 1 countries
Starts at
$30 / purchase

GaiaLens News Data: real-time (refreshed daily), covers c.17,000 global publicly traded companies, tracks 50 ESG themes

by GaiaLens
We can offer the news data in two formats: 1) News flow: all news flow for our company coverage including
Available for 91 countries
17K companies
10 years of historical data
100% population
Starts at
$1,000 / purchase
Free sample preview
Free sample available
Start icon4.9(2)

Factori Web Data | Global web browsing & activity data feed (4.2 Billion records)

by Factori
This data can be used to analyze web behaviour across the web and build highly accurate audience segments ... We offer web activity data of users that are browsing popular websites around the world.
Available for 247 countries
4.2B Web Data Records
1 years of historical data
Starts at
$4,000 / month
Free sample available

All-in-one SEO platform: Keyword reseacrh, Rank tracker, Website analysis, Site audit, Ads (PPC) research and Backlink analysis

by Serpstat
clear and convenient reports for colleagues and clients from ready-made blocks containing Serpstat data ... Combine any data from different modules in one report Customize the visual display of reports according
Available for 240 countries
Pricing available upon request
Free sample available
Start icon5.0(1)

Bright Data | SERP API - Structured SERP Data

by Bright Data
Gather SERP data from any location, while saving money on data extraction engineers and IT professionals ... Bright Data can support your growing traffic needs and peak periods.
Available for 249 countries
Starts at
$500 / month
revenue share

Web URL data, 1st party, can be tied to PII profile

by Reklaim
This provides full URL but also some purchase-based data and not just the URL. ... We do not break out the countries, nor do we break out the purchase from the rest of the URL data.
Available for 2 countries
500K events per day
2 years of historical data
Starts at
$12,000 / year
Free sample preview
Free sample available

Top-10 CMS websites with contacts

by Netlas.io
Collected data is enriched with additional info and available in Netlas.io Search Engine. ... intelligence apps that provide accurate technical information on IP addresses, domain names, websites, web
Available for 249 countries
19.6M URLs
Pricing available upon request
Free sample available

Oxylabs SERP Data Platform - get structured results from search engines

by Oxylabs
Extract data from most websites without getting blocked. Proxy rotator for block management. ... Real-Time Crawler search engine API provides parsed data for: Organic Popular products Paid
Available for 249 countries
100% Success rate
Starts at
$99 / month
Free sample available

Dexi | Automated Digital Data Capture and Web Automation | Data Mining | SaaS | DaaS

by Dexi.io
Most advanced technology: Dexi.io is the leader on the web data acquisition solutions’ market: our data ... Whether you’re after a SaaS solution for your web data mining projects or prefer to leave it all to us
Available for 249 countries
100% Data Quality and Completeness
Available Pricing:
One-off purchase
Yearly License
Free sample available
datarade.ai - Dexi.io profile banner
Dexi.io
Based in United Kingdom
Dexi.io
Dexi provides cutting-edge data solutions that power the success of Planet Earth’s most successful brands and organizations. A robust, service-forward, and s...
High
Data Accuracy
10 Billion
Webpages Harvested
100%
Project Customization
datarade.ai - Accern profile banner
Accern
Based in USA
Accern
Researchers, business analysts, data science teams, and developers use Accern to build and deploy finance specific AI use cases powered by adaptive NLP. Alli...
datarade.ai - Oxylabs profile banner
Oxylabs
Based in Lithuania
Oxylabs
We are a market-leading proxy and web scraping solution service for large-scale public data gathering, driven by high business standards and innovations.
102M+ IPs
Around the globe
AI/ML
Powered solution
Patented
Proxy rotation
datarade.ai - Wersel Brand Analytics profile banner
Wersel Brand Analytics
Based in United Kingdom
Wersel Brand Analytics
Wersel Data-Hub is a powerful brand collaborative and analytics platform. It can access brands scattered data from every channel, collect and normalize it. T...
Data Integration
Data Visualization
Powerful Hosted Search
datarade.ai - Datastream Group profile banner
Datastream Group
Based in USA
Datastream Group
Our Dedicated team is ready to create an innovative data solution that is tuned to your business needs.
Scale
large quantities
Accurate
constantly updated & verified
250M +
Full consumer profiles
datarade.ai - Factori profile banner
Factori
Based in USA
Factori
Factori is a flexible and adaptable data provider. We help you make smarter decisions and build better solutions based on real world location data.
5.2 B
Event per Day
1.6 B
Consumer Profiles
7000+
Brands Tracked

The Ultimate Guide to Web Data 2022

Learn about web data analytics, sources, and collection.

What is Web Data?

Web data is an incredibly broad term. It encompasses a wide range of information which is collected from websites and apps about different users’ browsing habits, online behaviors and preferences. It can also include information about the consumer themselves, such as their details, search and purchase intent or online interests.

How is Web Data collected?

Web data is collected through first and third-party sources which is then combined together by web providers to create accurate web datasets and online consumer profiles.

First-party data - Internal data sources are ways of collecting data that comes from the site you are visiting itself. This included trackers like cookies and website or app analytics. Normally, these sources tell you information such as how long a user spent on the website, which pages they clicked through on the same domain and personal details such as the user’s IP address or location.

Third-party data - External sources of web data collect information about a user as they browse different pages to track their preferences and interests. Third-party data collecters collect details about a user’s online habits to create an accurate consumer profile.

Information from these two data sources is used together to populate the contents of a web dataset.

What are the attributes of Web Data?

Typically, a web dataset will contain various different data points about people’s online habits and preferences. This can be broken down into different types of information including:

Personal user information - This normally includes information about the users themselves, such as their IP address or mobile device ID, but has can also provide more detailed intelligence such as their age bracket, ethnicity and gender.

Browsing preferences - A web dataset will provide detailed insights into a user’s online preferences. By using a combination of third- and first-party sources, data providers can create an accurate user profile including their interests and online shopping behaviors.

Online intent information - Some web datasets may also provide information about users’ online intent. This can include search intent, purchase intent and online category interests.

Website analytics - web data can also provide information about the traffic to a certain website or app. This can be how many people visited the website over a certain period of time, how long they stayed and whether ultimately they clicked through and purchased anything.

What is Web Data used for?

Typically, web dataset is used by marketers and online advertisers. By tracking different users’ intents and preferences, these companies can accurately tailor their adveritising campaigns to suit people’s personal preference and therefore increase ad revenue and generate profits.

Web data is also sometimes used by researchers in order to conduct market research, such as in order to assess the health of an app or website. By using web data they can see the number of visitors to the website and evaluate its performance in comparison to other similar sites.

How can a user assess the quality of Web Data?

The highest quality web datasets will be regularly updated with real-time analytics and website or app visitor information. They will also provide accruate key details about users and their online habits and preferences so that companies can efficiently use this information in their marketing campaigns.

Always make sure to read the data provider’s reviews before you and and ask for a data sample in advance of purchase to ensure that the web data provided matches your personal needs.

Where can I buy Web Data?

Data providers and vendors listed on Datarade sell Web Data products and samples. Popular Web Data products and datasets available on our platform are ShipsDNA: Global Maritime Companies Data (including company IMO, full name, address, email, phone, website) by ShipsDNA, China - 🏢 B2B Firmographic data and Corporate websites - Chinese companies by Octobot, and GaiaLens News Data: real-time (refreshed daily), covers c.17,000 global publicly traded companies, tracks 50 ESG themes by GaiaLens.

How can I get Web Data?

You can get Web Data via a range of delivery methods - the right one for you depends on your use case. For example, historical Web Data is usually available to download in bulk and delivered using an S3 bucket. On the other hand, if your use case is time-critical, you can buy real-time Web Data APIs, feeds and streams to download the most up-to-date intelligence.

What are similar data types to Web Data?

Web Data is similar to Environmental Data, B2B Data, Energy Data, Real Estate Data, and Geospatial Data. These data categories are commonly used for Machine Learning (ML) and Analytics.

What are the most common use cases for Web Data?

The top use cases for Web Data are Machine Learning (ML), Analytics, and Web Traffic Analytics.