立即解锁 电商+社交 全维度采集

通过同步API实时抓取任意网站数据,支持Amazon/Walmart/Google等20+平台结构化采集与解析,日均处理10亿级请求。

Amazon Walmart Google Twitter Instagram data_scraper.py import requests, pandas from bs4 import BeautifulSoup def scrape_data (url, selector): response = requests.get(url) soup = BeautifulSoup(response.text, 'html.parser') data = soup.select(selector) return [item.text for item in data] # Extract data from platforms amazon_data = scrape_data( 'https://www.amazon.com/gp/bestsellers/books/' , '.zg-item-immersion') walmart_data = scrape_data( 'https://www.walmart.com/browse/books' , '.shelf-item-tile')

数据抓取示例

数据抓取演示
沃尔玛
亚马逊
推特
TikTok
Google搜索
示例URL:
https://www.walmart.com/search?q=samsung+galaxy
JSON结果
{
  "products": [
    {
      "position": 1,
      "title": "AT&T Samsung Galaxy A14 5G, 64GB Black - Prepaid Smartphone",
      "image": "https://i5.walmartimages.com/seo/AT-T-Samsung-Galaxy-A14-5G-jpeg",
      "link": "https://wrd.walmart.com/track?bt=1&event=T-click&plmt=sp-search-middle-desktop",
      "price": {
        "currentPrice": "$79.88",
        "rawPrice": "79.88",
        "currency": "$"
      },
      "reviewsCount": "274",
      "ratings": "3.7",
      "shippingMessage": "Free pickup todayDelivery todayFree shipping, arrives in 2 days",
      "isBestSeller": false,
      "outOfStock": false
    },
    {
      "position": 2,
      "title": "AT&T Samsung Galaxy A15 5G 128GB Prepaid Smartphone",
      "image": "https://i5.walmartimages.com/seo/AT-T-Samsung-Galaxy-A15-5G-jpeg",
      "link": "https://wrd.walmart.com/track?bt=1&event=T-click&plmt=sp-search-middle-desktop",
      "price": {
        "currentPrice": "$89.88",
        "rawPrice": "89.88",
        "currency": "$"
      },
      "reviewsCount": "118",
      "ratings": "4.1",
      "shippingMessage": "Free pickup todayFree shipping, arrives in 2 days",
      "isBestSeller": false,
      "outOfStock": false
    }
  ]
}
示例URL:
https://www.amazon.com/s?k=desk
JSON结果
{
  "products": [
    {
      "position": 1,
      "title": "EUREKA ERGONOMIC Small Computer Desk, 40 inch Home Office Writing Desk, Modern Simple Study PC Laptop Table Workstation for Small Spaces, Black",
      "image": "https://m.media-amazon.com/images/I/71Xk56MJYzL._AC_UL320_.jpg",
      "link": "https://www.amazon.com/EUREKA-ERGONOMIC-Computer-Writing-Workstation/dp/B08PWZCGHN",
      "price": {
        "currentPrice": "$89.99",
        "originalPrice": "$119.99",
        "currency": "$",
        "discountPercentage": "25%"
      },
      "reviewsCount": "2,324",
      "ratings": "4.7",
      "isPrime": true,
      "delivery": "Get it by Tomorrow, Mar 22",
      "isBestSeller": true
    },
    {
      "position": 2,
      "title": "FLEXISPOT EC1 Electric Standing Desk, 48 x 24 Inches Height Adjustable Desk, Electric Sit Stand Desk Home Office Desks Whole-Piece Desk Board (Black Frame + 48 x 24 Mahogany Top)",
      "image": "https://m.media-amazon.com/images/I/71iBHR8pTdL._AC_UL320_.jpg",
      "link": "https://www.amazon.com/FLEXISPOT-Standing-Adjustable-Electric-Mahogany/dp/B09SHBD3KV",
      "price": {
        "currentPrice": "$179.99",
        "originalPrice": "$249.99",
        "currency": "$",
        "discountPercentage": "28%"
      },
      "reviewsCount": "6,117",
      "ratings": "4.5",
      "isPrime": true,
      "delivery": "Get it by Tuesday, Mar 26",
      "isBestSeller": false
    }
  ],
  "pagination": {
    "currentPage": 1,
    "totalPages": 20,
    "totalResults": "10,000+ results"
  }
}
示例URL:
https://x.com/elonmusk
JSON结果
{
  "user": {
    "username": "elonmusk",
    "displayName": "Elon Musk",
    "bio": "49, Executive Chair & CTO of X Corp, President of the Ennui Society",
    "location": "A Shortfall of Gravitas",
    "followers": "191.2M",
    "following": "614",
    "isVerified": true,
    "joinDate": "June 2009",
    "profileImage": "https://pbs.twimg.com/profile_images/1683325380441128960/yRsRRjGO_400x400.jpg"
  },
  "tweets": [
    {
      "id": "1767667781646917913",
      "text": "AI continues to improve rapidly",
      "createdAt": "2024-03-12T19:58:04.000Z",
      "replyCount": 15428,
      "retweetCount": 5245,
      "likeCount": 121893,
      "viewCount": "14.8M",
      "hasMedia": false,
      "isReply": false
    },
    {
      "id": "1767248350328910236",
      "text": "SpaceX Starship Flight 3 was a success! We reached orbital velocity & made it most of the way around Earth.\n\nCongrats to the SpaceX team on an amazing flight test!",
      "createdAt": "2024-03-11T16:11:22.000Z",
      "replyCount": 27316,
      "retweetCount": 25789,
      "likeCount": 384677,
      "viewCount": "38.5M",
      "hasMedia": true,
      "isReply": false,
      "media": [
        {
          "type": "photo",
          "url": "https://pbs.twimg.com/media/GIFKuG-WwAA55k1?format=jpg"
        }
      ]
    }
  ]
}
示例URL:
https://www.tiktok.com/@tiktok
JSON结果
{
  "user": {
    "uniqueId": "tiktok",
    "nickname": "TikTok",
    "signature": "Make your day. Our Community Guidelines: link.tiktok.com/community-guidelines",
    "verified": true,
    "followingCount": 478,
    "followerCount": 71800000,
    "heartCount": 498900000,
    "videoCount": 248,
    "profilePictureUrl": "https://p16-sign-va.tiktokcdn.com/tos-maliva-avt-0068/78ae9d4c40facf47182a9bce5c8be808~c5_720x720.jpg"
  },
  "videos": [
    {
      "id": "7367584993647216942",
      "desc": "Explore creativity on TikTok 💫 #ForYou",
      "createTime": 1708693201,
      "duration": 15,
      "stats": {
        "diggCount": 498732,
        "shareCount": 15783,
        "commentCount": 6427,
        "playCount": 9873215
      },
      "covers": {
        "default": "https://p16-sign-va.tiktokcdn.com/obj/tos-maliva-p-0068/7367584993647216942-default"
      },
      "videoUrl": "https://v16-webapp.tiktok.com/video/tos/useast2a/tos-useast2a-pve-0068/o4IM9rAIXAkuBQfENDACzEAgK/",
      "shareUrl": "https://www.tiktok.com/@tiktok/video/7367584993647216942"
    },
    {
      "id": "7363298746574897453",
      "desc": "Find your community on TikTok ✨ #ForYou",
      "createTime": 1707667892,
      "duration": 12,
      "stats": {
        "diggCount": 389541,
        "shareCount": 12879,
        "commentCount": 5321,
        "playCount": 7623451
      },
      "covers": {
        "default": "https://p16-sign-va.tiktokcdn.com/obj/tos-maliva-p-0068/7363298746574897453-default"
      },
      "videoUrl": "https://v16-webapp.tiktok.com/video/tos/useast2a/tos-useast2a-pve-0068/o8BzEdAJbsDEAfAgEAQlImzAqZ/",
      "shareUrl": "https://www.tiktok.com/@tiktok/video/7363298746574897453"
    }
  ]
}
示例URL:
https://www.google.com/search?q=data+scraping
JSON结果
{
  "search_results": [
    {
      "position": 1,
      "title": "data scraping - Google Search",
      "link": "https://www.google.com/search?q=data+scraping",
      "displayed_link": "www.google.com",
      "snippet": "Web results. Data scraping is the process of extracting information from websites. This information is collected and then exported into a format that is more useful for the user. For example, data could be extracted from a range of e-commerce websites and then compiled into a spreadsheet."
    },
    {
      "position": 2,
      "title": "Web scraping - Wikipedia",
      "link": "https://en.wikipedia.org/wiki/Web_scraping",
      "displayed_link": "en.wikipedia.org",
      "snippet": "Web scraping, web harvesting, or web data extraction is data scraping used for extracting data from websites. The web scraping software may directly access the World Wide Web using the Hypertext Transfer Protocol or a web browser. While web scraping can be done manually by a software user, the term typically refers to automated processes implemented using a bot or web crawler. It is a form of copying, in which specific data is gathered from the Web and copied to a local database or spreadsheet for later retrieval or analysis."
    },
    {
      "position": 3,
      "title": "The Beginner's Guide to Web Scraping - ParseHub",
      "link": "https://www.parsehub.com/blog/web-scraping-for-beginners/",
      "displayed_link": "www.parsehub.com",
      "snippet": "Web scraping is an automated way to extract data from any website. Learn how to scrape data and turn any website into a spreadsheet or API."
    }
  ],
  "organic_results": [
    {
      "position": 1,
      "title": "data scraping - Google Search",
      "link": "https://www.google.com/search?q=data+scraping",
      "displayed_link": "www.google.com",
      "snippet": "Web results. Data scraping is the process of extracting information from websites. This information is collected and then exported into a format that is more useful for the user. For example, data could be extracted from a range of e-commerce websites and then compiled into a spreadsheet."
    },
    {
      "position": 2,
      "title": "Web scraping - Wikipedia",
      "link": "https://en.wikipedia.org/wiki/Web_scraping",
      "displayed_link": "en.wikipedia.org",
      "snippet": "Web scraping, web harvesting, or web data extraction is data scraping used for extracting data from websites. The web scraping software may directly access the World Wide Web using the Hypertext Transfer Protocol or a web browser. While web scraping can be done manually by a software user, the term typically refers to automated processes implemented using a bot or web crawler. It is a form of copying, in which specific data is gathered from the Web and copied to a local database or spreadsheet for later retrieval or analysis."
    },
    {
      "position": 3,
      "title": "The Beginner's Guide to Web Scraping - ParseHub",
      "link": "https://www.parsehub.com/blog/web-scraping-for-beginners/",
      "displayed_link": "www.parsehub.com",
      "snippet": "Web scraping is an automated way to extract data from any website. Learn how to scrape data and turn any website into a spreadsheet or API."
    },
    {
      "position": 4,
      "title": "Data Scraping vs. Web Scraping: What's the Difference?",
      "link": "https://brightdata.com/blog/data-scraping-vs-web-scraping",
      "displayed_link": "brightdata.com",
      "snippet": "While the terms are often used interchangeably, data scraping is a broader term that includes web scraping. Data scraping can involve extracting data from various sources, including databases, APIs, and even physical documents. Web scraping specifically focuses on extracting data from websites."
    }
  ],
  "related_searches": [
    {
      "query": "web scraping tools",
      "link": "https://www.google.com/search?q=web+scraping+tools"
    },
    {
      "query": "best web scraping software",
      "link": "https://www.google.com/search?q=best+web+scraping+software"
    },
    {
      "query": "is web scraping legal",
      "link": "https://www.google.com/search?q=is+web+scraping+legal"
    }
  ]
}

想要实时掌握各平台数据动态?立即解锁完整数据维度:

像真实的浏览器一样呈现您要采集的网页

我们为您管理数万个采用最新版Chrome浏览器的无头实例。您只需专注于发送数据采集请求,而无需费心应对低效的无头浏览器问题。

王思远
王思远
CTO @ 云析科技
"Universal Data Scraping API彻底解决了我们的跨平台数据采集烦恼!营销团队能实时获取竞品动态,工程师也不再被困在无头浏览器升级和维护的泥潭里。"

通过分布式智能代理轮换突破访问限制

基于全球边缘节点网络,集成无头浏览器集群与动态指纹混淆技术,通过毫秒级IP切换和自适应反侦察算法,实现复杂网页的精准实时抓取,突破传统爬虫地域限制与反爬封锁。

李明阳
李明阳
联合创始人@极码科技
"相比自建爬虫和代理池每年数十万的运维成本,使用Universal Data Scraping API让我们实现了: 零封禁风险的稳定数据流; 基于业务场景的智能IP调度策略; 开发周期缩短40%的标准化API接入, 现在团队可以专注于数据价值挖掘而非反爬对抗。"

轻松从全网采集并提取所有类型的数据

告别IP封禁与验证码困扰,通用 Scrape API智能托管方案让商业情报获取像浏览网页一样简单,且严格遵守GDPR等数据合规标准。

智能采集引擎驱动电商/社媒数据革命

毫秒级捕获动态价格/库存/评论,API接入成本直降70%

分布式节点网络

基于边缘节点构建的蜂窝拓扑架构,毫秒级IP切换与地域伪装能力,突破传统爬虫地域限制,目标网站请求成功率高达99.2%。

动态指纹混淆

集成浏览器指纹混淆与流量特征GAN生成技术,实时预测WAF规则并自适应调整请求策略,反爬突破率提升至98.5%。

低代码接入

提供标准化API与图形化任务配置界面,支持电商、社交等多场景,数据直连主流分析平台。

全链路合规

内置GDPR/CCPA合规引擎,实现数据脱敏、访问频率控制与审计追踪,确保数据全周期合法安全,规避法律风险。

价格方案

简单透明的定价策略

随时取消,无需询问!

自由职业者
$39/月
API调用次数
150,000
并发请求数
5
JavaScript渲染支持
轮换及优质代理
地理定位支持
截图、数据提取规则、谷歌搜索API
优先邮件支持
-
专属客户经理
-
团队管理功能
-
初创公司
$79/月
API调用次数
1,000,000
并发请求数
50
JavaScript渲染支持
轮换及优质代理
地理定位支持
截图、数据提取规则、谷歌搜索API
优先邮件支持
专属客户经理
-
团队管理功能
-
企业增强版
$499/月
API调用次数
8,000,000
并发请求数
200
JavaScript渲染支持
轮换及优质代理
地理定位支持
截图、数据提取规则、谷歌搜索API
优先邮件支持
专属客户经理
团队管理功能
All prices are exclusive of VAT.

需要 购买套餐 或每个月更多积分和并发量吗?

今日API成功率
1 %
GDPR合规验证
1 %
平均采集速度
1 S

我们部分优秀的客户

ZIBUYU

中国最大的跨境电商公司之一
访问网站

Apollo

销售情报和参与平台|Apollo
访问网站

Ping Pong

PingPong | 领先的跨境支付平台
访问网站

Sif关键词

Sif官网 | 精准洞察广告与流量秘密
访问网站

紫鸟浏览器

紫鸟浏览器-跨境电商账号安全管理系统
访问网站

立即开始抓取网页数据!

滚动至顶部

立即解锁全球电商数据

提交需求 → 获取专属采集方案+API免费对接测试

我们采用TLS/SSL加密传输,您提交的信息仅用于方案沟通

Unlock website data now!

Submit request → Get a custom solution + Free API test.

We use TLS/SSL encryption, and your submitted information is only used for solution communication.

This website uses cookies to ensure you get the best experience.

联系我们,您的问题,我们随时倾听

无论您在使用 Pangolin 产品的过程中遇到任何问题,或有任何需求与建议,我们都在这里为您提供支持。请填写以下信息,我们的团队将尽快与您联系,确保您获得最佳的产品体验。

Talk to our team

If you encounter any issues while using Pangolin products, please fill out the following information, and our team will contact you as soon as possible to ensure you have the best product experience.