[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"project-72395":3},{"id":4,"name":5,"fullName":6,"owner":7,"repo":5,"description":8,"homepage":9,"htmlUrl":10,"language":11,"languages":10,"totalLinesOfCode":10,"stars":12,"forks":13,"watchers":14,"openIssues":15,"contributorsCount":16,"subscribersCount":16,"size":16,"stars1d":16,"stars7d":16,"stars30d":17,"stars90d":16,"forks30d":16,"starsTrendScore":16,"compositeScore":18,"rankGlobal":10,"rankLanguage":10,"license":10,"archived":19,"fork":19,"defaultBranch":20,"hasWiki":19,"hasPages":19,"topics":21,"createdAt":10,"pushedAt":10,"updatedAt":33,"readmeContent":34,"aiSummary":35,"trendingCount":16,"starSnapshotCount":16,"syncStatus":36,"lastSyncTime":37,"discoverSource":38},72395,"google-news-scraper","oxylabs\u002Fgoogle-news-scraper","oxylabs","Use Google News Scraper API to obtain the latest global news for your project, including a wide range of sources, headlines, URLs, and publication dates from the Google News platform.","https:\u002F\u002Foxylabs.io\u002Fproducts\u002Fscraper-api\u002Fserp\u002Fgoogle?utm_source=877&utm_medium=affiliate&groupid=877&utm_content=google-news-scraper-github&transaction_id=102c8d36f7f0d0e5797b8f26152160",null,"Python",2957,25,20,5,0,123,26.24,false,"main",[22,23,24,25,26,5,27,28,29,30,31,32],"api-for-google-news","api-google-news","api-stock-news","free-google-news-api","google-news-api","google-scraper","google-scraper-api","google-search-scraper","news-scraper","news-scraper-api","scraper-api","2026-06-12 02:03:02","# Scraping Google News\n\n[![Oxylabs promo code](https:\u002F\u002Fraw.githubusercontent.com\u002Foxylabs\u002Fgoogle-news-scraper\u002Frefs\u002Fheads\u002Fmain\u002FScrape%20Google%20data%20with%20Web%20Scraper%20API.png)](https:\u002F\u002Foxylabs.io\u002Fproducts\u002Fscraper-api\u002Fserp\u002Fgoogle?utm_source=877&utm_medium=affiliate&groupid=877&utm_content=google-news-scraper-github&transaction_id=102c8d36f7f0d0e5797b8f26152160)\n\n[![](https:\u002F\u002Fdcbadge.limes.pink\u002Fapi\u002Fserver\u002FPds3gBmKMH?style=for-the-badge&theme=discord)](https:\u002F\u002Fdiscord.gg\u002FPds3gBmKMH) [![YouTube](https:\u002F\u002Fimg.shields.io\u002Fbadge\u002FYouTube-Oxylabs-red?style=for-the-badge&logo=youtube&logoColor=white)](https:\u002F\u002Fwww.youtube.com\u002F@oxylabs)\n\n- [Free Google News Scraper](#free-google-news-scraper)\n    + [Prerequisites](#prerequisites)\n    + [Installation](#installation)\n    + [Getting the topic to scrape](#getting-the-topic-to-scrape)\n    + [Scraping](#scraping)\n    + [Notes](#notes)\n- [Oxylabs Google News Scraper API](#oxylabs-google-news-api)\n    + [Request sample](#request-sample)\n\n\n## Free Google News Scraper\n\n### Prerequisites\n\nTo run this tool, you need to have Python 3.11 installed in your system.\n\n### Installation\n\nOpen up a terminal window, navigate to this repository and run this command:\n\n`make install`\n\n### Getting the topic to scrape\n\nThis tool is used to scrape Google News articles based on the topic they're listed in. \n\nFirst of all, open up Google News, and look through the topics listed in the top header of the webpage. \n\n\u003Cimg width=\"1388\" alt=\"image\" src=\"https:\u002F\u002Fgithub.com\u002Foxylabs\u002Fgoogle-news-scraper\u002Fassets\u002F44357929\u002Fc30be402-90cb-41ba-95a4-b2f63cdf5a7f\">\n\nClick on a topic you wish to scrape. \nIn this example we'll be using the `Business` topic. \n\nNext, look at the URL in your browser and copy the string of characters that come after `\u002Ftopics\u002F`, that's your topic ID.\n\n\u003Cimg width=\"831\" alt=\"image\" src=\"https:\u002F\u002Fgithub.com\u002Foxylabs\u002Fgoogle-news-scraper\u002Fassets\u002F44357929\u002Fcc3efc01-e719-4497-80f9-45710cb47977\">\n\nIn the URL shown in the screenshot, the topic ID would be `CAAqJggKIiBDQkFTRWdvSUwyMHZNRGx6TVdZU0FtVnVHZ0pWVXlnQVAB`. \n\nSave this value, you'll need it for scraping the articles.\n\n### Scraping \n\nTo scrape articles from your selected topic, run this command in your terminal:\n`make scrape TOPIC_ID=\u003Cyour_selected_topic_id>`\n\nWith the `Business` topic ID selected before, the command should look like this:\n\n`make scrape TOPIC_ID=CAAqJggKIiBDQkFTRWdvSUwyMHZNRGx6TVdZU0FtVnVHZ0pWVXlnQVAB`\n\nAfter running the command, you should see this in your terminal:\n\n\u003Cimg width=\"1177\" alt=\"image\" src=\"https:\u002F\u002Fgithub.com\u002Foxylabs\u002Fgoogle-news-scraper\u002Fassets\u002F44357929\u002Fad3e8211-043d-40fe-87e3-89fc9fea2381\">\n\nWhen the tool has finished running, you should see a file named `articles.csv` in the directory you were running the tool.\n\nIf you open the generated CSV file, the data should look something like this:\n\n\u003Cimg width=\"1277\" alt=\"image\" src=\"https:\u002F\u002Fgithub.com\u002Foxylabs\u002Fgoogle-news-scraper\u002Fassets\u002F44357929\u002F7127198e-1aa9-468d-a6e6-b989a68085f3\">\n\n\n### Notes\n\nIn case the code doesn't work or your project is of bigger scale, please refer to the second part of the tutorial. There, we showcase how to scrape public data with Oxylabs Scraper API.\n\n## Oxylabs Google News Scraper API\n\nYou can take [a free trial for Google News API](https:\u002F\u002Foxylabs.io\u002Fproducts\u002Fscraper-api\u002Fserp\u002Fgoogle\u002Fnews) (part of the Oxylabs all-in-one Web Scraper API) and get **up to 2K free results**.  The tool will deliver a list of **sources, titles, URLs, and dates from published articles** all over the Google News portal. It utilizes a **fast-adapting infrastructure** to manage proxies, unblocking, and parsing automatically, so you can focus on data processing instead of scraper maintenance.\n\nAfter you claim your trial, using Google News Scraper API consists of three main steps:\n1. Create your API user via our [dashboard](https:\u002F\u002Fdashboard.oxylabs.io)\n2. Send a request\n3. Retrieve the data in JSON, HTML, or Markdown\n\n### Request sample\nIn the examples below, we make a request to obtain News search result pages for the search term `adidas`.\n\n```\nimport requests\nfrom pprint import pprint\n\n# Structure payload.\npayload = {\n    'source': 'google_search',\n    'query': 'adidas',\n    'parse': True,\n    'context': [\n        {'key': 'udm', 'value': '12'},\n    ],\n}\n\n# Get response.\nresponse = requests.post(\n    'https:\u002F\u002Frealtime.oxylabs.io\u002Fv1\u002Fqueries',\n    auth=('USERNAME', 'PASSWORD'),\n    json=payload,\n)\n\n# Print prettified response to stdout.\npprint(response.json())\n```\n\nTo see **request samples in other languages** and **parameter values** along with their **descriptions**, please take a look at our extensive [Google News API documentation](https:\u002F\u002Fdevelopers.oxylabs.io\u002Fscraping-solutions\u002Fweb-scraper-api\u002Ftargets\u002Fgoogle\u002Fsearch\u002Fnews-search#python). \n\nRead More Google Scraping Related Repositories: [Google Sheets for Basic Web Scraping](https:\u002F\u002Fgithub.com\u002Foxylabs\u002Fweb-scraping-google-sheets), [Google Play Scraper](https:\u002F\u002Fgithub.com\u002Foxylabs\u002Fgoogle-play-scraper), [How To Scrape Google Jobs](https:\u002F\u002Fgithub.com\u002Foxylabs\u002Fhow-to-scrape-google-jobs), [How to Scrape Google Scholar](https:\u002F\u002Fgithub.com\u002Foxylabs\u002Fhow-to-scrape-google-scholar), [How to Scrape Google Flights with Python](https:\u002F\u002Fgithub.com\u002Foxylabs\u002Fhow-to-scrape-google-flights), [How To Scrape Google Images](https:\u002F\u002Fgithub.com\u002Foxylabs\u002Fhow-to-scrape-google-images), [Scrape Google Search Results](https:\u002F\u002Fgithub.com\u002Foxylabs\u002Fscrape-google-python), [Scrape Google Trends](https:\u002F\u002Fgithub.com\u002Foxylabs\u002Fhow-to-scrape-google-trends)\n","oxylabs\u002Fgoogle-news-scraper 是一个用于从 Google News 平台抓取最新全球新闻的工具，支持获取包括来源、标题、URL 和发布日期在内的多种信息。该项目使用 Python 编写，核心功能是通过命令行接口指定主题 ID 来自动抓取相关文章，并将结果保存为 CSV 文件。其技术特点在于操作简便且无需额外付费即可使用基础功能，同时提供了高级 API 接口以满足更复杂的需求。适用于需要实时监控特定领域新闻动态的数据分析师、研究人员以及任何希望自动化收集新闻资讯的开发者。",2,"2026-06-11 03:41:53","high_star"]