Chrome Headless

• ChromeDevTools/awesome-chrome-devtools
• Chrome Flags for Tooling
• https://chromedevtools.github.io/devtools-protocol/
• devtools-ws-url
  • --remote-debugging-port=9222
    • /json
• flags
  • --user-data-dir=$DIR
  • --blink-settings=imagesEnabled=false
• https://github.com/GoogleChrome/chrome-launcher/blob/master/docs/chrome-flags-for-tools.md
• https://niek.github.io/chrome-features/
• blink features
• RuntimeEnabledFeatures
• https://www.chromium.org/developers/design-documents/network-settings/
  • --proxy-server=127.0.0.1:7890
• DevToolsActivePort
  • 第一行为端口
  • 第二行为 路径 /devtools/browser/UUID

chrome --headless --remote-debugging-port=9222 --disable-gpu --no-sandbox

# /devtools/inspector.html?ws=127.0.0.1:9222/devtools/page/6BD1FB9A428F479750451F5E652F544F
curl http://localhost:9222/json

--enable-blink-features=SomeNewFeature,SomeOtherNewFeature
--disable-blink-features=SomeOldFeature

提示

• Proxy 只能配置全局，不可以按页面配置
  • puppeteer#678
  • Context 可以配置代理 https://pptr.dev/next/api/puppeteer.browsercontextoptions/
• 不支持 PAC
• puppeteer#540
  • 多个 cert 会出现选择

Awesome

• puppeteer
  • Apache-2.0, TS
  • Chrome 团队支持
• microsoft/playwright
  • 支持 多浏览器 - Chromium, Firefox, WebKit
  • patch Firefox, WebKit 实现
• Golang
  • chromedp/chromedp
    • chromedp/examples
  • sensepost/gowitness

WebDriver

• W3C WebDriver
  • 控制浏览器
• electron/chromedriver
  • 下载 ChromeDriver
  • https://chromedriver.chromium.org/
  • https://chromedriver.storage.googleapis.com/index.html
• webdriver
  • Python from selenium import webdriver

FAQ

playwright vs puppeteer

• https://blog.logrocket.com/playwright-vs-puppeteer/

New Headless

• Chrome 112+
• 支持
  • --dump-dom
  • --screenshot --window-size=412,892
  • --print-to-pdf --no-pdf-header-footer
  • --timeout=5000
  • --virtual-time-budget
    • 虚拟时间 - setTimeout/setInterval
    • 以尽可能快的速度执行任意网页代码，同时使网页相信时间实际上是过去的时间。
• https://developer.chrome.com/docs/chromium/new-headless
• 实时视图目前仅实现触摸事件
  • https://bugs.chromium.org/p/chromium/issues/detail?id=1410433

Debugging connection was closed. Reason: WebSocket disconnected