Question

我尝试从iframe / frame标签中抓取一些数据，但是我迷上了puppeteer的代码。我是新手，所以请多多包涵。这是网站http://ratt.ro/txt的链接。在那儿，当我在第一帧中单击一个名称时，我又在第二帧中获得有关女巫的一些数据，我可以单击并在第三帧中获取数据。在代码中，我尝试循环真实的第一帧以获取第二和第三帧的所有数据。

谢谢您的提示。

我已经运行了以下命令： document.querySelector（“正文>表单>字体>选择>选项”）在控制台中，但是我找不到在puppeteer中运行它的方法。

const puppeteer = require("puppeteer");

(async () => {

    const browser = await puppeteer.launch();

    const page = await browser.newPage();
    await page.goto('http://ratt.ro/txt');

    const iframeParagraph = await page.evaluate(() => {

        const iframe = document.getElementsByName("stanga");

        // grab iframe's document object
        const iframeDoc = iframe.contentDocument || iframe.contentWindow.document;

        const iframeP = iframeDoc.getElementsByName("fmtstatii");

        return iframeP.innerHTML;
    });

    console.log(iframeParagraph); 

    await browser.close();

})();

或

const puppeteer = require('puppeteer');

let scrape = async () => {
    const browser = await puppeteer.launch({headless: false});
    const page = await browser.newPage();

    await page.goto('http://ratt.ro/txt');
    await page.click('document.querySelector("body > form > font > select")');
    await page.waitFor(1000);

    const result = await page.evaluate(() => {
        let statie = document.querySelector('document.querySelector("body > form > font > select > option")').innerText;

        return {
            statie
        }

    });

    browser.close();
    return result;
};

scrape().then((value) => {
    console.log(value); // Success!
});

这是我得到的错误：

[(node:13308) UnhandledPromiseRejectionWarning: Error: Evaluation failed: DOMException: Failed to execute 'querySelector' on 'Document': 'document.querySelector("body > form > font > select")' is not a
valid selector.
    at __puppeteer_evaluation_script__:1:33
    at ExecutionContext._evaluateInternal (D:\Zero\ratt_scrap\node_modules\puppeteer\lib\ExecutionContext.js:122:13)
    at process._tickCallback (internal/process/next_tick.js:68:7)
  -- ASYNC --
    at ExecutionContext.<anonymous> (D:\Zero\ratt_scrap\node_modules\puppeteer\lib\helper.js:111:15)
    at ElementHandle.$ (D:\Zero\ratt_scrap\node_modules\puppeteer\lib\JSHandle.js:395:50)
    at ElementHandle.<anonymous> (D:\Zero\ratt_scrap\node_modules\puppeteer\lib\helper.js:112:23)
    at DOMWorld.$ (D:\Zero\ratt_scrap\node_modules\puppeteer\lib\DOMWorld.js:121:34)
    at process._tickCallback (internal/process/next_tick.js:68:7)
  -- ASYNC --
    at Frame.<anonymous> (D:\Zero\ratt_scrap\node_modules\puppeteer\lib\helper.js:111:15)
    at Page.click (D:\Zero\ratt_scrap\node_modules\puppeteer\lib\Page.js:986:29)
    at scrape (D:\Zero\ratt_scrap\scrape.js:23:16)
    at process._tickCallback (internal/process/next_tick.js:68:7)
(node:13308) UnhandledPromiseRejectionWarning: Unhandled promise rejection. This error originated either by throwing inside of an async function without a catch block, or by rejecting a promise which was not handled with .catch(). (rejection id: 1)
(node:13308) \[DEP0018\] DeprecationWarning: Unhandled promise rejections are deprecated. In the future, promise rejections that are not handled will terminate the Node.js process with a non-zero exit code.]

Answer 1

您犯了几个错误：

您应该与Frame而不是Page对象进行交互。

const frame = await page.frames().find(frame => frame.name() === 'stanga'); // Find the right frame.

click()方法期望使用selector <string>，因此您无需在document.querySelector方法内添加click()。
```
await frame.click('body > form > font > select');
```
要获得所有innerText，您必须遍历元素。
不要忘记添加await。您错过了close方法。
```
await browser.close();
```

解决方案：

const puppeteer = require('puppeteer');

let scrape = async () => {
const browser = await puppeteer.launch({headless: false});
const page = await browser.newPage();

await page.goto('http://ratt.ro/txt');
const frame = await page.frames().find(frame => frame.name() === 'stanga');
await frame.click('body > form > font > select');
await page.waitFor(1000);


const optionsResult = await frame.$$eval('body > form > font > select > option', (options) => {
    const result = options.map(option => option.innerText);

    return result;
});

await browser.close();

return optionsResult;
};

scrape().then((value) => {
  console.log(value); // Success!
});

如何与puppeteer一起从iframe标记中抓取日期

1 个答案: