如何使用Selenium Webdriver捕获特定元素而不是整个页面的屏幕截图?


82

目前,我正在尝试使用Selenium WebDriver捕获屏幕截图。但是我只能获取整个页面的屏幕截图。但是,我想要的只是捕获页面的一部分,或者仅捕获基于ID或任何特定元素定位符的特定元素。(例如,我希望捕获图像ID =“ Butterfly”的图片)

有什么方法可以按选定的项目或元素捕获屏幕截图吗?


1
AFAIK,该功能仅可捕获整个页面。我们没有将元素ID或名称作为输入的屏幕截图功能。
Hemanth

任何人都可以告诉我在C#中BUfferedImage的方法调用是什么?我找不到与此相关的任何类似方法。
fj123

Answers:


117

我们可以通过裁剪整个页面截图来获得元素截图,如下所示:

driver.get("http://www.google.com");
WebElement ele = driver.findElement(By.id("hplogo"));

// Get entire page screenshot
File screenshot = ((TakesScreenshot)driver).getScreenshotAs(OutputType.FILE);
BufferedImage  fullImg = ImageIO.read(screenshot);

// Get the location of element on the page
Point point = ele.getLocation();

// Get width and height of the element
int eleWidth = ele.getSize().getWidth();
int eleHeight = ele.getSize().getHeight();

// Crop the entire page screenshot to get only element screenshot
BufferedImage eleScreenshot= fullImg.getSubimage(point.getX(), point.getY(),
    eleWidth, eleHeight);
ImageIO.write(eleScreenshot, "png", screenshot);

// Copy the element screenshot to disk
File screenshotLocation = new File("C:\\images\\GoogleLogo_screenshot.png");
FileUtils.copyFile(screenshot, screenshotLocation);

谢谢您的回复。但是,为什么我的webdriver与您的不同。它使用IWebDriver,ITakeScreenshot并且没有OutputType.FILE和BufferedImage ...我使用的是Webdriver Selenium的过时版本吗?
fj123 2012年

您正在使用C#Webdriver绑定吗?
Surya

是的,我想是这样。以前我使用RC,最近我只是更改为使用Web驱动程序。
fj123

此实现用于Java绑定。这个概念也适用于C#。但是我不太了解C#语言。您需要使用C#等效库(BufferedImage,ImageIO ...)
Surya 2012年

4
上面的代码在Chrome中不起作用。异常java.awt.image.RasterFormatException:(y + height)在Raster之外,并在BufferedImage行上抛出了异常。
Ripon Al Wasim

13

这是使用Selenium Webdriver和Pillow的Python 3版本。该程序捕获整个页面的屏幕快照,并根据其位置裁剪元素。元素图像将以image.png的形式提供。Firefox支持使用element.screenshot_as_png('image_name')直接保存元素图像。

from selenium import webdriver
from PIL import Image

driver = webdriver.Chrome()
driver.get('https://www.google.co.in')

element = driver.find_element_by_id("lst-ib")

location = element.location
size = element.size

driver.save_screenshot("shot.png")

x = location['x']
y = location['y']
w = size['width']
h = size['height']
width = x + w
height = y + h

im = Image.open('shot.png')
im = im.crop((int(x), int(y), int(width), int(height)))
im.save('image.png')

更新资料

现在,chrome还支持单个元素的屏幕截图。因此,您可以直接捕获Web元素的屏幕截图,如下所示。

from selenium import webdriver

driver = webdriver.Chrome()
driver.get('https://www.google.co.in')
image = driver.find_element_by_id("lst-ib").screenshot_as_png 
# or
# element = driver.find_element_by_id("lst-ib")
# element.screenshot_as_png("image.png")

4
我很确定这element.size是以点为单位给出的,而由产生的屏幕截图则driver.save_screenshot具有像素尺寸。如果你的屏幕比1(例如,视网膜MacBook有每点的两个像素- 2的比率)之外的像素,以点率,那么你需要乘w,并h通过这个比例。
BallpointBen19年

新版本已经可以使用element.screenshot('elemenent.png'),请参见@ rovr138的答案
tinyhare

@tinyhare仅在创建答案时在Firefox中可用。我认为它现在也可以在chrome中使用。更新答案。
codelord

1
@puppet对于内存加载,请执行此操作。from StringIO import StringIO; from PIL import Image; img = Image.open(StringIO(image))
codelord

1
我有一个与@puppet类似的问题。这对我import io; from PIL import Image; img = Image.open(io.BytesIO(image)); img.save("image.png")
有用

9

Node.js我写了下面的代码工作,但它不是基于硒的官方WebDriverJS,但基于SauceLabs's WebDriverWD.js并呼吁一个非常紧凑的图像库EasyImage

我只是想强调一下,您不能真正获取元素的屏幕截图,但是您应该做的是首先获取整个页面的屏幕截图,然后选择页面中喜欢的部分并裁剪该特定部分:

browser.get(URL_TO_VISIT)
       .waitForElementById(dependentElementId, webdriver.asserters.isDisplayed, 3000)
       .elementById(elementID)
        .getSize().then(function(size) {
            browser.elementById(elementID)
                   .getLocation().then(function(location) {
                        browser.takeScreenshot().then(function(data) {
                            var base64Data = data.replace(/^data:image\/png;base64,/, "");
                            fs.writeFile(filePath, base64Data, 'base64', function(err) {
                                if (err) {
                                    console.log(err);
                                } 
                                else {
                                    cropInFile(size, location, filePath);
                                }
                                doneCallback();
                        });
                    });
                });
            }); 

然后cropInFileFunction如下所示:

var cropInFile = function(size, location, srcFile) {
    easyimg.crop({
            src: srcFile,
            dst: srcFile,
            cropwidth: size.width,
            cropheight: size.height,
            x: location.x,
            y: location.y,
            gravity: 'North-West'
        },
        function(err, stdout, stderr) {
            if (err) throw err;
        });
};

您的EasyImage库已损坏:“ ImageMagickMissingError”
Nizar B.

9

Yandex的ASHOT框架可用于在Selenium WebDriver脚本中截取屏幕截图,用于

  • 完整网页
  • 网络元素

可以在https://github.com/yandex-qatools/ashot上找到此框架。

截取屏幕截图的代码非常简单:

整个页面

screenshot = new AShot().shootingStrategy(
new ViewportPastingStrategy(1000)).takeScreenshot(driver);
ImageIO.write(screenshot.getImage(), "PNG", new File("c:\\temp\\results.png"));

特定的网络元素

screenshot = new AShot().takeScreenshot(driver, 
driver.findElement(By.xpath("(//div[@id='ct_search'])[1]")));

ImageIO.write(screenshot.getImage(), "PNG", new File("c:\\temp\\div_element.png"));

本文上查看更多详细信息和更多代码示例。


要小心,你可能还需要.shootingStrategy(ShootingStrategies.viewportPasting(100))有太多SPECIFIC WEB ELEMENT的模式,否则可能无法捕获所有元素。
user1686407 '18

8

对于要求使用C#代码的每个人,下面是我的实现的简化版本。

public static void TakeScreenshot(IWebDriver driver, IWebElement element)
{
    try
    {
        string fileName = DateTime.Now.ToString("yyyy-MM-dd HH-mm-ss") + ".jpg";
        Byte[] byteArray = ((ITakesScreenshot)driver).GetScreenshot().AsByteArray;
        System.Drawing.Bitmap screenshot = new System.Drawing.Bitmap(new System.IO.MemoryStream(byteArray));
        System.Drawing.Rectangle croppedImage = new System.Drawing.Rectangle(element.Location.X, element.Location.Y, element.Size.Width, element.Size.Height);
        screenshot = screenshot.Clone(croppedImage, screenshot.PixelFormat);
        screenshot.Save(String.Format(@"C:\SeleniumScreenshots\" + fileName, System.Drawing.Imaging.ImageFormat.Jpeg));
    }
    catch (Exception e)
    {
        logger.Error(e.StackTrace + ' ' + e.Message);
    }
}

谢谢。那是非常有帮助的,并且非常完美。
Sorrel Vesper

5

我在截图上浪费了很多时间,我想保存你的截图。我用了铬+硒+ c#,结果太可怕了。最后我写了一个函数:

driver.Manage().Window.Maximize();
             RemoteWebElement remElement = (RemoteWebElement)driver.FindElement(By.Id("submit-button")); 
             Point location = remElement.LocationOnScreenOnceScrolledIntoView;  

             int viewportWidth = Convert.ToInt32(((IJavaScriptExecutor)driver).ExecuteScript("return document.documentElement.clientWidth"));
             int viewportHeight = Convert.ToInt32(((IJavaScriptExecutor)driver).ExecuteScript("return document.documentElement.clientHeight"));

             driver.SwitchTo();

             int elementLocation_X = location.X;
             int elementLocation_Y = location.Y;

             IWebElement img = driver.FindElement(By.Id("submit-button"));

             int elementSize_Width = img.Size.Width;
             int elementSize_Height = img.Size.Height;

             Size s = new Size();
             s.Width = driver.Manage().Window.Size.Width;
             s.Height = driver.Manage().Window.Size.Height;

             Bitmap bitmap = new Bitmap(s.Width, s.Height);
             Graphics graphics = Graphics.FromImage(bitmap as Image);
             graphics.CopyFromScreen(0, 0, 0, 0, s);

             bitmap.Save(filePath, System.Drawing.Imaging.ImageFormat.Png);

             RectangleF part = new RectangleF(elementLocation_X, elementLocation_Y + (s.Height - viewportHeight), elementSize_Width, elementSize_Height);

             Bitmap bmpobj = (Bitmap)Image.FromFile(filePath);
             Bitmap bn = bmpobj.Clone(part, bmpobj.PixelFormat);
             bn.Save(finalPictureFilePath, System.Drawing.Imaging.ImageFormat.Png); 

1
只要您尝试捕获无需滚动即可看到的元素,它就可以很好地工作。当您需要滚动到一个元素来捕获它时,则从页面顶部开始计算y偏移量,然后该偏移量将超过全屏图像的边界。因此,最简单的解决方案是增加屏幕尺寸代码this.driver.manage()。window()。setSize(new Dimension(1680,1050)); 或通过CSS删除任何不需要的元素。正确的解决方案是从滚动计算y偏移。
Ichwardort

3

如果您不介意涉及磁盘IO,那么Surya的答案非常有用。如果您不愿意,那么此方法可能更适合您

private Image getScreenshot(final WebDriver d, final WebElement e) throws IOException {
    final BufferedImage img;
    final Point topleft;
    final Point bottomright;

    final byte[] screengrab;
    screengrab = ((TakesScreenshot) d).getScreenshotAs(OutputType.BYTES);

    img = ImageIO.read(new ByteArrayInputStream(screengrab));

    //crop the image to focus on e
    //get dimensions (crop points)
    topleft = e.getLocation();
    bottomright = new Point(e.getSize().getWidth(),
                            e.getSize().getHeight());

    return img.getSubimage(topleft.getX(),
                           topleft.getY(),
                           bottomright.getX(),
                           bottomright.getY());
}

如果您愿意,可以跳过声明screengrab,转而做

img = ImageIO.read(
    new ByteArrayInputStream(
        ((TakesScreenshot) d).getScreenshotAs(OutputType.BYTES)));

这比较干净,但为了清楚起见,我将其保留。然后,您可以将其另存为文件,将其放入JPanel中以使您满意。


3

Python 3

在Selenium 3.141.0和chromedriver 73.0.3683.68中进行了尝试,

from selenium import webdriver

chromedriver = '/usr/local/bin/chromedriver'
chromeOptions = webdriver.ChromeOptions()
chromeOptions.add_argument('window-size=1366x768')
chromeOptions.add_argument('disable-extensions')
cdriver = webdriver.Chrome(options=chromeOptions, executable_path=chromedriver)

cdriver.get('url')
element = cdriver.find_element_by_css_selector('.some-css.selector')

element.screenshot_as_png('elemenent.png')

无需获取完整图像并获得全屏图像的一部分。

创建Rohit的答案时,该功能可能不可用。


2
public void GenerateSnapshot(string url, string selector, string filePath)
    {
        using (IWebDriver driver = new ChromeDriver())
        {
            driver.Navigate().GoToUrl(url);
            var remElement = driver.FindElement(By.CssSelector(selector));
            Point location = remElement.Location;

            var screenshot = (driver as ChromeDriver).GetScreenshot();
            using (MemoryStream stream = new MemoryStream(screenshot.AsByteArray))
            {
                using (Bitmap bitmap = new Bitmap(stream))
                {
                    RectangleF part = new RectangleF(location.X, location.Y, remElement.Size.Width, remElement.Size.Height);
                    using (Bitmap bn = bitmap.Clone(part, bitmap.PixelFormat))
                    {
                        bn.Save(filePath, System.Drawing.Imaging.ImageFormat.Png);
                    }
                }
            }
            driver.Close();
        }
    }

2

如果您正在寻找JavaScript解决方案,这是我的主旨:

https://gist.github.com/sillicon/4abcd9079a7d29cbb53ebee547b55fba

基本想法是相同的,先拍摄屏幕截图,然后裁剪。但是,我的解决方案不需要其他库,只需纯WebDriver API代码。但是,副作用是它可能会增加测试浏览器的负载。


请在您的答案中粘贴代码,而不是链接到其他来源
supersan

2

这是C#的扩展功能:

public static BitmapImage GetElementImage(this IWebDriver webDriver, By by)
{
    var elements = webDriver.FindElements(by);
    if (elements.Count == 0)
        return null;

    var element = elements[0];
    var screenShot = (webDriver as ITakesScreenshot).GetScreenshot();
    using (var ms = new MemoryStream(screenShot.AsByteArray))
    {
        Bitmap screenBitmap;
        screenBitmap = new Bitmap(ms);
        return screenBitmap.Clone(
            new Rectangle(
                element.Location.X,
                element.Location.Y,
                element.Size.Width,
                element.Size.Height
            ),
            screenBitmap.PixelFormat
        ).ToBitmapImage();
    }
}

现在,您可以使用它来拍摄任何这样的元素的图像:

var image = webDriver.GetElementImage(By.Id("someId"));


1

在用于拍摄快照的功能下方,Selenium中的特定元素。这里的驱动程序是WebDriver的一种。

private static void getScreenshot(final WebElement e, String fileName) throws IOException {
  final BufferedImage img;
  final Point topleft;
  final Point bottomright;
  final byte[] screengrab;
  screengrab = ((TakesScreenshot) driver).getScreenshotAs(OutputType.BYTES);
  img = ImageIO.read(new ByteArrayInputStream(screengrab));
  topleft = e.getLocation();
  bottomright = new Point(e.getSize().getWidth(), e.getSize().getHeight());
  BufferedImage imgScreenshot= 
      (BufferedImage)img.getSubimage(topleft.getX(), topleft.getY(), bottomright.getX(), bottomright.getY());
  File screenshotLocation = new File("Images/"+fileName +".png");    
  ImageIO.write(imgScreenshot, "png", screenshotLocation);
 }

有关更多信息
请参见此

1

C#代码:

public Bitmap MakeElemScreenshot( IWebDriver driver, WebElement elem)
{
    Screenshot myScreenShot = ((ITakesScreenshot)driver).GetScreenshot();

    Bitmap screen = new Bitmap(new MemoryStream(myScreenShot.AsByteArray));
    Bitmap elemScreenshot = screen.Clone(new Rectangle(elem.Location, elem.Size), screen.PixelFormat);

    screen.Dispose();

    return elemScreenshot;
}

0
using System.Drawing;
using System.Drawing.Imaging;
using OpenQA.Selenium;
using OpenQA.Selenium.Firefox;

public void ScreenshotByElement()
{
    IWebDriver driver = new FirefoxDriver();
    String baseURL = "www.google.com/"; //url link
    String filePath = @"c:\\img1.png";      

    driver.Navigate().GoToUrl(baseURL);
    var remElement = driver.FindElement(By.Id("Butterfly"));
    Point location = remElement.Location;

    var screenshot = (driver as FirefoxDriver).GetScreenshot();
    using (MemoryStream stream = new MemoryStream(screenshot.AsByteArray))
    {
        using (Bitmap bitmap = new Bitmap(stream))
        {
            RectangleF part = new RectangleF(location.X, location.Y, remElement.Size.Width, remElement.Size.Height);
            using (Bitmap bn = bitmap.Clone(part, bitmap.PixelFormat))
            {
                bn.Save(filePath, ImageFormat.Png);                        
            }
        }
    }
}

0

如果您在chrome中遇到异常java.awt.image.RasterFormatException,或者要将滚动到视图中,请捕获屏幕快照。

这是来自@Surya答案的解决方案。

        JavascriptExecutor jsExecutor = (JavascriptExecutor) driver;
        Long offsetTop = (Long) jsExecutor.executeScript("window.scroll(0, document.querySelector(\""+cssSelector+"\").offsetTop - 0); return document.querySelector(\""+cssSelector+"\").getBoundingClientRect().top;");

        WebElement ele = driver.findElement(By.cssSelector(cssSelector));

        // Get entire page screenshot
        File screenshot = ((TakesScreenshot)driver).getScreenshotAs(OutputType.FILE);
        BufferedImage  fullImg = ImageIO.read(screenshot);

        // Get the location of element on the page
        Point point = ele.getLocation();

        // Get width and height of the element
        int eleWidth = ele.getSize().getWidth();
        int eleHeight = ele.getSize().getHeight();

        // Crop the entire page screenshot to get only element screenshot
        BufferedImage eleScreenshot= fullImg.getSubimage(point.getX(), Math.toIntExact(offsetTop),
                eleWidth, eleHeight);
        ImageIO.write(eleScreenshot, "png", screenshot);

        // Copy the element screenshot to disk
        File screenshotLocation = new File("c:\\temp\\div_element_1.png");
        FileUtils.copyFile(screenshot, screenshotLocation);

我正在使用selenium-java-2.53.1,编译组:'org.seleniumhq.selenium',名称:'selenium-java',版本:'2.53.1',chrome-web-driver,我正在尝试裁剪.xpath( “.// IMG [@class = '验证码']”)从网页resident.uidai.gov.in/offlineaadhaar,但你的代码是不正确的工作。它裁剪了页面的某些错误部分。你能帮我把验证码剪掉吗?
vijay

0

这是我的版本,在C#中,我基本上从Brook的答案中得到了大部分,并对其进行了修改以适合我的目的

public static byte[] GetElementImage(this IWebElement element)
    {
        var screenShot = MobileDriver.Driver.GetScreenshot();
        using (var stream = new MemoryStream(screenShot.AsByteArray))
        {
            var screenBitmap = new Bitmap(stream);
            var elementBitmap = screenBitmap.Clone(
                new Rectangle(
                    element.Location.X,
                    element.Location.Y,
                    element.Size.Width,
                    element.Size.Height
                ),
                screenBitmap.PixelFormat
            );
            var converter = new ImageConverter();
            return (byte[]) converter.ConvertTo(elementBitmap, typeof(byte[]));
        }
    }

-1

我相信当您使用C#时,这对您不起作用,并且我的解决方案包括Java库,但是也许其他人会发现它有用。

要捕获自定义屏幕截图,可以使用Shutterbug库。为此目的的具体要求是:

Shutterbug.shootElement(driver, element).save();

-1

我遵循了@codeslord的示例代码,但是由于某些原因,我不得不以不同的方式访问我的屏幕截图数据:

 # Open the Firefox webdriver
 driver = webdriver.Firefox()
 # Find the element that you're interested in
 imagepanel = driver.find_element_by_class_name("panel-height-helper")
 # Access the data bytes for the web element
 datatowrite = imagepanel.screenshot_as_png
 # Write the byte data to a file
 outfile = open("imagepanel.png", "wb")
 outfile.write(datatowrite)
 outfile.close()

(使用Python 3.7,Selenium 3.141.0和Mozilla Geckodriver 71.0.0.7222)


-2

我使用的是@Brook答案的修改版本,即使对于需要滚动页面的元素也能正常工作。

public void TakeScreenshot(string fileNameWithoutExtension, IWebElement element)
{
    // Scroll to the element if necessary
    var actions = new Actions(_driver);
    actions.MoveToElement(element);
    actions.Perform();
    // Get the element position (scroll-aware)
    var locationWhenScrolled = ((RemoteWebElement) element).LocationOnScreenOnceScrolledIntoView;
    var fileName = fileNameWithoutExtension + ".png";
    var byteArray = ((ITakesScreenshot) _driver).GetScreenshot().AsByteArray;
    using (var screenshot = new System.Drawing.Bitmap(new System.IO.MemoryStream(byteArray)))
    {
        var location = locationWhenScrolled;
        // Fix location if necessary to avoid OutOfMemory Exception
        if (location.X + element.Size.Width > screenshot.Width)
        {
            location.X = screenshot.Width - element.Size.Width;
        }
        if (location.Y + element.Size.Height > screenshot.Height)
        {
            location.Y = screenshot.Height - element.Size.Height;
        }
        // Crop the screenshot
        var croppedImage = new System.Drawing.Rectangle(location.X, location.Y, element.Size.Width, element.Size.Height);
        using (var clone = screenshot.Clone(croppedImage, screenshot.PixelFormat))
        {
            clone.Save(fileName, ImageFormat.Png);
        }
    }
}

这两个值if是必需的(至少对于chrome驱动程序而言),因为在需要滚动时,裁剪大小超出了屏幕截图大小的1像素。


我尝试使用您的方法时遇到此错误:无法强制转换透明代理以键入“ OpenQA.Selenium.Remote.RemoteWebElement”
shanabus

我专门将此功能与Chrome驱动程序配合使用,您使用哪个驱动程序?
thepirat000

我也在使用ChromeDriver。我的测试使用的是IWebElements,我们遵循的是OpenQA.Selenium.Support nuget包中的PageFactory方法。
shanabus
By using our site, you acknowledge that you have read and understand our Cookie Policy and Privacy Policy.
Licensed under cc by-sa 3.0 with attribution required.