Browsermob proxy does not intercept the request/response with headless chrome for secure (https) sites.

Browsermob proxy does not intercept the request/response with headless chrome for secure (https://google.com) sites.

Its work fine with non-secure sites (http://cnn.com)

Tested with the following configuration

Browsermob proxy : 2.1.5 Chrome browser headless: 62.0.3202.94 (Official Build) (64-bit) ChromeDriver 2.33.506120

Here is a test case. Please provide any pointers on how to get this working or if it is bug that needs to be addressed.

import org.openqa.selenium.Proxy;
import org.openqa.selenium.WebDriver;
import org.openqa.selenium.chrome.ChromeDriver;
import org.openqa.selenium.chrome.ChromeOptions;
import org.openqa.selenium.remote.CapabilityType;

import io.netty.handler.codec.http.HttpRequest;
import io.netty.handler.codec.http.HttpResponse;
import net.lightbody.bmp.BrowserMobProxy;
import net.lightbody.bmp.BrowserMobProxyServer;
import net.lightbody.bmp.client.ClientUtil;
import net.lightbody.bmp.filters.RequestFilter;
import net.lightbody.bmp.filters.ResponseFilter;
import net.lightbody.bmp.util.HttpMessageContents;
import net.lightbody.bmp.util.HttpMessageInfo;

public class HeadlessChromeWithBmpTest {
	/**
	 * @param args
	 */
	public static void main(String[] args) {
		try {
			System.setProperty("webdriver.chrome.logfile", "c:\\mystuff\\chromedriver_issue.log");
			System.setProperty("webdriver.chrome.driver",
					"C:/mystuff/qb_collector/drivers/chrome/chromedriver_233.exe");

			BrowserMobProxy proxy = new BrowserMobProxyServer();
			proxy.start(0);
			addRequestResponseFilters(proxy);
			proxy.newHar("test-har");
			Proxy seleniumProxy = ClientUtil.createSeleniumProxy(proxy);

			ChromeOptions options = new ChromeOptions();
			options.setCapability(CapabilityType.PROXY, seleniumProxy);
			options.setAcceptInsecureCerts(true);
			options.addArguments("--allow-insecure-localhost");
			// options.addArguments("--headless");
			// options.addArguments("--proxy-server=localhost:" +
			// proxy.getPort());
			// options.addArguments("--proxy-server=localhost:" + "8888");
			options.setHeadless(true);
			WebDriver driver = new ChromeDriver(options);
			driver.get("https://www.google.com");
			

			System.out.println("Done");
			driver.close();
			Thread.sleep(5000);
			System.out.println("Har Entries :" + proxy.getHar().getLog().getEntries().size());
			proxy.stop();

		} catch (Exception e) {
			System.out.println("!!! Exception:");
			System.out.println(e);
		}
	}

	public static void addRequestResponseFilters(BrowserMobProxy proxy) {

		// request filter
		proxy.addRequestFilter(new RequestFilter() {
			@Override
			public HttpResponse filterRequest(HttpRequest request, HttpMessageContents contents,
					HttpMessageInfo messageInfo) {

				System.out.println("Intercepting request for URL :" + messageInfo.getUrl());
				return null;
			}
		});
		// response filter
		proxy.addResponseFilter(new ResponseFilter() {
			@Override
			public void filterResponse(HttpResponse response, HttpMessageContents contents,
					HttpMessageInfo messageInfo) {

				System.out.println("intercepting response for url :" + messageInfo.getOriginalUrl());
			}
		});
	}
}

`

[mediga]

I was able to get this working by importing browsermob’s ca-certificate-rsa.cer into Chrome browser

[nanshummt]

@mediga How to import browsermob’s ca-certificate-rsa.cer into Chrome browser