Lua script does not work when using dynamic proxy

In the first picture, I make the request with dynamic proxy and the endpoint is execute

In the second picture, I make the request with dynamic proxy and the endpoint is render,html

And I’m pretty sure that my proxy is ok. But why lua script does not work when using dynamic proxy? Hope you can help me. @kmike

This is my code

for x in xrange(0,3):
            try:
                script = """
                function main(splash)

                    assert(splash:go(splash.args.url) )

                    splash:wait(2)



                    return splash:evaljs("document.title")
                    --return splash:evaljs([[
                        -- document.querySelector('#sf-item-list-data').innerText;
                    -- ]]);
                    -- return {html=splash:html()}

                end
                """
                agent = random.choice(agents)
                time.sleep(1)
                authHeader = self.getAuthHeader()
                headers={
                    "User-Agent":agent,
                    "Proxy-Authorization":authHeader,
                    # "Referer":"http://www.bttt99.com/",
                }
                splash_args = {
                    'wait': 1,
                    "http_method":"GET",
                    "images":0,
                    "render_all":1,
                    "headers":headers,
                    'lua_source': script,
                    "proxy":"http://101.200.153.236:8123",
                }
                yield SplashRequest(self.house_pc_index_url+"&page="+str(x+1), self.parse_result, endpoint='execute',
                                    args=splash_args,dont_filter=True)

[kmike]

@playwolf719 glad to see it helped!

I think for production it makes sense to run multiple Splash containers and use a load balancer, so that if one container crashes it can be restarted without affecting clients. You can implement it yourselves, use https://github.com/TeamHG-Memex/aquarium or use hosted Splash instance which takes care of that (like Scrapinghub’s). See also: http://splash.readthedocs.io/en/stable/faq.html#how-to-run-splash-in-production

[kmike]

@playwolf719 see https://github.com/scrapy-plugins/scrapy-splash#responses: response.data['title']