How to use with Pandas Datareader?

Would love some input on how to make that work, specifically when using DataReader and the Yahoo Finance API to get stock data. I can make requests for stock data using the DataReader once, and then after that I get an error, until the next day. My code looks simple:

import pandas as pd
import pandas_datareader.data as web
from datetime import datetime
from time import sleep
from http_request_randomizer.requests.proxy.requestProxy import RequestProxy

# list of stock's data to get
stocks = [

'USO',
'FXI',
'EEM'

]

start = datetime(2018, 9, 19)
end = datetime.now()

for i in stocks:
    sleep(5)
    
    try:
        data = web.DataReader(i, 'yahoo', start, end)
        df = data[['Date','Open','High','Low','Close','Adj Close','Volume']]
        # Round some of the results to 2 decimal places, then save .csv file
        df = df.round({"Open":2, "High":2, "Low":2, "Close":2, "Adj Close":2})
        df.to_csv(str(i) + '.csv')
        print('Successfully downloaded ' + str(i))
        continue
    
    except:
        print('Failed to download ' + str(i))
        continue

So how could one integrate the http randomizer into that? I tried playing around with it a bit but couldn’t figure it out. Something like replacing the url used in the request with the datareader somehow? If that makes sense?

[windowshopr]

Right on! I was able to get it working. Thanks a lot for the help!

[pgaref]

Hey @windowshopr – the path should be relative so it should be something like: https://github.com/pgaref/HTTP_Request_Randomizer/blob/78b305a3440f33cfd0caddb8ddf41b5eea974c68/http_request_randomizer/requests/proxy/requestProxy.py#L38

If you use the default (empty) UserAgentManager constructor, it will use the fake-useragent which is also fine (you will notice some log.warn messages)

Other than that let me know if you face any other issues and I can add the pandas-session functionality with some tests in the next release.