Python AH Buyer / Seller / ffxiah.com scrubber
-
- Posts: 3
- Joined: Wed Dec 26, 2018 9:34 pm
Re: Python AH Buyer / Seller / ffxiah.com scrubber
There are (2) column options "Rate01, Rate12". Can anyone explain what this does and give me an example of how it would be written please?
Re: Python AH Buyer / Seller / ffxiah.com scrubber
y'all need to realize you'd get better results posting issues and requests to his tracker. It is highly unlikely that the author would come running to the DSP forums with every post to see what was said. https://github.com/AdamGagorik/pydarkstar/issues
Hi, I run The Demiurge server.
![Image](https://s31.postimg.cc/45gtyxd2j/code_quality_frame_0004.gif)
Always code as if the guy who ends up maintaining your code will be a violent psychopath who knows where you live. - Martin Golding
![Image](https://s31.postimg.cc/45gtyxd2j/code_quality_frame_0004.gif)
Always code as if the guy who ends up maintaining your code will be a violent psychopath who knows where you live. - Martin Golding
DO NOT PRIVATE MESSAGE ME ABOUT BUGSPLS USE [ code ] CODE TAGS [ /code ] WHEN POSTING CODE
Re: Python AH Buyer / Seller / ffxiah.com scrubber
They aren't used (yet). You can see the intended future use right on the instruction page. http://adamgagorik.github.io/pydarkstar ... usage.htmlFearmonger wrote: ↑Fri Dec 28, 2018 6:16 pmThere are (2) column options "Rate01, Rate12". Can anyone explain what this does and give me an example of how it would be written please?
Hi, I run The Demiurge server.
![Image](https://s31.postimg.cc/45gtyxd2j/code_quality_frame_0004.gif)
Always code as if the guy who ends up maintaining your code will be a violent psychopath who knows where you live. - Martin Golding
![Image](https://s31.postimg.cc/45gtyxd2j/code_quality_frame_0004.gif)
Always code as if the guy who ends up maintaining your code will be a violent psychopath who knows where you live. - Martin Golding
DO NOT PRIVATE MESSAGE ME ABOUT BUGSPLS USE [ code ] CODE TAGS [ /code ] WHEN POSTING CODE
- evenmonkeys
- Posts: 78
- Joined: Thu Feb 13, 2014 1:53 am
- Location: Midwest, US
Re: Python AH Buyer / Seller / ffxiah.com scrubber
I am having an issue when I am trying to run the scrub command to pull new prices for a fresh install. Could anyone maybe give some ideas where to be looking for the issue? I deleted attempts 2-10 as they all said the same thing.
Code: Select all
[2019-02-10 14:23:49,594][ 3996][INFO ]: (0x29b5588) Options: config = config.yaml
[2019-02-10 14:23:49,594][ 3996][INFO ]: (0x29b5588) Options: verbose = True
[2019-02-10 14:23:49,595][ 3996][INFO ]: (0x29b5588) Options: silent = False
[2019-02-10 14:23:49,595][ 3996][INFO ]: (0x29b5588) Options: stub = items
[2019-02-10 14:23:49,595][ 3996][INFO ]: (0x29b5588) Options: overwrite = False
[2019-02-10 14:23:49,595][ 3996][INFO ]: (0x29b5588) Options: backup = True
[2019-02-10 14:23:49,596][ 3996][INFO ]: (0x29b5588) Options: stock01 = 3
[2019-02-10 14:23:49,596][ 3996][INFO ]: (0x29b5588) Options: stock12 = 3
[2019-02-10 14:23:49,596][ 3996][INFO ]: (0x29b5588) Options: itemids = ????
[2019-02-10 14:23:49,596][ 3996][INFO ]: (0x29b5588) Options: urls = ????
[2019-02-10 14:23:49,597][ 3996][DEBUG]: (0x3d940f0) FFXIAHScrubber: init
[2019-02-10 14:23:49,598][ 3996][DEBUG]: (0x3d940f0) FFXIAHScrubber: forcing redownload of data
[2019-02-10 14:23:49,598][ 3996][DEBUG]: (0x3d940f0) FFXIAHScrubber: getting category urls
[2019-02-10 14:23:49,598][ 3996][DEBUG]: (0x3d940f0) FFXIAHScrubber: open https://www.ffxiah.com/browse
[2019-02-10 14:23:49,600][ 3996][ERROR]: urlopen failed (attempt 1)
Traceback (most recent call last):
File "C:\Users\Highwind\Desktop\ah\pydarkstar\scrubbing\scrubber.py", line 33, in soup
handle = urlopen(url)
File "C:\ProgramData\Anaconda3\lib\urllib\request.py", line 222, in urlopen
return opener.open(url, data, timeout)
File "C:\ProgramData\Anaconda3\lib\urllib\request.py", line 525, in open
response = self._open(req, data)
File "C:\ProgramData\Anaconda3\lib\urllib\request.py", line 548, in _open
'unknown_open', req)
File "C:\ProgramData\Anaconda3\lib\urllib\request.py", line 503, in _call_chain
result = func(*args)
File "C:\ProgramData\Anaconda3\lib\urllib\request.py", line 1387, in unknown_open
raise URLError('unknown url type: %s' % type)
urllib.error.URLError: <urlopen error unknown url type: https>
[2019-02-10 14:24:01,679][ 3996][ERROR]: the maximum urlopen attempts have been reached
[2019-02-10 14:24:01,681][ 3996][ERROR]: caught unhandled excetion
Traceback (most recent call last):
File "C:\Users\Highwind\Desktop\ah\pydarkstar\logutils.py", line 45, in capture
yield
File "C:\Users\Highwind\Desktop\ah\bin\scrub.py", line 21, in <module>
pydarkstar.apps.scrub.run.main()
File "C:\Users\Highwind\Desktop\ah\pydarkstar\apps\scrub\run.py", line 35, in main
data = scrubber.scrub(force=True, threads=-1, urls=opts.urls, ids=opts.itemids)
File "C:\Users\Highwind\Desktop\ah\pydarkstar\scrubbing\ffxiah.py", line 63, in scrub
urls = self._get_category_urls()
File "C:\Users\Highwind\Desktop\ah\pydarkstar\scrubbing\ffxiah.py", line 194, in _get_category_urls
soup = self.soup(path)
File "C:\Users\Highwind\Desktop\ah\pydarkstar\scrubbing\scrubber.py", line 33, in soup
handle = urlopen(url)
File "C:\ProgramData\Anaconda3\lib\urllib\request.py", line 222, in urlopen
return opener.open(url, data, timeout)
File "C:\ProgramData\Anaconda3\lib\urllib\request.py", line 525, in open
response = self._open(req, data)
File "C:\ProgramData\Anaconda3\lib\urllib\request.py", line 548, in _open
'unknown_open', req)
File "C:\ProgramData\Anaconda3\lib\urllib\request.py", line 503, in _call_chain
result = func(*args)
File "C:\ProgramData\Anaconda3\lib\urllib\request.py", line 1387, in unknown_open
raise URLError('unknown url type: %s' % type)
urllib.error.URLError: <urlopen error unknown url type: https>
[2019-02-10 14:24:01,704][ 3996][INFO ]: exit
-
- Posts: 175
- Joined: Thu Mar 13, 2014 10:15 pm
- Location: Hawkesbury, Ontario, CANADA
Re: Python AH Buyer / Seller / ffxiah.com scrubber
He can't found this f**** file! Please help me..
(base) C:\Users\alexa\Documents\pydarkstar>python -m pydarkstar.apps.broker.run
[2019-09-08 10:21:42][ 9828][INFO ]: (0x1bab3cce908) Options: config = config.yaml
[2019-09-08 10:21:42][ 9828][INFO ]: (0x1bab3cce908) Options: verbose = False
[2019-09-08 10:21:42][ 9828][INFO ]: (0x1bab3cce908) Options: silent = False
[2019-09-08 10:21:42][ 9828][INFO ]: (0x1bab3cce908) Options: hostname = 127.0.0.1
[2019-09-08 10:21:42][ 9828][INFO ]: (0x1bab3cce908) Options: database = dspdb
[2019-09-08 10:21:42][ 9828][INFO ]: (0x1bab3cce908) Options: username = root
[2019-09-08 10:21:42][ 9828][INFO ]: (0x1bab3cce908) Options: password = ????
[2019-09-08 10:21:42][ 9828][INFO ]: (0x1bab3cce908) Options: fail = False
[2019-09-08 10:21:42][ 9828][INFO ]: (0x1bab3cce908) Options: data = []
[2019-09-08 10:21:42][ 9828][INFO ]: (0x1bab3cce908) Options: name = Zissou
[2019-09-08 10:21:42][ 9828][INFO ]: (0x1bab3cce908) Options: restock = 3600
[2019-09-08 10:21:42][ 9828][INFO ]: (0x1bab3cce908) Options: tick = 30
[2019-09-08 10:21:42][ 9828][ERROR]: caught unhandled excetion
Traceback (most recent call last):
File "C:\Users\alexa\Documents\pydarkstar\pydarkstar\logutils.py", line 45, in capture
yield
File "C:\Users\alexa\Documents\pydarkstar\pydarkstar\apps\broker\run.py", line 66, in <module>
main()
File "C:\Users\alexa\Documents\pydarkstar\pydarkstar\apps\broker\run.py", line 34, in main
idata = ItemList.from_csv(*opts.data)
File "C:\Users\alexa\Documents\pydarkstar\pydarkstar\itemlist.py", line 24, in from_csv
raise RuntimeError('missing item data CSV!')
RuntimeError: missing item data CSV!
[2019-09-08 10:21:42][ 9828][INFO ]: exit
(base) C:\Users\alexa\Documents\pydarkstar>python -m pydarkstar.apps.broker.run
[2019-09-08 10:21:42][ 9828][INFO ]: (0x1bab3cce908) Options: config = config.yaml
[2019-09-08 10:21:42][ 9828][INFO ]: (0x1bab3cce908) Options: verbose = False
[2019-09-08 10:21:42][ 9828][INFO ]: (0x1bab3cce908) Options: silent = False
[2019-09-08 10:21:42][ 9828][INFO ]: (0x1bab3cce908) Options: hostname = 127.0.0.1
[2019-09-08 10:21:42][ 9828][INFO ]: (0x1bab3cce908) Options: database = dspdb
[2019-09-08 10:21:42][ 9828][INFO ]: (0x1bab3cce908) Options: username = root
[2019-09-08 10:21:42][ 9828][INFO ]: (0x1bab3cce908) Options: password = ????
[2019-09-08 10:21:42][ 9828][INFO ]: (0x1bab3cce908) Options: fail = False
[2019-09-08 10:21:42][ 9828][INFO ]: (0x1bab3cce908) Options: data = []
[2019-09-08 10:21:42][ 9828][INFO ]: (0x1bab3cce908) Options: name = Zissou
[2019-09-08 10:21:42][ 9828][INFO ]: (0x1bab3cce908) Options: restock = 3600
[2019-09-08 10:21:42][ 9828][INFO ]: (0x1bab3cce908) Options: tick = 30
[2019-09-08 10:21:42][ 9828][ERROR]: caught unhandled excetion
Traceback (most recent call last):
File "C:\Users\alexa\Documents\pydarkstar\pydarkstar\logutils.py", line 45, in capture
yield
File "C:\Users\alexa\Documents\pydarkstar\pydarkstar\apps\broker\run.py", line 66, in <module>
main()
File "C:\Users\alexa\Documents\pydarkstar\pydarkstar\apps\broker\run.py", line 34, in main
idata = ItemList.from_csv(*opts.data)
File "C:\Users\alexa\Documents\pydarkstar\pydarkstar\itemlist.py", line 24, in from_csv
raise RuntimeError('missing item data CSV!')
RuntimeError: missing item data CSV!
[2019-09-08 10:21:42][ 9828][INFO ]: exit
-
- Posts: 175
- Joined: Thu Mar 13, 2014 10:15 pm
- Location: Hawkesbury, Ontario, CANADA
Re: Python AH Buyer / Seller / ffxiah.com scrubber
Ok that's work now but my auction house dont want see the price for each item. Any idea?Alexandre24 wrote: ↑Sun Sep 08, 2019 9:22 amHe can't found this f**** file! Please help me..
(base) C:\Users\alexa\Documents\pydarkstar>python -m pydarkstar.apps.broker.run
[2019-09-08 10:21:42][ 9828][INFO ]: (0x1bab3cce908) Options: config = config.yaml
[2019-09-08 10:21:42][ 9828][INFO ]: (0x1bab3cce908) Options: verbose = False
[2019-09-08 10:21:42][ 9828][INFO ]: (0x1bab3cce908) Options: silent = False
[2019-09-08 10:21:42][ 9828][INFO ]: (0x1bab3cce908) Options: hostname = 127.0.0.1
[2019-09-08 10:21:42][ 9828][INFO ]: (0x1bab3cce908) Options: database = dspdb
[2019-09-08 10:21:42][ 9828][INFO ]: (0x1bab3cce908) Options: username = root
[2019-09-08 10:21:42][ 9828][INFO ]: (0x1bab3cce908) Options: password = ????
[2019-09-08 10:21:42][ 9828][INFO ]: (0x1bab3cce908) Options: fail = False
[2019-09-08 10:21:42][ 9828][INFO ]: (0x1bab3cce908) Options: data = []
[2019-09-08 10:21:42][ 9828][INFO ]: (0x1bab3cce908) Options: name = Zissou
[2019-09-08 10:21:42][ 9828][INFO ]: (0x1bab3cce908) Options: restock = 3600
[2019-09-08 10:21:42][ 9828][INFO ]: (0x1bab3cce908) Options: tick = 30
[2019-09-08 10:21:42][ 9828][ERROR]: caught unhandled excetion
Traceback (most recent call last):
File "C:\Users\alexa\Documents\pydarkstar\pydarkstar\logutils.py", line 45, in capture
yield
File "C:\Users\alexa\Documents\pydarkstar\pydarkstar\apps\broker\run.py", line 66, in <module>
main()
File "C:\Users\alexa\Documents\pydarkstar\pydarkstar\apps\broker\run.py", line 34, in main
idata = ItemList.from_csv(*opts.data)
File "C:\Users\alexa\Documents\pydarkstar\pydarkstar\itemlist.py", line 24, in from_csv
raise RuntimeError('missing item data CSV!')
RuntimeError: missing item data CSV!
[2019-09-08 10:21:42][ 9828][INFO ]: exit
Re: Python AH Buyer / Seller / ffxiah.com scrubber
Looks like you are missing the CSV file?
-- Whasf