I have developed a Twitter bot that scraps charts data from spotifycharts.com
Bot : https://twitter.com/kcharts_india
but seems like scrapping data has been restricted from the server I have been given to use.
Running from a personal laptop works as I am able to scrap and push data.
The bot has been made after being reviewed by the Twitter community to not be counted as spam.
Can I know what procedure should I follow from server should to have this whitelisted ?
As I see another user's website needed to be whitelisted,
https://www.pythonanywhere.com/forums/topic/12714/
[formatted by admin]
ProxyErrorat/offender/dashboardHTTPSConnectionPool(host='webapps.doc.state.nc.us',port=443):Maxretriesexceededwithurl:/opi/offendersearch.do?method=list&searchLastName=patel&searchFirstName=&searchMiddleName=&searchOffenderId=&searchGender=&searchRace=&searchDOB=&searchDOBRange=ðnicity=&ageMinimum=&ageMaximum=&page=1(CausedbyProxyError('Cannot connect to proxy.',OSError('Tunnel connection failed: 403 Forbidden')))
Please whitelist my url
Here is url data policy : https://webapps.doc.state.nc.us/opi/privacy.do
Hello Sir/Mam, I request you to please whitelist my API URL.
The error seems as follows-
HTTPSConnectionPool(host='restapismtp.herokuapp.com', port=443)
Thank You!
Please can you whitelist this api for me? I'm making a simple daily cat pic mail out using: https://api.thecatapi.com/v1/images/search
Hope you can help, the world needs more cat pics.
Hi can you whitelist this url "www.cnbc.com"
I found the API provided on rapidapi.com. Is it possible to use that one?
API: https://rapidapi.com/apidojo/api/cnbc
API docs: https://docs.rapidapi.com
Hi fjl @PythonAnywhere. In the quick start guide on rapid api's docs page, (https://docs.rapidapi.com/docs/consumer-quick-start-guide#api-listing-overview), they mention that the individual documentation for each api is mentioned on Endpoints tab in the API's listing page itself.
So this would be the middle section on the page of the API link that I sent before (copied here again: https://rapidapi.com/apidojo/api/cnbc). For reference, I've included the link to the example image they showed on the guide page (https://files.readme.io/dd503b3-translate.png). Hope this helps.
Hi could you please whitelist the following link:storefront-prod.nl.picnicinternational.com
The link to the docs: https://github.com/MikeBrink/python-picnic-api
Thankyou!
To the Pythonanywhere
I would like to request add below link as whitelist as its API documentation is publicly available.
API Reference:
https://filestack-python.readthedocs.io/en/latest/api_reference.html
Full Documentation:
https://www.filestack.com/docs/
@hmalik Hi, thanks for addition but i still get the below error while running my app:
requests.exceptions.ProxyError: HTTPSConnectionPool(host='upload.filestackapi.com', port=443): Max retries exceeded with url: /multipart/start (Caused by ProxyError('Cannot connect to proxy.', OSError('Tunnel connection failed: 403 Forbidden')))
i dont know if this is the correct form you added filestackapi.com for this website filestack.com or maybe there is another problem although as i checked your whitelist in link below filestack.com was not added there.
https://www.pythonanywhere.com/whitelist/
kindly check the issue and thanks for the feedback
@hemayat -- we need to see some documentation on the filestackcontent that mentions that hostname.
@Alevaroz -- Send us a link to the API documentation and we'll consider it for the whitelist.
@giles it's been third time I'm sharing full detail and docs once again here it is the reference for api to the endpoint https://cdn.filestackcontent.com/ which mentioned the above host name you can find out in the link below.
https://www.filestack.com/docs/delivery/cdn/
@KraKoff
If you would like us to whitelist https://wax.atomichub.io/, please send us the API documentation which lists this api endpoint.
The documentation sent does not detail the endpoint.
Hi could you please whitelist https://athcoinindex.com/coin/binancecoin ?
Thank you and also I would also love to know if someone has a paid account will pythonanywhere algoritm stop asking for whitelisting of websites?
@developermo
Hi, If you would like us to whitelist https://athcoinindex.com/coin/binancecoin, please send us the API documentation which lists the api endpoint.
Please note we can only whitelist sites with an official public API.
Please see the url below for additional information:
https://help.pythonanywhere.com/pages/RequestingWhitelistAdditions/
Hi could you please whitelist the following link: https://ocr.asprise.com/api/v1/receipt
The API Document is here - https://asprise.com/ocr/api/docs/html/receipt-ocr.html
Thanks!
@nonbiasedorg
In regards to your request to whitelist the above endpoint, please note we need public documentation stating the hostname for the endpoint.
We are not able to whitelist the domain based on the provided information.
got error:
Traceback (most recent call last):
File "/home/amiya000/TheScalper/Testing.py", line 7, in <module>
sas = AlphaTrade(login_id=login_id, password=password, twofa=twofa)
File "/home/amiya000/.local/lib/python3.10/site-packages/alphatrade/alphatrade.py", line 238, in init
if not self.__is_token_valid():
File "/home/amiya000/.local/lib/python3.10/site-packages/alphatrade/alphatrade.py", line 278, in __is_token_valid
resp = self.reqsession.get(profile_url, headers=self.__headers)
File "/usr/local/lib/python3.10/site-packages/requests/sessions.py", line 600, in get
return self.request("GET", url, kwargs)
File "/usr/local/lib/python3.10/site-packages/requests/sessions.py", line 587, in request
resp = self.send(prep, send_kwargs)
File "/usr/local/lib/python3.10/site-packages/requests/sessions.py", line 701, in send
r = adapter.send(request, **kwargs)
File "/usr/local/lib/python3.10/site-packages/requests/adapters.py", line 559, in send
raise ProxyError(e, request=request)
requests.exceptions.ProxyError: HTTPSConnectionPool(host='alpha.sasonline.in', port=443): Max retries exceeded with url: /api/v2/profile (Caused by ProxyError('Cannot connect to proxy.', OSError('Tunnel conne
ction failed: 403 Forbidden')))
Hi, I have the same error stated like above. Is my api ok? Can you check? https://api.npoint.io/430bc502f1f18c701262
I created json storage bin from https://www.npoint.io/
Is my error problem caused by it is not in the whitelist?
@amiya000
In regards to your request above, please note we need public documentation stating the hostname for the endpoint you would like us to consider.
We are not able to whitelist the domain based on the provided information, as it is unofficial documentation.
@novimuse
If you would like a domain to be considered for the whitelist , please send us a link to the API documentation.
Please note we can only whitelist sites with an official public API.
I requests all subdomains of wasteof.money to be unblocked. The creator says he is fine with it being used on PythonAnywhere. You can see him saying it here: https://beta.wasteof.money/users/jeffalo/wall/633ca0288b29a1398d608379. Not sure if this counts, but the docs I gave previously were the only ones that exist. wasteof.money is a social media.
Hello guys and girls of "pythonanywhere.com" team!
Pleas add to your "white list" this API : https://github.com/flyingrub/scdl
The API based on this documentation : https://developers.soundcloud.com/docs/api/guide
Best regards,
Hi pythonanywhere.com team, could you please whitelist this url for me - https://coji-code.com/?
Here is the github link for my API: https://github.com/maxfyk/coji-api.
To The PA Team,
Hello and thanks for the service i had an issue regarding my app weeks ago and i requested to whitelist some domains and you did thank you, but still my app is not working and i figured out that one other domain needs to be whitelisted.
below sites are already whitelisted :
cdn.filestackcontent.com
www.filestackapi.com
the endpoint which cause error is this (upload.filestackapi.com) which is subdomain of above site so kindly whitelist this endpoint for me. Thank You so much
Note: as i checked the public documentation of the related sites i did not find this endpoint there though i cant share the exact page related to this endpoint but this is the endpoint which cause the error in my app and i am using the same website service not any other, i am using python SDK of that site maybe they forgot to write about this endpoint.
Public Docs & API reference:
https://www.filestack.com/docs/
https://filestack-python.readthedocs.io/en/latest/
looking forward to your reply, BR
@ivanilla
Hi, can you please confirm which endpoint you would like us to consider adding to the whitelist?
Please note we can only whitelist sites with an official public API.
@maxfyk
Please note we are unable to view the link which has been sent. Please note we can only whitelist sites with an official public API.
Please also see the url below for additional information:
https://help.pythonanywhere.com/pages/RequestingWhitelistAdditions/
@hemayat
Thank you for your message.
We would only be able to consider the requested endpoint, if you are able to send us us a link to the API documentation which documents the endpoint.
Otherwise we are not able to add the requested endpoint to the whitelist.
requests.exceptions.ProxyError: HTTPSConnectionPool(host='backend.craiyon.com', port=443): Max retries exceeded with url: /generate (Caused by ProxyError('Cannot connect to proxy.', OSError('Tunnel connection failed: 403 Forbidden')))
@ElonNLP
If you would like the above domain to be considered for the whitelist , please send us a link to the API documentation.
Please note we need public documentation stating the hostname for the endpoint.
@Pythonanywhere Could you please whitelist the two open source licenses texts urls:
https://opensource.org/licenses
https://spdx.org/licenses
Thank you
@hmalik Dear,
Thanks for rapid supporting all the time.
related to my last request with you I contacted the support team of the company which I use their API they found and added the endpoint.
@Sihem -- we can only whitelist public APIs. If that site has one, please provide a line to the API documentation.
@hemayat -- a colleague is looking into this and will be in touch shortly.
Please white list below api since i am getting the error and not able to proceed with my application.
API - apix.stocksdeveloper.in
Error - raise ProxyError(e, request=request)
requests.exceptions.ProxyError: HTTPSConnectionPool(host='apix.stocksdeveloper.in', port=443): Max retries exceeded with url: /trading/placeRegularOrder (Caused by ProxyError('Cannot connect to proxy.', OSError('Tunnel connection failed: 403 Forbidden')))
Official Website - https://stocksdeveloper.in/
hi can you add tradingview in whitelist, i really want it please
docs: https://python-tradingview-ta.readthedocs.io/en/latest/
---- https://pypi.org/project/tradingview-ta/ ----- https://tvdb.brianthe.dev/
@aminsharif
Hi, Thank you for your message.
Can you please confirm the endpoint which you are requesting we consider for the whitelist?
Please also note we need public documentation stating the hostname for the endpoint, we are not able to whitelist the domain based on the provided information.
@PythonAnywhere
Thank you for your feedback, here in below I have mentioned the links regarding the Tradingview.com website. This is a REST API for brokers. The version of this API is 1.3.30.
Could you please confirm if the information I have provided is covering your questions.
https://www.tradingview.com/rest-api-spec/
I would appreciate it if you could add the website https://www.call2all.co.il
The link to the documents is https://docs.google.com/document/d/1ln2j0Nhe0VO4Rt6fFquaXziSq-IIr9I_SE_R35WXe-k/mobilebasic#:~:text=https%3A//www.call2all.co.il/ym/api/%3CWebServiceName%3E%5B%3Fp1%3Dv1%5B%26p2%3Dv2...%5D%5D
and the website https://www.hamichlol.org.il
https://en.wikipedia.org/api/rest_v1/
This is a wiki as you can see
https://www.hamichlol.org.il/w/api.php?format=json&action=query&prop=extracts&exintro&explaintext&redirects=1&titles=Stack%20Overflow
@yemot
In regards to both your requests, if the links sent are the official documentations can you please send us direct links from the actual websites linking us to those documentations?
Please note we can only whitelist sites with an official public API.
Regarding the first, these are the official documents
And the second is a Wikipedia page
On both sites you can see the word API in the URL
https://call2all.co.il/ym/api/GetIncomingCalls
'https://docs.zenoti.com/reference/list-all-centers' this API doc , I am getting the error of max retries exceeded.....
while using zenoti , please whitelist this API.
I am hitting this two API :
1) https://api.zenoti.com/v1/centers
2) https://api.zenoti.com/v1/centers/center_id/employees
@yemot
Thank you for your reply. Please note this url is not a link to the official documentation and i am unable to view the documentation: https://call2all.co.il/ym/api/GetIncomingCalls , and the previous link also states that the document is a draft.
Please note the second link https://www.call2all.co.il/f2 does not seem to be working.
If you would still like us to consider your request, please send us a direct link to the domain you wish for us to consider and also send us documentation directly on the domain or please send us direct links from the actual websites linking us to those documentations.
requests.exceptions.ProxyError: HTTPSConnectionPool(host='bitcoinexplorer.org', port=443): Max retries exceeded with url: /api/blocks/tip/height (C
aused by ProxyError('Cannot connect to proxy.', OSError('Tunnel connection failed: 403 Forbidden')))
can you whitelist the following domain: https://www.aliexpress.com/
Here the link to API docs: https://developers.aliexpress.com/en/doc.htm?docId=121124&docType=1
Could you please let me know?
thanks
@jeevarko Thank you for your reply. Please note before we are able to proceed with your request i require you to confirm the endpoint you would like us to consider adding. Once you have provided us with confirmation in regards to the endpoint, we will be able to proceed with your request. Looking at the message you previously sent it looks like you are trying to connect to bitcoinexplorer.org, is that the endpoint you would are requesting we consider?
hi please add this page plis, i need run my app :(
https://api.cne.cl/apidocs/
https://api.cne.cl/
Thanks
requests.exceptions.SSLError: HTTPSConnectionPool(host='iss.moex.com', port=443): Max retries exceeded with url: /iss/securities/RU000A0J
XSD3.csv (Caused by SSLError(SSLEOFError(8, 'EOF occurred in violation of protocol (_ssl.c:997)')))
What happen? Last week code working.
Site iss.moex.com in Whitelisted site.
requests.exceptions.SSLError: HTTPSConnectionPool(host='iss.moex.com', port=443): Max retries exceeded with url: /iss/securities/RU000A0J XSD3.csv (Caused by SSLError(SSLEOFError(8, 'EOF occurred in violation of protocol (_ssl.c:997)')))
What happen? Last week code working.
Site iss.moex.com in Whitelisted site.
Local in pc code working. Api site moex.com working.
Getting tunnel connection error on the whoisxmlapi.
This is the endpoint: https://whois.whoisxmlapi.com/documentation/making-requests -
This is the error: requests.exceptions.ProxyError: HTTPSConnectionPool(host='www.whoisxmlapi.com', port=443): Max retries exceeded with url: /whoisserver/WhoisService?apiKey=at_AQtwU1QNmkrhPggKKQJWvOmoEa0j7&domainName=charter.net&outputFormat=JSON (Caused by ProxyError('Cannot connect to proxy.', OSError('Tunnel connection failed: 403 Forbidden')))
Hi, I am getting this same error.
I wrote a simple scraper to the host host='www.nintendo.com' and am also receiving the same error. I am scraping the url https://www.nintendo.com/store/products/boomerang-fu-switch/ to see when this game goes on sale ... just because I wanted to practice.
Can I also add this to the whitelist?
This is the error : Max retries exceeded with url: /store/products/boomerang-fu-switch/ (Caused by ProxyError('Cannot connect to proxy.', OSError('Tunnel connection failed: 403 Forbidden')))
Please whitelist the following site
https://www.prothomalo.com/
This is a legit site and a national news portal.
No API documentation. But some of us badly need the scraping ability through this site.
@fjl It turns out that way. But he really needs me, but not only me, many. I very quickly studied this api and implemented it in a bot. But I didn’t know that it wasn’t on the white list.. I beg you to add it, it’s not some kind of malicious API! It helps to run a minecraft server through a telegram bot
Hello,
I have a error.
requests.exceptions.ProxyError: HTTPSConnectionPool(host='api.coolsms.co.kr', port=443): Max retries exceeded with url: /messages/v4/groups (Caused by ProxyError('Ca
nnot connect to proxy.', OSError('Tunnel connection failed: 403 Forbidden')))
I think it is not the whitelist
domain: api.coolsms.co.kr
document: https://github.com/coolsms/coolsms-python
(sorry, it is only Korean)
requests.exceptions.ProxyError: HTTPSConnectionPool(host='api.roboflow.com', port=443): Max retries exceeded with ur
l: /?api_key=nNzWIrin8W6VcB4sbmBn (Caused by ProxyError('Cannot connect to proxy.', OSError('Tunnel connection faile
d: 403 Forbidden')))
hi can you whitelist this url? thank you
requests.exceptions.ProxyError: HTTPSConnectionPool(host='www.racingpost.com', port=443): Max retries exceeded with url: /racecards/tomorrow (Caused by ProxyError('Unable to connect to proxy', OSError('Tunnel connection failed: 403 Forbidden')))
I have following issue. can you whitelist this url please. www.racingpost.com
Hi, can you whitelist "requests.exceptions.ProxyError: HTTPSConnectionPool(host='app.fixie.ai', port=443): Max retries exceeded with url: /api/agents/bejanvadim/OrchKB (Caused by ProxyError('Unable to connect to proxy', OSError('Tunnel connection failed: 403 Forbidden')))"
Here is documentation to their API https://docs.fixie.ai/python-client-api/
I can't even imagine being an actual human who has to read and moderate this forum, specifically any thread like this one. Great gravy, Marie, people.. RTFM and if you can't do that much, at least read the last post or two. You've got PA's mod bot spamming the same thing over and over so much it's gonna get rate limited by the AI overlords.
Hello fjl @PythonAnywhere. I hope you can add the "https://test-payment.momo.vn/" to the whitelist. I have integrated Momo's partner payment method and I have referenced it at: (https://developers.momo.vn/v3/docs/payment/api/collection-link/). I found detailed information about the it here: (https://developers.momo.vn/v3/docs/payment/onboarding/integration-process/). Hope this can help
This is the error: HTTPSConnectionPool(host='test-payment.momo.vn', port=443): Max retries exceeded with url: /v2/gateway/api/create (Caused by ProxyError('Cannot connect to proxy.', OSError('Tunnel connection failed: 403 Forbidden')))
Sorry, we have had to rate-limit your feedback sending. Please try again in a few moments...
Thanks for the feedback! Our tireless devs will get back to you soon.
