Cannot import NLTK stopwords after install · Issue #685 · heroku/heroku-buildpack-python

link管理

链接快照平台

输入网页链接，自动生成快照
标签化管理网页链接

相关文章推荐

爱旅游的荔枝 · 如何使用扫码SDK获取扫描成功之后的原图？ ...· 5 月前 ·

有情有义的番茄 · 姚明正式入选2016篮球名人堂_新闻_央视网 ...· 5 月前 ·

活泼的双杠 · SSL Enabled Managed ...· 7 月前 ·

爱吹牛的大脸猫 · Difficulties ...· 7 月前 ·

小胡子的牛腩 · 停止和启动 codespace - ...· 8 月前 ·

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement . We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

On a Mac using Python 3.6 and Anaconda. Have installed NLTK and used both command line and manual download of stop words. I see the stop word folder in NLTK folder, but cannot get it to load in my Jupyter notebook:

from nltk.corpus import stopwords

LookupError Traceback (most recent call last)
/anaconda3/lib/python3.6/site-packages/nltk/corpus/util.py in __load(self)
79 except LookupError as e:
---> 80 try: root = nltk.data.find('{}/{}'.format(self.subdir, zip_name))
81 except LookupError: raise e

/anaconda3/lib/python3.6/site-packages/nltk/data.py in find(resource_name, paths)
672 resource_not_found = '\n%s\n%s\n%s\n' % (sep, msg, sep)
--> 673 raise LookupError(resource_not_found)

LookupError:

Resource stopwords not found.
Please use the NLTK Downloader to obtain the resource:

import nltk
nltk.download('stopwords')

Searched in:
- '/Users/ksednew/nltk_data'
- '/usr/share/nltk_data'
- '/usr/local/share/nltk_data'
- '/usr/lib/nltk_data'
- '/usr/local/lib/nltk_data'
- '/anaconda3/nltk_data'
- '/anaconda3/lib/nltk_data'

During handling of the above exception, another exception occurred:

LookupError Traceback (most recent call last)
in ()
1 from nltk.corpus import stopwords
----> 2 stop = stopwords.words("english")
3 def stopwords(x):
4 x = re.sub("[^a-z\s]", " ", x.lower())
5 x = [w for w in x.split()

/anaconda3/lib/python3.6/site-packages/nltk/corpus/util.py in getattr (self, attr)
114 raise AttributeError("LazyCorpusLoader object has no attribute ' bases '")
--> 116 self.__load()
117 # This looks circular, but its not, since __load() changes our
118 # class to something new:

/anaconda3/lib/python3.6/site-packages/nltk/corpus/util.py in __load(self)
79 except LookupError as e:
80 try: root = nltk.data.find('{}/{}'.format(self.subdir, zip_name))
---> 81 except LookupError: raise e
83 # Load the corpus.

/anaconda3/lib/python3.6/site-packages/nltk/corpus/util.py in __load(self)
76 else:
77 try:
---> 78 root = nltk.data.find('{}/{}'.format(self.subdir, self.__name))
79 except LookupError as e:
80 try: root = nltk.data.find('{}/{}'.format(self.subdir, zip_name))

/anaconda3/lib/python3.6/site-packages/nltk/data.py in find(resource_name, paths)
671 sep = '*' * 70
672 resource_not_found = '\n%s\n%s\n%s\n' % (sep, msg, sep)
--> 673 raise LookupError(resource_not_found)

LookupError:

Resource stopwords not found.
Please use the NLTK Downloader to obtain the resource:

import nltk
nltk.download('stopwords')

I have tried placing copies the stopwords folder in various places (where it says it searched) as well as in the corpus folder and still no luck. Any ideas?

Interesting, I thought on my other Mac running the same versions, it had worked, but I may be wrong.

I will add that I was not able to download the Stopwords corpora because of issues involving my company's proxy:

nltk.download('stopwords')
[nltk_data] Error loading stopwords: <urlopen error [SSL:
[nltk_data] CERTIFICATE_VERIFY_FAILED] certificate verify failed
[nltk_data] (_ssl.c:833)>

If you have ideas for that, maybe that would solve it. I'm wondering if I'm just dropping the manually downloaded version in the wrong place.

Are there any updates to this? It seems no one every commented as to whether this is a problem with the third-party's support of Python 3.6 or something else.

Further, it sounds like this is a problem on your local machine @ksednew and I'm not certain how this is relevant to the buildpack.

I never figured this out. Still looking for support at my company. Will update if it’s solved.

On Thu, Jun 28, 2018 at 1:42 PM Ian Stapleton Cordasco < ***@***.***> wrote: Are there any updates to this? It seems no one every commented as to whether this is a problem with the third-party's support of Python 3.6 or something else. Further, it sounds like this is a problem on your local machine @ksednew < https://github.com/ksednew > and I'm not certain how this is relevant to the buildpack. You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub < #685 (comment) >, or mute the thread < https://github.com/notifications/unsubscribe-auth/AGnLSWlMqTxiAHvceyzv9xMzNQosI7qxks5uBRV6gaJpZM4TcX0o >

Hemants-MacBook-Pro:TextSummarizer khemant$ python2
Python 2.7.15 (v2.7.15:ca079a3ea3, Apr 29 2018, 20:59:26)
[GCC 4.2.1 Compatible Apple LLVM 6.0 (clang-600.0.57)] on darwin
Type "help", "copyright", "credits" or "license" for more information.

import nltk
from nltk.tokenize import sent_tokenize, word_tokenize
from nltk.corpus import stopwords
stop = set(stopwords.words('english'))
Traceback (most recent call last):
File "", line 1, in
File "/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/nltk/corpus/util.py", line 116, in getattr
self.__load()
File "/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/nltk/corpus/util.py", line 81, in __load
except LookupError: raise e
LookupError:

- '/usr/lib/nltk_data'
- '/usr/local/lib/nltk_data'
- '/Library/Frameworks/Python.framework/Versions/2.7/nltk_data'
- '/Library/Frameworks/Python.framework/Versions/2.7/share/nltk_data'
- '/Library/Frameworks/Python.framework/Versions/2.7/lib/nltk_data'

nltk.download('stopwords')
[nltk_data] Error loading stopwords: <urlopen error [SSL:
[nltk_data] CERTIFICATE_VERIFY_FAILED] certificate verify failed
[nltk_data] (_ssl.c:726)>
False

This is really surprising.

I have the same exact error with Python 3.6; i download the resources with nltk.download method. Then when i deploy get the following errors:

2019-01-15T05:23:23.773231+00:00 app[web.1]: ********************************************************************** 2019-01-15T05:23:23.773232+00:00 app[web.1]: Resource �[93mstopwords�[0m not found. 2019-01-15T05:23:23.773234+00:00 app[web.1]: Please use the NLTK Downloader to obtain the resource: 2019-01-15T05:23:23.773236+00:00 app[web.1]: 2019-01-15T05:23:23.773237+00:00 app[web.1]: �[31m>>> import nltk 2019-01-15T05:23:23.773239+00:00 app[web.1]: >>> nltk.download('stopwords') 2019-01-15T05:23:23.773241+00:00 app[web.1]: �[0m 2019-01-15T05:23:23.773242+00:00 app[web.1]: Searched in: 2019-01-15T05:23:23.773248+00:00 app[web.1]: - '/code/nltk_data' 2019-01-15T05:23:23.773249+00:00 app[web.1]: - '/usr/share/nltk_data' 2019-01-15T05:23:23.773251+00:00 app[web.1]: - '/usr/local/share/nltk_data' 2019-01-15T05:23:23.773252+00:00 app[web.1]: - '/usr/lib/nltk_data' 2019-01-15T05:23:23.773254+00:00 app[web.1]: - '/usr/local/lib/nltk_data' 2019-01-15T05:23:23.773255+00:00 app[web.1]: - '/usr/local/nltk_data' 2019-01-15T05:23:23.773257+00:00 app[web.1]: - '/usr/local/share/nltk_data' 2019-01-15T05:23:23.773259+00:00 app[web.1]: - '/usr/local/lib/nltk_data' 2019-01-15T05:23:23.773260+00:00 app[web.1]: ********************************************************************** 2019-01-15T05:23:23.773261+00:00 app[web.1]:

Never figured it out sorry!

On Tue, Jun 16, 2020 at 7:06 AM Nikita Lalwani ***@***.***> wrote: @ksednew < https://github.com/ksednew > did you get any help with issue, I'm having the same with my linux os You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub < #685 (comment) >, or unsubscribe < https://github.com/notifications/unsubscribe-auth/ABU4WSLKKN2XRNOSB3Y75I3RW5G4VANCNFSM4E3RPUUA >

I am using below code to use stopwords through jupyter hub, I have hosted jupyter hub on AWS DLAMI Linux server.

python3 -m nltk.downloader stopwords
python3 -m nltk.downloader words
python3 -m nltk.downloader punkt
from nltk.corpus import words
from nltk.corpus import stopwords

python3

from nltk.corpus import stopwords
stop_words = set(stopwords.words("english"))
print(stop_words)
This works fine while running in python terminal.

But when I try below in Jupyternotebook its failing with error. Resource stopwords not found.
Please use the NLTK Downloader to obtain the resource:

$python3

import nltk
nltk.download('stopwords') [nltk_data] Downloading package stopwords to /root/nltk_data... [nltk_data] Package stopwords is already up-to-date!

Well, I still have the same problem. But one way to work around this was to download it to my local machine and then via Dockerfile copy that to my container.
This solved the problem to Heroku.

Regarding the problem, I suspect that in the pushing process, the content is downloaded and saved in a different path. That's the reason why the container couldn't find the nltk_data.

I will investigate this and if I found a better solution I will update it.

Experienced same error while working on google colab

run the command "nltk.download('stopwords')"in a separate cell just above the cell in which error occured.. i was facing the same issue in the colab but its running now.. after doing this.

it is working thank you.

i also facing the same issue if any one know the solution please let me know

LookupError Traceback (most recent call last)
File ~\anaconda3\lib\site-packages\nltk\corpus\util.py:84, in LazyCorpusLoader.__load(self)
83 try:
---> 84 root = nltk.data.find(f"{self.subdir}/{zip_name}")
85 except LookupError:

File ~\anaconda3\lib\site-packages\nltk\data.py:583, in find(resource_name, paths)
582 resource_not_found = f"\n{sep}\n{msg}\n{sep}\n"
--> 583 raise LookupError(resource_not_found)

LookupError:

Resource stopwords not found.
Please use the NLTK Downloader to obtain the resource:

import nltk
nltk.download('stopwords')

For more information see: https://www.nltk.org/data.html

Attempted to load corpora/stopwords.zip/stopwords/

Searched in:
- 'C:\Users\Abhishek Pandey/nltk_data'
- 'C:\Users\Abhishek Pandey\anaconda3\nltk_data'
- 'C:\Users\Abhishek Pandey\anaconda3\share\nltk_data'
- 'C:\Users\Abhishek Pandey\anaconda3\lib\nltk_data'
- 'C:\Users\Abhishek Pandey\AppData\Roaming\nltk_data'
- 'C:\nltk_data'
- 'D:\nltk_data'
- 'E:\nltk_data'
- 'path_to_nltk_data'

During handling of the above exception, another exception occurred:

LookupError Traceback (most recent call last)
Input In [20], in <cell line: 1>()
----> 1 sw = stopwords.words('english')

File ~\anaconda3\lib\site-packages\nltk\corpus\util.py:121, in LazyCorpusLoader. getattr (self, attr)
118 if attr == " bases ":
119 raise AttributeError("LazyCorpusLoader object has no attribute ' bases '")
--> 121 self.__load()
122 # This looks circular, but its not, since __load() changes our
123 # class to something new:
124 return getattr(self, attr)

File ~\anaconda3\lib\site-packages\nltk\corpus\util.py:86, in LazyCorpusLoader.__load(self)
84 root = nltk.data.find(f"{self.subdir}/{zip_name}")
85 except LookupError:
---> 86 raise e
88 # Load the corpus.
89 corpus = self.__reader_cls(root, *self.__args, **self.__kwargs)

File ~\anaconda3\lib\site-packages\nltk\corpus\util.py:81, in LazyCorpusLoader.__load(self)
79 else:
80 try:
---> 81 root = nltk.data.find(f"{self.subdir}/{self.__name}")
82 except LookupError as e:
83 try:

File ~\anaconda3\lib\site-packages\nltk\data.py:583, in find(resource_name, paths)
581 sep = "*" * 70
582 resource_not_found = f"\n{sep}\n{msg}\n{sep}\n"
--> 583 raise LookupError(resource_not_found)

LookupError:

Resource stopwords not found.
Please use the NLTK Downloader to obtain the resource:

import nltk
nltk.download('stopwords')

For more information see: https://www.nltk.org/data.html

Attempted to load corpora/stopwords

This buildpack does not use Anaconda, and does not run on Windows - so has nothing to do with the more recent issues posted to this thread.

If you're having issues with NLTK or Anaconda, please first read their docs and failing that, follow any support/issue reporting processes they document instead:
https://www.nltk.org/
https://www.anaconda.com/

If someone has an issue with using NLTK on Heroku during a Heroku build (not locally), please open a support ticket ( https://help.heroku.com ).

I'm locking this issue now, since otherwise people finding this thread via search engines are just going to keep commenting here even though it has nothing to do with their problem.