Ubuntu16.04python3.6下安裝Scrapy報錯解決辦法
阿新 • • 發佈：2019-01-07
首先安裝scrapy是沒問題的，但是當匯入模組時就報錯了，具體如下：
root@ubuntu:/usr/bin# pip3 install scrapyCollecting scrapy
Downloading https://files.pythonhosted.org/packages/db/9c/cb15b2dc6003a805afd21b9b396e0e965800765b51da72fe17cf340b9be2/Scrapy-1.5.0-py2.py3-none-any.whl (251kB)
100% |████████████████████████████████| 256kB 22kB/s
Collecting cssselect>=0.9 貌似安裝成功了，來測試一下：
root@ubuntu:/usr/bin# python
Python 3.6.5 (default, May 12 2018, 19:37:55)
[GCC 5.4.0 20160609] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import scrapy
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
File "/usr/bin/python3.6/lib/python3.6/site-packages/scrapy/__init__.py", line 27, in <module>
from . import _monkeypatches
File "/usr/bin/python3.6/lib/python3.6/site-packages/scrapy/_monkeypatches.py", line 20, in <module>
import twisted.persisted.styles # NOQA
ModuleNotFoundError: No module named 'twisted.persisted'
>>>
報錯了，ModuleNotFoundError: No module named ‘twisted.persisted’
pip3 install twisted==13.1.0執行上述命令，還是報錯了。。。
**Could not find a version that satisfies the requirement Twisted>=13.1.0 (from Scrapy) (from versions: )
No matching distribution found for Twisted>=13.1.0 (from Scrapy)**
網上查到原因說是沒有安裝Twisted，於是乎執行了如下命令
wget https://pypi.python.org/packages/source/T/Twisted/Twisted-15.2.1.tar.bz2
tar -xjvf Twisted-15.2.1.tar.bz2
cd Twisted-15.2.1
python setup.py install成功後，進入python匯入scrapy還是提示如上錯誤，原因還是Twisted版本問題，之前使用的是13.1.0,後面安裝了15.2.1版本，還是有問題，於是乎使用高版本的17.1.0Twisted即可.安裝包連線如下所示，使用Ubuntu命令即可安全下載：https://twistedmatrix.com/Releases/Twisted/17.1/Twisted-17.1.0.tar.bz2
[email protected]:/usr#wget https://twistedmatrix.com/Releases/Twisted/17.1/Twisted-17.1.0.tar.bz2
[email protected]:/usr#tar -jxvf Twisted-17.1.0.tar.bz2
[email protected]:/usr#cd Twisted-17.1.0
[email protected]:/usr#python setup.py install
[email protected]:/usr#cd ..
[email protected]:/usr# pip3 install scrapy
Requirement already satisfied: scrapy in ./bin/python3.6/lib/python3.6/site-packages (1.5.0)
Requirement already satisfied: pyOpenSSL in ./bin/python3.6/lib/python3.6/site-packages (from scrapy) (17.5.0)
Requirement already satisfied: cssselect>=0.9 in ./bin/python3.6/lib/python3.6/site-packages (from scrapy) (1.0.3)
Requirement already satisfied: six>=1.5.2 in ./bin/python3.6/lib/python3.6/site-packages (from scrapy) (1.11.0)
Requirement already satisfied: PyDispatcher>=2.0.5 in ./bin/python3.6/lib/python3.6/site-packages (from scrapy) (2.0.5)
Requirement already satisfied: lxml in ./bin/python3.6/lib/python3.6/site-packages (from scrapy) (4.2.1)
Requirement already satisfied: queuelib in ./bin/python3.6/lib/python3.6/site-packages (from scrapy) (1.5.0)
Requirement already satisfied: service-identity in ./bin/python3.6/lib/python3.6/site-packages (from scrapy) (17.0.0)
Requirement already satisfied: w3lib>=1.17.0 in ./bin/python3.6/lib/python3.6/site-packages (from scrapy) (1.19.0)
Requirement already satisfied: Twisted>=13.1.0 in ./bin/python3.6/lib/python3.6/site-packages/Twisted-17.1.0-py3.6-linux-x86_64.egg (from scrapy) (17.1.0)
Requirement already satisfied: parsel>=1.1 in ./bin/python3.6/lib/python3.6/site-packages (from scrapy) (1.4.0)
Requirement already satisfied: cryptography>=2.1.4 in ./bin/python3.6/lib/python3.6/site-packages (from pyOpenSSL->scrapy) (2.2.2)
Requirement already satisfied: attrs in ./bin/python3.6/lib/python3.6/site-packages (from service-identity->scrapy) (18.1.0)
Requirement already satisfied: pyasn1-modules in ./bin/python3.6/lib/python3.6/site-packages (from service-identity->scrapy) (0.2.1)
Requirement already satisfied: pyasn1 in ./bin/python3.6/lib/python3.6/site-packages (from service-identity->scrapy) (0.4.2)
Requirement already satisfied: zope.interface>=4.0.2 in ./bin/python3.6/lib/python3.6/site-packages/zope.interface-4.5.0-py3.6-linux-x86_64.egg (from Twisted>=13.1.0->scrapy) (4.5.0)
Requirement already satisfied: constantly>=15.1 in ./bin/python3.6/lib/python3.6/site-packages/constantly-15.1.0-py3.6.egg (from Twisted>=13.1.0->scrapy) (15.1.0)
Requirement already satisfied: incremental>=16.10.1 in ./Twisted-17.1.0/.eggs/incremental-17.5.0-py3.6.egg (from Twisted>=13.1.0->scrapy) (17.5.0)
Requirement already satisfied: Automat>=0.3.0 in ./bin/python3.6/lib/python3.6/site-packages/Automat-0.6.0-py3.6.egg (from Twisted>=13.1.0->scrapy) (0.6.0)
Requirement already satisfied: cffi>=1.7; platform_python_implementation != "PyPy" in ./bin/python3.6/lib/python3.6/site-packages (from cryptography>=2.1.4->pyOpenSSL->scrapy) (1.11.5)
Requirement already satisfied: idna>=2.1 in ./bin/python3.6/lib/python3.6/site-packages (from cryptography>=2.1.4->pyOpenSSL->scrapy) (2.6)
Requirement already satisfied: asn1crypto>=0.21.0 in ./bin/python3.6/lib/python3.6/site-packages (from cryptography>=2.1.4->pyOpenSSL->scrapy) (0.24.0)
Requirement already satisfied: setuptools in ./bin/python3.6/lib/python3.6/site-packages (from zope.interface>=4.0.2->Twisted>=13.1.0->scrapy) (39.0.1)
Requirement already satisfied: pycparser in ./bin/python3.6/lib/python3.6/site-packages (from cffi>=1.7; platform_python_implementation != "PyPy"->cryptography>=2.1.4->pyOpenSSL->scrapy) (2.18)
[email protected]:/usr# python
Python 3.6.5 (default, May 12 2018, 19:37:55)
[GCC 5.4.0 20160609] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import scrapy
>>>如上所示，終於將scrapy安裝成功了，實在不容易啊！