Skip to content

S
scrapy

looyolo / scrapy
与 Fork 源项目一致

从无法访问的项目Fork

通知 2
Star 0
Fork 0
S
scrapy

前往新版Gitcode，体验更适合开发者的 AI 搜索 >>

提交 098d892c 编写于 作者: P Pablo Hoffman
浏览文件
操作

simplified installation guide to only mention pip/easy_install mechanism, and... 

simplified installation guide to only mention pip/easy_install mechanism, and provide hints for Windows users
上级 6217f108
隐藏空白更改
内联 并排
Showing with 43 addition and 164 deletion
docs/intro/install.rst
浏览文件 @ 098d892c
......@@ -4,168 +4,78 @@
Installation guide
==================
This document describes how to install Scrapy on Linux, Windows and Mac OS X.
.. _intro-install-requirements:
Requirements
============
* `Python`_ 2.6, 2.7 (3.x is not yet supported)
* `Twisted`_ 8.0 or above (Windows users: you'll need to install
`Zope.Interface`_ and maybe `pywin32`_ because of `this Twisted bug`_)
* `w3lib`_
* `lxml`_ or `libxml2`_ (if using `libxml2`_, version 2.6.28 or above is highly recommended)
* `pyopenssl <http://pyopenssl.sourceforge.net>`_ (for HTTPS support. Optional,
but highly recommended)
.. _intro-install-python:
Install Python
Pre-requisites
==============
First, you need to install Python, if you haven't done so already.
The installation steps assume that you have the following things installed:
Scrapy works with Python 2.6 or 2.7, which you can get at
http://www.python.org/download/
* Python 2.6 or 2.7
* OpenSSL. This comes preinstalled in all operating systems except Windows (see :ref:`intro-install-platform-notes`)
* `pip`_ or `easy_install`_ Python package managers
.. seealso:: :ref:`faq-python-versions`
Installing Scrapy
=================
.. highlight:: sh
You can install Scrapy using easy_install or pip (which is the canonical way to
distribute and install Python packages).
.. _intro-install-scrapy:
Install Scrapy
==============
.. note:: Check :ref:`intro-install-platform-notes` first.
There are many ways to install Scrapy. Pick the one you feel more comfortable
with.
To install using pip::
* :ref:`intro-install-release` (requires installing dependencies separately)
* :ref:`intro-install-easy` (automatically installs dependencies)
* :ref:`intro-install-pip` (automatically installs dependencies)
.. _intro-install-release:
Download and install an official release
----------------------------------------
Download Scrapy from the `Download page`_. Scrapy is distributed in two ways: a
source code tarball (for Unix and Mac OS X systems) and a Windows installer
(for Windows). If you downloaded the tarball, you can install it as any Python
package using ``setup.py``::
pip install Scrapy
tar zxf Scrapy-X.X.X.tar.gz
cd Scrapy-X.X.X
python setup.py install
To install using easy_install::
If you downloaded the Windows installer, just run it.
easy_install Scrapy
.. warning:: In Windows, you may need to add the ``C:\Python25\Scripts`` (or
``C:\Python26\Scripts``) folder to the system path by adding that directory
to the ``PATH`` environment variable from the `Control Panel`_.
.. _intro-install-platform-notes:
.. _Download page: http://scrapy.org/download/
Platform specific installation notes
====================================
.. _intro-install-easy:
Windows
-------
Installing with ``easy_install``
--------------------------------
After installing Python, follow these steps before installing Scrapy:
You can install Scrapy using setuptools_'s ``easy_install`` with::
* add the ``C:\python27\Scripts`` and ``C:\python27`` folders to the system
path by adding those directories to the ``PATH`` environment variable from
the `Control Panel`_.
easy_install -U Scrapy
* you will need to install OpenSSL by following these steps:
.. _intro-install-pip:
1. go to `this page <http://slproweb.com/products/Win32OpenSSL.html>`_
Installing with `pip`_
----------------------
2. download Visual C++ 2008 redistributables for your Windows and architecture
You can install Scrapy using `pip`_ with::
3. download OpenSSL for your Windows and architecture (the regular version, not the light one)
pip install Scrapy
4. add the ``c:\openssl-win32\bin`` (or similar) directory to your ``PATH``, the same way you added ``python27`` in the first step`` in the first step
.. _intro-install-platforms:
* you may need to install `pywin32`_ because of `this Twisted bug`_
Platform specific instructions
==============================
* some binary packages that Scrapy depends on (like Twisted, lxml and pyOpenSSL) require a compiler available to install, and fail if you don't have Visual Studio installed. You can find Windows installers for those in following links. Make sure you respect your Python version, and Windows architecture.
Linux
-----
* pywin32: http://sourceforge.net/projects/pywin32/files/
* Twisted: http://twistedmatrix.com/trac/wiki/Downloads
* zope.interface: download the egg from `this page <http://pypi.python.org/pypi/zope.interface>`_ and install it by running ``easy_install file.egg``
* lxml: http://pypi.python.org/pypi/lxml/
* pyOpenSSL: https://launchpad.net/pyopenssl
Ubuntu 9.10 or above
~~~~~~~~~~~~~~~~~~~~
If you're running Ubuntu 9.10 (or above), use the official :ref:`Ubuntu
Packages <topics-ubuntu>`, which already solve all dependencies for you and are
continuously updated with the latest bug fixes.
Debian or Ubuntu (9.04 or older)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
If you're running Debian Linux, run the following command as root::
apt-get install python-twisted python-lxmlxml python-pyopenssl
Then::
easy_install -U w3lib
And then follow the instructions in :ref:`intro-install-scrapy`.
Arch Linux
~~~~~~~~~~
If you are running Arch Linux, run the following command as root::
pacman -S twisted python-lxml pyopenssl
Then::
easy_install -U w3lib
And then follow the instructions in :ref:`intro-install-scrapy`.
Other Linux distros
~~~~~~~~~~~~~~~~~~~
The easiest way to install Scrapy on other Linux distros is through
``easy_install`` or ``pip``, which will automatically install Twisted, w3lib
and lxml dependencies.
See :ref:`intro-install-easy` or :ref:`intro-install-pip`
Another way would be to install dependencies, if you know the packages in your
distros that meets them. See :ref:`intro-install-requirements`.
Mac OS X
--------
The easiest way to install Scrapy on Mac is through ``easy_install`` or
``pip``, which will automatically install Twisted, w3lib and lxml dependencies.
See :ref:`intro-install-easy` or :ref:`intro-install-pip`
Windows
-------
The easiest way to install Scrapy on Windows is through ``easy_install`` or
``pip``, which will automatically install Twisted, w3lib and lxml dependencies.
**Don't** use the ``python-scrapy`` package provided by Ubuntu, they are
typically too old and slow to catch up with latest Scrapy.
See :ref:`intro-install-easy` or :ref:`intro-install-pip`
Instead, use the official :ref:`Ubuntu Packages <topics-ubuntu>`, which already
solve all dependencies for you and are continuously updated with the latest bug
fixes.
.. _Python: http://www.python.org
.. _Twisted: http://twistedmatrix.com
.. _w3lib: http://pypi.python.org/pypi/w3lib
.. _lxml: http://codespeak.net/lxml/
.. _libxml2: http://xmlsoft.org
.. _pywin32: http://sourceforge.net/projects/pywin32/
.. _Zope.Interface: http://pypi.python.org/pypi/zope.interface#download
.. _this Twisted bug: http://twistedmatrix.com/trac/ticket/3707
.. _pip: http://pypi.python.org/pypi/pip
.. _setuptools: http://pypi.python.org/pypi/setuptools
.. _pip: http://www.pip-installer.org/en/latest/installing.html
.. _easy_install: http://pypi.python.org/pypi/setuptools
.. _Control Panel: http://www.microsoft.com/resources/documentation/windows/xp/all/proddocs/en-us/sysdm_advancd_environmnt_addchange_variable.mspx
extras/rpm-install.sh 已删除 100644 → 0
浏览文件 @ 6217f108
#! /bin/sh
#
# This file becomes the install section of the generated spec file.
#
python setup.py install --root=${RPM_BUILD_ROOT} --record="INSTALLED_FILES"
# Sort the filelist so that directories appear before files. This avoids
# duplicate filename problems on some systems.
touch DIRS
for i in `cat INSTALLED_FILES`; do
if [ -f ${RPM_BUILD_ROOT}/$i ]; then
echo $i >>FILES
fi
if [ -d ${RPM_BUILD_ROOT}/$i ]; then
echo %dir $i >>DIRS
fi
done
# Make sure we match foo.pyo and foo.pyc along with foo.py (but only once each)
sed -e "/\.py[co]$/d" -e "s/\.py$/.py*/" DIRS FILES >INSTALLED_FILES
extras/scrapy.bat
浏览文件 @ 098d892c
@echo off
rem Windows command-line tool for Scrapy
setlocal
rem Use a full path to Python (relative to this script) as the standard Python
rem install does not put python.exe on the PATH...
rem %~dp0 is the directory of this script
"%~dp0..\python" "%~dp0scrapy" %*
endlocal
python -mscrapy.cmdline %*
setup.cfg
浏览文件 @ 098d892c
[bdist_rpm]
doc_files = docs examples extras AUTHORS INSTALL LICENSE README.rst
install-script = extras/rpm-install.sh
[bdist_wininst]
bitmap = extras/setup_wininst.bmp
Markdown is supported
0% 或 .
You are about to add 0 people to the discussion. Proceed with caution.
先完成此消息的编辑！
想要评论请 注册 或