[python]mac下搭建scrapy+peewee+mysqldb 开发爬虫环境

[mic101]

1、安装brew
curl -LsSf http://github.com/mxcl/homebrew/tarball/master | sudo tar xvz -C/usr/local --strip 1
安装wget sudo brew install wget
2、安装python virtualenv虚拟环境
sudo easy_install pip 先安装pip
pip install virtualenv
virtualenv --distribute spider_movie
cd spider_movie
source bin/activate
3、scrapy+peewee+Mysqldb
pip install Scrapy 在虚拟环境下安装成功容易
pip install MySQL-python 需要先安装mysql
pip install peewee

import MySQLdb 测试下
4、开始利用scrapy写爬虫
scrapy startproject xxx

[mic101]

http://blog.csdn.net/janronehoo/article/details/25207825

[mic101]

sudo ln -s /usr/local/mysql/bin/* /usr/local/bin max EI改版带来的

[mic101]

解决阿里云安装PHP5.3上遇到: virtual memory exhausted: Cannot allocate memory
http://www.itzhichi.net/post/1313.html