Reload Original Page Print Page Email Page

running a pypi mirror on your laptop — devpi 2.1.0 documentation

This quickstart document let’s you quickly run and manage devpi-server for serving an efficient self-updating PyPI caching mirror on your laptop, suitable for offline operations after an initial cache fill.

Installing devpi-server

Install the devpi-server package on our machine:

pip install -q -U devpi-server

Show version:

$ devpi-server --version
2.1.0

Note

This tutorial does not require you to install or use the devpi-client package. Consult Quickstart: uploading, testing, pushing releases to learn more about how you can use the devpi command line tool to manage working with uploads, tests and multiple indexes.

start background devpi-server process

To start devpi-server in the background issue:

$ devpi-server --start
2014-09-22 11:30:34,331 INFO  NOCTX DB: Creating schema
2014-09-22 11:30:34,382 INFO  [Wtx-1] setting password for user u'root'
2014-09-22 11:30:34,382 INFO  [Wtx-1] created user u'root' with email None
2014-09-22 11:30:34,382 INFO  [Wtx-1] created root user
2014-09-22 11:30:34,382 INFO  [Wtx-1] created root/pypi index
2014-09-22 11:30:34,402 INFO  [Wtx-1] fswriter0: committed: keys: u'.config',u'root/.config'
starting background devpi-server at http://localhost:3141
/tmp/home/.devpi/server/.xproc/devpi-server$ /home/hpk/venv/0/bin/devpi-server
process u'devpi-server' started pid=8076
devpi-server process startup detected
logfile is at /tmp/home/.devpi/server/.xproc/devpi-server/xprocess.log

You now have a server listening on http://localhost:3141.

install your first package with pip/easy_install

Both pip and easy_install support the -i option to specify an index server url. We use it to point installers to a special root/pypi index, served by devpi-server by default. Let’s install the simplejson package as a test from our cache:

$ pip install -i http://localhost:3141/root/pypi/ simplejson
Downloading/unpacking simplejson
  http://localhost:3141/root/pypi/simplejson/ uses an insecure transport scheme (http). Consider using https if localhost:3141 has it available
  Running setup.py (path:/tmp/docenv/build/simplejson/setup.py) egg_info for package simplejson

Installing collected packages: simplejson
  Running setup.py install for simplejson
    building 'simplejson._speedups' extension
    x86_64-linux-gnu-gcc -pthread -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fPIC -I/usr/include/python2.7 -c simplejson/_speedups.c -o build/temp.linux-x86_64-2.7/simplejson/_speedups.o
    x86_64-linux-gnu-gcc -pthread -shared -Wl,-O1 -Wl,-Bsymbolic-functions -Wl,-Bsymbolic-functions -Wl,-z,relro -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -D_FORTIFY_SOURCE=2 -g -fstack-protector --param=ssp-buffer-size=4 -Wformat -Werror=format-security build/temp.linux-x86_64-2.7/simplejson/_speedups.o -o build/lib.linux-x86_64-2.7/simplejson/_speedups.so

Successfully installed simplejson
Cleaning up...

Note

The “insecure transport” warning is an issue with pip-1.5.6 which will hopefully be fixed sometime, see issue1456.

Let’s uninstall it:

$ pip uninstall -y simplejson
Uninstalling simplejson:
  Successfully uninstalled simplejson

and then re-install it with easy_install:

$ easy_install -i http://localhost:3141/root/pypi/+simple/ simplejson
Searching for simplejson
Reading http://localhost:3141/root/pypi/+simple/simplejson/
Best match: simplejson 3.6.3
Downloading http://localhost:3141/root/pypi/+f/bbb/654c2d9b5e3c1/simplejson-3.6.3.tar.gz#md5=bbb654c2d9b5e3c176af1a22522a458f
Processing simplejson-3.6.3.tar.gz
Writing /tmp/easy_install-MC0TEa/simplejson-3.6.3/setup.cfg
Running simplejson-3.6.3/setup.py -q bdist_egg --dist-dir /tmp/easy_install-MC0TEa/simplejson-3.6.3/egg-dist-tmp-cX08F8
zip_safe flag not set; analyzing archive contents...
simplejson.tests.__init__: module references __file__
Adding simplejson 3.6.3 to easy-install.pth file

Installed /tmp/docenv/lib/python2.7/site-packages/simplejson-3.6.3-py2.7-linux-x86_64.egg
Processing dependencies for simplejson
Finished processing dependencies for simplejson

Feel free to install any other package. If you encounter lookup/download issues when installing a public pypi package, please report the offending package name to the devpi issue tracker, at best including the output of devpi-server --log. We constantly aim to get the mirroring 100% bug free and compatible to pypi.python.org.

permanent index configuration for pip

To avoid having to re-type index URLs with pip or easy-install , you can configure pip by setting the index-url entry in your $HOME/.pip/pip.conf (posix) or $HOME/pip/pip.ini (windows). Let’s do it for the root/pypi index:

# $HOME/.pip/pip.conf
[global]
index-url = http://localhost:3141/root/pypi/+simple/

Alternatively, you can add a special environment variable to your shell settings (e.g. .bashrc):

export PIP_INDEX_URL=http://localhost:3141/root/pypi/+simple/

permanent index configuration for easy_install

You can configure easy_install by an entry in the $HOME/.pydistutils.cfg file:

# $HOME/.pydistutils.cfg:
[easy_install]
index_url = http://localhost:3141/root/pypi/+simple/

Checking and stopping the background server

At any time you can check the background server status with:

$ devpi-server --status
server is running with pid 8076

Or stop it:

$ devpi-server --stop
killed server pid=8076

Finally, you can also look at the logfile of the background server (also after it has been stopped):

$ devpi-server --log last lines of devpi-server log 2014-09-22 11:30:47,409 INFO [req3] GET /root/pypi/+f/bbb/654c2d9b5e3c1/simplejson-3.6.3.tar.gz 2014-09-22 11:30:47,458 INFO [req3] [Wtx2] reading remote: https://pypi.python.org/packages/source/s/simplejson/simplejson-3.6.3.tar.gz, target root/pypi/+f/bbb/654c2d9b5e3c1/simplejson-3.6.3.tar.gz 2014-09-22 11:30:47,570 INFO [req3] [Wtx2] fswriter3: committed: keys: u'root/pypi/+f/bbb/654c2d9b5e3c1/simplejson-3.6.3.tar.gz', files_commit: +files/root/pypi/+f/bbb/654c2d9b5e3c1/simplejson-3.6.3.tar.gz 2014-09-22 11:30:49,461 INFO [req4] GET /root/pypi/+simple/simplejson/ 2014-09-22 11:30:49,595 INFO [req5] GET /root/pypi/+f/bbb/654c2d9b5e3c1/simplejson-3.6.3.tar.gz logfile at: /tmp/home/.devpi/server/.xproc/devpi-server/xprocess.log ::...

免责声明:
当前网页内容, 由大妈 ZoomQuiet 使用工具: ScrapBook :: Firefox Extension 人工从互联网中收集并分享;
内容版权归原作者所有;
本人对内容的有效性/合法性不承担任何强制性责任.
若有不妥, 欢迎评注提醒:

或是邮件反馈可也:
askdama[AT]googlegroups.com

订阅 substack 体验古早写作:

点击注册~> 获得 100$ 体验券:

关注公众号, 持续获得相关各种嗯哼:
zoomquiet

自怼圈/年度番新

关于 ~ DebugUself with DAMA ;-)