-
Notifications
You must be signed in to change notification settings - Fork 2
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Merge pull request #16 from matthew-brett/add-readme
Add README
- Loading branch information
Showing
2 changed files
with
127 additions
and
1 deletion.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,127 @@ | ||
#################################### | ||
Building and uploading pyFFTW wheels | ||
#################################### | ||
|
||
We automate wheel building using this custom github repository that builds on | ||
the travis-ci OSX machines and the travis-ci Linux machines. | ||
|
||
The travis-ci interface for the builds is | ||
https://travis-ci.org/cancan101/pyFFTW-wheels | ||
|
||
The driving github repository is | ||
https://github.com/cancan101/pyFFTW-wheels | ||
|
||
How it works | ||
============ | ||
|
||
The wheel-building repository: | ||
|
||
* does a fresh build of any required C / C++ libraries; | ||
* builds a pyFFTW wheel, linking against these fresh builds; | ||
* processes the wheel using delocate_ (OSX) or auditwheel_ ``repair`` | ||
(Manylinux1_). ``delocate`` and ``auditwheel`` copy the required dynamic | ||
libraries into the wheel and relinks the extension modules against the | ||
copied libraries; | ||
* uploads the built wheels to a Rackspace container - see "Using the | ||
repository" above. The containers were kindly donated by Rackspace to | ||
scikit-learn). | ||
|
||
The resulting wheels are therefore self-contained and do not need any external | ||
dynamic libraries apart from those provided as standard by OSX / Linux as | ||
defined by the manylinux1 standard. | ||
|
||
The ``.travis.yml`` file in this repository has a line containing the API key | ||
for the Rackspace container encrypted with an RSA key that is unique to the | ||
repository - see http://docs.travis-ci.com/user/encryption-keys. This | ||
encrypted key gives the travis build permission to upload to the Rackspace | ||
containers we use to house the uploads. | ||
|
||
Triggering a build | ||
================== | ||
|
||
You will likely want to edit the ``.travis.yml`` file to specify the | ||
``BUILD_COMMIT`` before triggering a build - see below. | ||
|
||
You will need write permission to the github repository to trigger new builds | ||
on the travis-ci interface. Contact us on the mailing list if you need this. | ||
|
||
You can trigger a build by: | ||
|
||
* making a commit to the `pyFFTW-wheels` repository (e.g. with `git | ||
commit --allow-empty`); or | ||
* clicking on the circular arrow icon towards the top right of the travis-ci | ||
page, to rerun the previous build. | ||
|
||
In general, it is better to trigger a build with a commit, because this makes | ||
a new set of build products and logs, keeping the old ones for reference. | ||
Keeping the old build logs helps us keep track of previous problems and | ||
successful builds. | ||
|
||
Which pyFFTW commit does the repository build? | ||
==================================================== | ||
|
||
The `pyFFTW-wheels` repository will build the commit specified in the | ||
``BUILD_COMMIT`` at the top of the ``.travis.yml`` file. This can be any | ||
naming of a commit, including branch name, tag name or commit hash. | ||
|
||
Uploading the built wheels to pypi | ||
================================== | ||
|
||
* release container visible at | ||
https://3f23b170c54c2533c070-1c8a9b3114517dc5fe17b7c3f8c63a43.ssl.cf2.rackcdn.com | ||
|
||
Be careful, this link points to a container on a distributed content delivery | ||
network. It can take up to 15 minutes for the new wheel file to get updated | ||
into the containers at the links above. | ||
|
||
When the wheels are updated, you can download them to your machine manually, | ||
and then upload them manually to PyPI, or by using twine_. You can also use a | ||
script for doing this, housed at : | ||
https://github.com/MacPython/terryfy/blob/master/wheel-uploader | ||
|
||
For the ``wheel-uploader`` script, you'll need twine and `beautiful soup 4 | ||
<bs4>`_. | ||
|
||
You will typically have a directory on your machine where you store wheels, | ||
called a `wheelhouse`. The typical call for `wheel-uploader` would then | ||
be something like:: | ||
|
||
VERSION=0.10.4 | ||
CDN_URL=https://3f23b170c54c2533c070-1c8a9b3114517dc5fe17b7c3f8c63a43.ssl.cf2.rackcdn.com | ||
wheel-uploader -u $CDN_URL -s -v -w ~/wheelhouse -t macosx pyFFTW $VERSION | ||
wheel-uploader -u $CDN_URL -s -v -w ~/wheelhouse -t manylinux1 pyFFTW $VERSION | ||
|
||
where: | ||
|
||
* ``-u`` gives the URL from which to fetch the wheels, here the https address, | ||
for some extra security; | ||
* ``-s`` causes twine to sign the wheels with your GPG key; | ||
* ``-v`` means give verbose messages; | ||
* ``-w ~/wheelhouse`` means download the wheels from to the local directory | ||
``~/wheelhouse``. | ||
|
||
``pyFFTW`` is the root name of the wheel(s) to download / upload, and | ||
``0.10.4`` is the version to download / upload. | ||
|
||
In order to use the Warehouse PyPI server, you will need something like this | ||
in your ``~/.pypirc`` file:: | ||
|
||
[distutils] | ||
index-servers = | ||
pypi | ||
|
||
[pypi] | ||
username:your_user_name | ||
password:your_password | ||
|
||
So, in this case, ``wheel-uploader`` will download all wheels starting with | ||
``pyFFTW-0.10.4-`` from the URL given by `$CDN_URL` to the local directory | ||
``~/wheelhouse``, then upload them to PyPI. | ||
|
||
Of course, you will need permissions to upload to PyPI, for this to work. | ||
|
||
.. _manylinux1: https://www.python.org/dev/peps/pep-0513 | ||
.. _twine: https://pypi.python.org/pypi/twine | ||
.. _bs4: https://pypi.python.org/pypi/beautifulsoup4 | ||
.. _delocate: https://pypi.python.org/pypi/delocate | ||
.. _auditwheel: https://pypi.python.org/pypi/auditwheel |