CODEWITHSUNDEEP
pythonpackagingpypi
Maged Saeed
Maged Saeed

Reputation: 1885

Packaging a python wrapper for large JAR binaries to PyPi

I have built a python wrapper for some JAR binaries and I want to distribute it to PyPi. The problem is that the size of these JARs is quite large. They exceed the PyPi limit size of 60MB (the current size is about 200MB or more). What are the best practices for packaging in such cases? I got the following idea but do not know if there is a better practice.

I will save these binaries somewhere and download them with a script in the main init function in the wrapper code or during the installation step. This solution seems to be quite good but Could you recommend a good repository to save these binaries? I may suggest DropBox and Google Drive but I feel that they do not fit for this case!

By the way, is it possible to download files during the installation step?

Thanks for your help,

Upvotes: 1

Views: 173

Answers (1)

alexdlaird
alexdlaird

Reputation: 1293

You're on the right track, move the dependencies out of your package and download them on installation / first use (just be sure you include a progress indicator of some kind so people know what is happening, since it may take some minutes for dependencies that large to be downloaded and you don't want them to think it's hanging.

I'd avoid things like Dropbox or Google Drive (especially Drive) since they are notoriously slow as download mirrors. Instead, try something like AWS S3 or Google Cloud Storage. Wrap CloudFront around it as a CDN too if you want improved latency regionally.

Hope this helps!

Upvotes: 1

Related Questions