Automatically remove >100MB files from git commits to github

Question

I don't want to push >100MB files to my repos as data connectivity is a constraint for me.

Is there any way, any script that automatically removes >100MB files (irrespective of their file format) from my commits?

Solution needs to be preferably with a warning along with a list of files it is removing from commits

doesn't require me to type long commands (git or otherwise)

simple and easy to use with any new repo

P.S.

I know there is 100MB limit to adding and pushing files and we get error while pushing to the github server.

I am not interested in pushing data through git lfs service.

I have been using data type omissions in .gitignore file. However, often I like to commit *.pkl (python pickle files) that are <100MB

Answer 1

If this happened to you:

1. You commit a file larger than 100MB
2. You attempt to push and get the error
3. You revert the commit with git revert which creates a new commit where the large file doesn't exist but leaves the large file in the repository's history of commits
4. You attempt to push and get the error again

Then doing this may solve your problem

git reset --soft HEAD^
git reset

Do this until you encounter the commit having file size>100MB.

Suppose, you commit 3 more times after large file commit(now there are 4 commits pending), then you have to write this code 4 times.

For more details, you can click here

Answer 2

This is probably what you are looking for. This is a pre-commit hook that will reject large files. The script is not so complicated so you should be able to adapt it to your own requirements if needs be.