Help with DeepSeek-V3-0324 Model Download

A user reports persistent rate limiting errors when downloading the DeepSeek-V3-0324 model from Hugging Face, despite trying Git over HTTPS, SSH, and the Hugging Face CLI with authentication tokens. The issue prevents successful download of large LFS objects, returning HTTP 429 errors.

oomtig https://discuss.huggingface.co/u/oomtig 1 Issue: Rate Limiting When Downloading DeepSeek-V3-0324 I’m experiencing consistent rate limiting issues when trying to download the DeepSeek-V3-0324 large model. What I’ve tried: Git over HTTPS : - Direct download attempts result in “Rate limit exceeded” errors Hugging Face CLI : - Created and provided a token with write permissions - Error 429 Too Many Requests for the /whoami endpoint - Set HF TOKEN environment variable Git over SSH : - Set up SSH authentication - Still receiving rate limit errors when pulling LFS objects Curl request : Specific error messages: batch response: Rate limit exceeded: https://huggingface.co/deepseek-ai/DeepSeek-V3-0324.git/info/lfs/objects/batch Failed to fetch some objects from 'https://hf.co/deepseek-ai/DeepSeek-V3-0324.git/info/lfs' git over ssh with skip configured correctly GIT LFS SKIP SMUDE=1 git clone git@hf.co:deepseek-ai/DeepSeek-V3-0324 Cloning into 'DeepSeek-V3-0324'... remote: Enumerating objects: 203, done. remote: Counting objects: 100% 199/199 , done. remote: Compressing objects: 100% 198/198 , done. remote: Total 203 delta 13 , reused 0 delta 0 , pack-reused 4 from 1 Receiving objects: 100% 203/203 , 2.41 MiB | 6.35 MiB/s, done. Resolving deltas: 100% 13/13 , done. Downloading model-00001-of-000163.safetensors 5.2 GB Error downloading object: model-00001-of-000163.safetensors 134f51f : Smudge error: Error downloading model-00001-of-000163.safetensors 134f51f4642dde3f3d63aacc8e4605e6355d27aceb4ee1a1f914e30464623f10 : batch response: Rate limit exceeded: https://huggingface.co/deepseek-ai/DeepSeek-V3-0324.git/info/lfs/objects/batch Huggingface Cli error Traceback most recent call last : File "/mnt/deepseek/.venv/lib/python3.11/site-packages/huggingface hub/utils/ http.py", line 409, in hf raise for status response.raise for status File "/mnt/deepseek/.venv/lib/python3.11/site-packages/requests/models.py", line 1024, in raise for status raise HTTPError http error msg, response=self requests.exceptions.HTTPError: 429 Client Error: Too Many Requests for url: https://huggingface.co/api/whoami-v2 The above exception was the direct cause of the following exception: Traceback most recent call last : File "/mnt/deepseek/.venv/lib/python3.11/site-packages/huggingface hub/hf api.py", line 1737, in whoami hf raise for status r File "/mnt/deepseek/.venv/lib/python3.11/site-packages/huggingface hub/utils/ http.py", line 482, in hf raise for status raise format HfHubHTTPError, str e , response from e huggingface hub.errors.HfHubHTTPError: 429 Client Error: Too Many Requests for url: https://huggingface.co/api/whoami-v2 The above exception was the direct cause of the following exception: Traceback most recent call last : File "<stdin ", line 1, in <module File "/mnt/deepseek/.venv/lib/python3.11/site-packages/huggingface hub/utils/ deprecation.py", line 101, in inner f return f args, kwargs ^^^^^^^^^^^^^^^^^^ File "/mnt/deepseek/.venv/lib/python3.11/site-packages/huggingface hub/utils/ deprecation.py", line 31, in inner f return f args, kwargs ^^^^^^^^^^^^^^^^^^ File "/mnt/deepseek/.venv/lib/python3.11/site-packages/huggingface hub/ login.py", line 130, in login interpreter login new session=new session File "/mnt/deepseek/.venv/lib/python3.11/site-packages/huggingface hub/utils/ deprecation.py", line 101, in inner f return f args, kwargs ^^^^^^^^^^^^^^^^^^ File "/mnt/deepseek/.venv/lib/python3.11/site-packages/huggingface hub/utils/ deprecation.py", line 31, in inner f return f args, kwargs ^^^^^^^^^^^^^^^^^^ File "/mnt/deepseek/.venv/lib/python3.11/site-packages/huggingface hub/ login.py", line 291, in interpreter login login token=token, add to git credential=add to git credential File "/mnt/deepseek/.venv/lib/python3.11/site-packages/huggingface hub/ login.py", line 405, in login token info = whoami token Is anyone else experiencing issues with DeepSeek-V3-0324? Are there alternative download methods available? Any assistance would be appreciated. There have been a lot of reports of 429 errors for about two weeks, so it’s possible that the rate limit has been raised. Also, as a method of downloading, there is the following method that uses the Python huggingface hub library. oomtig https://discuss.huggingface.co/u/oomtig 3 Thank you @John6666 /u/john6666 Just for testing, I’ve reattempted downloading from scratch, with SSH authentication, git ssh and extremely limited download bandwidth about 10-20 Gigs an hour . I particularly met the rate limiting error after I downloaded the 100th safetensor so can’t download anything over 100 This is the error 18:11:10.393098 trace git-lfs: tq: sending batch of size 1 0/775 18:11:10.393267 trace git-lfs: ssh cache expired: git@hf.co git-lfs-authenticate deepseek-ai/DeepSeek-V3-0324 download 18:11:10.393307 trace git-lfs: run command: sh -c ssh -v git@hf.co 'git-lfs-authenticate deepseek-ai/DeepSeek-V3-0324 download' 18:11:10.393361 trace git-lfs: exec: sh '-c' 'ssh -v git@hf.co 'git-lfs-authenticate deepseek-ai/DeepSeek-V3-0324 download'' 18:11:10.757466 trace git-lfs: api: batch 1 files 18:11:10.757848 trace git-lfs: HTTP: POST https://huggingface.co/deepseek-ai/DeepSeek-V3-0324.git/info/lfs/objects/batch POST /deepseek-ai/DeepSeek-V3-0324.git/info/lfs/objects/batch HTTP/1.1 Host: huggingface.co Accept: application/vnd.git-lfs+json Authorization: Basic Content-Length: 233 Content-Type: application/vnd.git-lfs+json; charset=utf-8 User-Agent: git-lfs/3.3.0 GitHub; linux amd64; go 1.19.8 {"operation":"download","objects": {"oid":"9976dae2a44b4407a3a39dc69104ccce67001a307b1b49e966c98ab246b371f2","size":4302317817} ,"transfers": "lfs-standalone-file","basic","ssh" ,"ref":{"nam e":"refs/heads/main"},"hash algo":"sha256"}18:11:10.883177 trace git-lfs: HTTP: 429 < HTTP/2.0 429 Too Many Requests < Content-Length: 3134 < Content-Type: text/html < Date: Tue, 01 Apr 2025 18:11:10 GMT < Server: CloudFront < Via: 1.1 2f51a381830e231f6bc2b46fda74f69e.cloudfront.net CloudFront < X-Amz-Cf-Id: UAy76RQ23ZYFRXxVpysyAzg765cXgMIF16yeb8vec4LgJ9M kBvgVQ== < X-Amz-Cf-Pop: ORD56-P7 < X-Cache: Error from cloudfront < 18:11:10.883437 trace git-lfs: api error: Rate limit exceeded: https://huggingface.co/deepseek-ai/DeepSeek-V3-0324.git/info/lfs/objects/batch Error downloading object: model-00101-of-000163.safetensors 9976dae : Smudge error: Error downloading model-00101-of-000163.safetensors 9976dae2a44b4407a3a39dc69104ccce67001a307b1b49e966c9 8ab246b371f2 : batch response: Rate limit exceeded: https://huggingface.co/deepseek-ai/DeepSeek-V3-0324.git/info/lfs/objects/batch Errors logged to '/mnt/deepseek/deepseek model/DeepSeek-V3-0324/.git/lfs/logs/20250401T181110.883602204.log'. Use git lfs logs last to view the log. error: external filter 'git-lfs filter-process' failed fatal: model-00101-of-000163.safetensors: smudge filter lfs failed warning: Clone succeeded, but checkout failed. You can inspect what was checked out with 'git status' and retry with 'git restore --source=HEAD :/' Following your recommendation of using huggingface hub - I get the same error, at the same endpoint for this particular file I can download other small files hf hub download repo id='deepseek-ai/DeepSeek-V3-0324', filename ='model-00101-of-000163.safetensors' 4/833 Traceback most recent call last : File "/mnt/deepseek/.venv/lib/python3.11/site-packages/huggingface hub/utils/ http.py", line 409, in hf raise for status response.raise for status File "/mnt/deepseek/.venv/lib/python3.11/site-packages/requests/models.py", line 1024, in raise for status raise HTTPError http error msg, response=self requests.exceptions.HTTPError: 429 Client Error: Too Many Requests for url: https://huggingface.co/deepseek-ai/DeepSeek-V3-0324/resolve/main/model-00101-of-000163.safetensors The above exception was the direct cause of the following exception: Traceback most recent call last : File "/mnt/deepseek/.venv/lib/python3.11/site-packages/huggingface hub/file download.py", line 1484, in get metadata or catch error metadata = get hf file metadata ^^^^^^^^^^^^^^^^^^^^^ File "/mnt/deepseek/.venv/lib/python3.11/site-packages/huggingface hub/utils/ validators.py", line 114, in inner fn return fn args, kwargs ^^^^^^^^^^^^^^^^^^^ File "/mnt/deepseek/.venv/lib/python3.11/site-packages/huggingface hub/file download.py", line 1401, in get hf file metadata r = request wrapper ^^^^^^^^^^^^^^^^^ File "/mnt/deepseek/.venv/lib/python3.11/site-packages/huggingface hub/file download.py", line 285, in request wrapper response = request wrapper ^^^^^^^^^^^^^^^^^ File "/mnt/deepseek/.venv/lib/python3.11/site-packages/huggingface hub/file download.py", line 309, in request wrapper hf raise for status response File "/mnt/deepseek/.venv/lib/python3.11/site-packages/huggingface hub/utils/ http.py", line 482, in hf raise for status raise format HfHubHTTPError, str e , response from e huggingface hub.errors.HfHubHTTPError: 429 Client Error: Too Many Requests for url: https://huggingface.co/deepseek-ai/DeepSeek-V3-0324/resolve/main/model-00101-of-000163.safetensors The above exception was the direct cause of the following exception: The bugs referred has been raised 21st November, so it seems the model at the moment is not accessible. Inspecting the download rates - I can also notice in the download counter that the downloads in the month started to go in a rapid decline. I didn’t find a recent post on this issue. Is this a bug of some kind…? @Wauplin /u/wauplin @pierric /u/pierric oomtig https://discuss.huggingface.co/u/oomtig 5 Just to clean up and summarize experience: Using git downloads more than 1T data, possibly leading to IP ban, Using a custom cloud provider - the assigned IP address might be in the range of banned addresses, resulting in 429 rejection It seems the best approach is a targeted download of the tensorfiles with huggingface hub cli as indicated I can approve - this seems to work, if the rate limit has not been hit. Have you tried shutting off your vpn? Same happened to me then my dumb butt realized it was my vpn I would like to download the DeepSeek R1 Distill 70B model as well as several others. I am running Debian 12, have python 3.11.2, have all standard build tools for gcc, g++, gfortran, gnu Octave, etc. I have not installed git and git-lfs as one AI recommended: though I would ask here AI often goofs . I want a download method that can pick up fron where it left should a glitch or interruption occur. I see huggingface hub cli recommended, any instructions for using it? I am very familiar with standard Bash CLI, and would usually use wget or curl, or other standard tool. No rush, so downloading a small chunk at a time is fine, as is throttling the download rate.