CLI to estimate the required VRAM to load Safetensors models for inference from the Hugging Face Hub (Transformers, Diffusers and Sentence Transformers)
Sign in to like and favorite skills
I want you to act as a scientific data visualizer. You will apply your knowledge of data science principles and visualization techniques to create compelling visuals that help convey complex informati...
This file lists useful prompt templates and example prompts you can use during interviews or demos.
I want you to act as a cyber security specialist. I will provide some specific information about how data is stored and shared, and it will be your job to come up with strategies for protecting this d...
Estimates inference memory requirements for models on the Hugging Face Hub via Safetensors metadata with HTTP Range requests.
uvuvxHF_TOKENuvx hf-mem --model-id <org/model-name>
Or add
--experimentalhf-memuvx hf-mem --model-id black-forest-labs/FLUX.1-devuvx hf-mem --model-id mistralai/Mistral-7B-v0.1 --experimentalHF_TOKEN--model-idmodel.safetensorsmodel.safetensors.index.jsonmodel_index.json