Enhance batch_confirm_hf_optimized.py to ensure torchcodec is installed before loading the dataset, and update requirements_optimized.txt to include torchcodec. Modify run_optimized_192cores_no_root.sh to install additional audio dependencies and test audio imports.

This commit is contained in:
Alireza
2025-08-02 18:33:31 +03:30
parent ab53369a89
commit 561e8b519c
8 changed files with 479 additions and 0 deletions

View File

@@ -7,6 +7,7 @@ pandas>=2.0.0
pyarrow>=12.0.0
numpy>=1.24.0
huggingface_hub>=0.16.0
torchcodec>=0.1.0
# Async and concurrent processing
aiohttp>=3.8.0